magnitudedev/magnitude
⭐ 4.0K
Magnitude is an open-source local inference server that profiles hardware to recommend and run suitable models on demand; it supports downloading, tuning, and on-the-fly loading, emphasizing offline operation and local data privacy for developers integrating agents and edge deployments.