exo-explore/exo
⭐ 35.6K (+1.1K)
exo unites heterogeneous everyday devices into a scalable distributed inference cluster, offering a ChatGPT-compatible API via dynamic partitioning and P2P architecture; suitable for private or resource-constrained self-hosted model inference, but verify license, network and stability risks before adoption.