NobodyWho

NobodyWho is an on-device inference engine that runs LLMs locally on any device, so called SLM. Developers can embed fast, scalable models into mobile and desktop apps with just a few lines of code. Because inference runs entirely on-device, no servers are required and applications scale automatically with user adoption. This significantly reduces both costs and overall footprint. The result is offline, privacy-preserving and sustainable AI. The library is open source under EUPL 1.2 and is free for both individuals and companies.