It is a GPU-accelerated local inference engine, built on llama.cpp and ONNX Runtime, that runs any GGUF chat LLM (Gemma, Qwen, Mistral, etc.) efficiently on desktop and mobile devices, with language bindings for Kotlin, Swift, React Native, Flutter, Python, and Godot.
It is most valuable when building apps that need AI features that work offline, keep user data on-device for privacy, avoid per-token API costs, or need low-latency responses without network round-trips. Note that it does not support web/WASM exports, so it targets native desktop and mobile apps rather than browser apps.