Offline AI language models for Mobiles
August 30, 2025•104 words
Offline AI: Apps & Tools Bring Language Models to Your Device
PocketPal AI
An app that brings language models directly to your phone.
https://github.com/a-ghorbani/pocketpal-ai
https://sites.google.com/llm-ventures.com/pocketpal
https://play.google.com/store/apps/details?id=com.pocketpalai
https://alternativeto.net/software/pocketpal/about/
Google AI Edge Gallery
https://github.com/google-ai-edge/gallery
Layla
https://www.layla-network.ai/
https://r2-assets.layla-cloud.com/releases/layla-v5.6.6-direct.apk
ChatterUI
Vali-98/ChatterUI: Simple frontend for LLMs built in react-native.
https://github.com/Vali-98/ChatterUI
Maid AI
https://github.com/Mobile-Artificial-Intelligence/maid
https://alternativeto.net/software/maid-ai-/about/
SillyTavern
https://github.com/SillyTavern/SillyTavern
Jan.ai
https://alternativeto.net/software/jan-ai/about/
https://github.com/menloresearch/jan
Models:
Format: .gguf .litertlm
.task
GGUF
https://huggingface.co/docs/hub/gguf
https://huggingface.co/docs/transformers/gguf
GGUF versus GGML
https://www.ibm.com/think/topics/gguf-versus-ggml
How to convert any HuggingFace Model to gguf file format?
https://www.geeksforgeeks.org/machine-learning/how-to-convert-any-huggingface-model-to-gguf-file-format/
Search : GGUF on Huggingface
https://huggingface.co/models?library=gguf
UmeAiRT/ComfyUI-Autoinstaller
https://huggingface.co/UmeAiRT/ComfyUI-Autoinstaller
https://huggingface.co/unsloth/Llama-3.2-1B-Instruct-GGUF
https://huggingface.co/MaziyarPanahi/Phi-3.5-mini-instruct-GGUF
https://huggingface.co/bartowski/gemma-2-2b-it-GGUF
https://huggingface.co/mradermacher/OREAL-7B-i1-GGUF
https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1-GGUF
https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct-GGUF
https://huggingface.co/Qwen/Qwen2.5-3B-Instruct-GGUF
https://huggingface.co/bartowski/SmolLM2-1.7B-Instruct-GGUF
https://huggingface.co/hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF