Run GPT-OSS 20B on Android via Your PC
Résumé
Pixel shares a guide to using Off Grid AI Mobile to chat with large models like GPT-OSS 20B and Llama 3.1 70B from an Android phone, while inference runs on a Mac or PC over Wi-Fi. It explains phone memory limits, computer RAM requirements, and support for Ollama and LM Studio, helping the community access powerful AI without sending data to the cloud.
DEV Community
How to Run GPT-OSS 20B and Llama 3.1 70B From Your Android Phone in 2026 (On Your Own Computer)
You can't fit a 20B or 70B model into an Android phone's memory, but you can run it on your own Mac or PC and use it from the phone. Off Grid AI Mobile (OGAM), the free Android app, finds Off Grid AI Desktop, Ollama or LM Studio on your Wi-Fi and lets you chat with whatever model the computer has loaded. The computer does the inference, the phone shows the answer, and nothing goes to a cloud. Get Off Grid AI on Google Play | All downloads What would you like to do with Off Grid AI? Have a feature or use case you would like us to support? Tell us what you want to do and which device you use. Write to [email protected], join our Slack community, or talk to us on Reddit. I build Off Grid AI. This walkthrough uses OGAM 0.0.124. If Ollama or LM Studio is already on your computer, you'll be done in a few minutes. The user-facing version lives on our site as the guide to using big AI models from your Android phone. The memory math on a phone On the phone, OGAM runs GGUF models with llama.cpp. A loaded model needs its file plus room for the conversation, and Android gives a single app well under the phone's total RAM. So OGAM sizes every file against your RAM. Under 52% runs well, up to 62% is Tight, and anything above that is Too big. Phone RAM Runs well Tight Too big 8 GB under 4.2 GB 4.2 to 5 GB over 5 GB 12 GB under 6.2 GB 6.2 to 7.4 GB over 7.4 GB 16 GB under 8.3 GB 8.3 to 9.9 GB over 9.9 GB That caps you at about 7B to 9B. Gemma 4 E4B, Qwen 3.5 4B or 9B and Llama 3.2 3B all fit. They're good for quick questions, rewrites and offline use. The models people actually pull on Ollama are another size class: Model Ollama download Computer memory to aim for GPT-OSS 20B 14 GB 24 GB Gemma 4 26B 16 to 19 GB 32 GB Qwen 3.5 27B 17 to 20 GB 32 GB Gemma 4 31B 19 to 20 GB 32 GB Llama 3.1 70B 43 GB 64 GB GPT-OSS 120B 65 GB 96 GB or more Download sizes come from the Ollama library on 16 Nov 2026. The memory column adds headroom for the conversation and the OS, so treat it as rough. None of these fit any phone. A 32 GB Mac or PC handles most of them. Expose a server on your LAN You need one inference server on the computer. Any of these works. Ollama. Pull a model, for example ollama pull gpt-oss:20b. By default Ollama only listens to the computer itself, so bind it to your network. On Mac or Linux: OLLAMA_HOST=0.0.0.0 ollama serve
On Windows, add a system environment variable OLLAMA_HOST with the value 0.0.0.0 and restart Ollama. LM Studio. Download the model, open the Developer tab, load it, start the server and turn on Serve on Local Network. Off Grid AI Desktop. Install it, open Models, download a model and select it. Ask it one question on the computer to make sure it answers. Its gateway listens on port 7878. Keep the computer awake and on the same Wi-Fi as the phone. Point OGAM at the server OGAM's Remote servers feature talks to OpenAI-compatible servers on your local network and streams the replies back. Ports are the defaults for each server. In OGAM, open Settings → Remote servers. Under Scan for, leave on what you use: Off Grid AI Desktop (7878), Ollama (11434), LM Studio (1234). Tap Scan network. OGAM checks your Wi-Fi and lists whatever answered. Turn on Auto-discover on Wi-Fi if you want it to look every time you open this screen. Scan came back empty? Tap Add manually, enter a name and the full address with port, such as http://192.168.1.50:11434 for Ollama. Tap Test connection, then Add server. Skip 127.0.0.1, because on the phone that's the phone. If Off Grid AI Desktop wants a key, OGAM tells you. Copy one from Desktop's Gateway → API keys and paste it into the server's API key field. The key stays on your phone. Select the remote model Open a chat and tap the model name. On-device models sit under Local Models. The computer's models sit under the server's name. Pick GPT-OSS 20B, or whatever you loaded, and send a prompt. Under Currently Loaded you'll see a Remote badge, so it's always clear where inference runs. ...

Powered by Readybot.io