Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News Editorials & Other Articles General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search

General Discussion

Showing Original Post only (View all)

usonian

(27,604 posts)
Wed Jul 15, 2026, 01:18 PM Wednesday

Mega Data Centers? NO. Your iPhone Is an OpenAI-Compatible LLM Server Now [View all]

This article touts an iphone app, free with ads, $1.99 without ads.

Ipads and some macs. (26 and M1 or newer)

I am posting it here not as a plug, but as a proof of concept, that mega data centers are a criminal waste of money, And just as you are using a home computer instead of a mainframe (do ya remember mainframes?) these monstrosities will serve only mega-companies and government surveillance and death goals.

https://www.kevin.md/iphone-openai-compatible-server.md/

TL;DR: Local LLM Server turns an iPhone, iPad, or Mac into an LLM server: Apple’s on-device Foundation Models exposed over an OpenAI- and Ollama-compatible HTTP API. Any existing client library points at your phone’s LAN address and just works. Free with ads; Pro is $1.99 without them.

Apple Intelligence ships a ~3B-parameter language model on every recent iPhone, running locally on the neural engine. It’s genuinely capable for structured tasks—classification, extraction, summaries—and it costs nothing per token. The catch: Apple exposes it as a Swift framework. If your tooling speaks HTTP—Python scripts, LangChain, DSPy, a curl one-liner, literally the entire LLM ecosystem—there’s no door in.

Local LLM Server is that door. Open the app, pick a port, hit Start Server, and the device serves at http://{your-lan-ip}:8080 with the two API shapes everything already understands: OpenAI’s (/v1/chat/completions and friends) and Ollama’s. Your OpenAI client library doesn’t know it’s talking to a phone.






4 replies = new reply since forum marked as read
Highlight: NoneDon't highlight anything 5 newestHighlight 5 most recent replies
Latest Discussions»General Discussion»Mega Data Centers? NO. Yo...