Skip to content

Add off-grid-mobile: on-device LLM + vision + image gen (React Native, iOS)#3263

Open
alichherawalla wants to merge 1 commit intovsouza:masterfrom
alichherawalla:add-off-grid-mobile
Open

Add off-grid-mobile: on-device LLM + vision + image gen (React Native, iOS)#3263
alichherawalla wants to merge 1 commit intovsouza:masterfrom
alichherawalla:add-off-grid-mobile

Conversation

@alichherawalla
Copy link

What

Adds off-grid-mobile to the Machine Learning section.

About the project

off-grid-mobile is an open source React Native app (MIT) that runs LLMs, vision models, and Stable Diffusion fully on-device on iOS (and Android). Uses Core ML for image generation on iOS.

  • On-device LLM inference (llama.cpp via llm.rn)
  • On-device vision/multimodal models
  • On-device text-to-image via Core ML / Stable Diffusion Swift
  • No internet, no accounts, no data leaves the device
  • MIT license, actively maintained

Good real-world example of production Core ML + llama.cpp integration in a React Native iOS app.

@alichherawalla
Copy link
Author

hey @vsouza , could you please take a look?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant