Running Large Language Models – “LLMs” locally on Android & Booting Ubuntu / other Linux distros and apps within Android.

Hello my nerdy, Android-loving friends!

Ever want to chat to a top level AI assistant – locally? Without the internet? Privately?

Interested in downloading a 5GB offline file that basically contains an abundance of the world’s knowledge?

This is going to be a quick tutorial on running LLMs (Large Language Models) such as Llama 3.1, and their uncensored variants – within Android.

I also touch on how to boot Linux distros such as Ubuntu and Debian within Android! Use any Linux ARM app right on your phone!

I plan on documenting as many of my “side quest” projects as possible to bring you fun and educational project ideas – and hopefully some of these projects find themselves useful in your day to day tech life!

This tutorial features apps such as “Private AI”, “Andronix”, “Termux” and a VNC client such as “RVNC” in order to accomplish our end goal – being able to chat privately to an AI assistant – OR boot any app available for ARM Ubuntu – right inside your phone. Enjoy!