llamdrop

llamdrop is a free, open-source tool that automatically detects your hardware and runs appropriate AI models locally on devices including Android via Termux, old laptops, Raspberry Pi, and other single-board computers. It requires no configuration, subscription, or cloud dependency. The tool handles model selection and backend setup automatically.