I have pocketpal setup on my pixel with graphene os and its pretty awesome. I agree that AI is inherently bad considering the environmental impact and the amount of data that is illegally needed to train AI.

That being said pocketpal is openaoirce and is great. https://github.com/a-ghorbani/pocketpal-ai