What open source generative AI models and related code we can use on modern smart phones

Generative models on "modern" mobile phones have the potential to revolutionize the way we interact with our devices. They could be used to generate personalized content, create new forms of entertainment, and improve the accuracy of machine translation. However, there are still a number of challenges that need to be addressed before generative models can be used effectively on mobile phones. In this talk, I will use Stable Diffusion and llama.cpp as main examples talk about how people try to address these challenges. Despite these challenges, there is a lot of potential for generative models on mobile phones. As the technology continues to develop, we can anticipate seeing a wide range of new and innovative applications for generative models on mobile devices.

講者

Koan-Sin Tan

Koan-Sin Tan is an old programmer, who learned to use “open source” stuff on VAX-11/780 running 4.3BSD before the term “open source” was coined. He is interested in running neural networks on edge devices the past 7 years. He is a TensorFlow contributor. He converted Stable Diffusion to tflite format and wrote some glue code for it [1].

[1] https://github.com/freedomtan/keras_cv_stable_diffusion_to_tflite/