LiteRT Community

LiteRT is Google's on-device framework for high-performance ML & GenAI deployment on edge platforms. It is the improved successor to TensorFlow Lite. On this community page, you can find ready-to-run LiteRT models for a wide range of ML/AI tasks.

Within this ecosystem, LiteRT-LM specializes in cutting edge GenAI. Recognizing that LLMs now function as complex pipelines of related models rather than single standalone models, LiteRT-LM leverages LiteRT to deliver an optimized solution for running LLMs on-device.

Both LiteRT and LiteRT-LM can run on a variety of devices including Android, iOS, Windows, macOS, Linux and Web allow easy deployment and scaling across a diverse device landscape.

Trying it Live

Not sure where to start? We recommend first trying our models in our Google AI Edge Gallery app on Android.

Community Contributions

Are we missing your favorite model? You can convert and run PyTorch, TensorFlow, or JAX models to the classic TFLite format using the LiteRT conversion and optimization tools. Or for LLMs, you can use the LiteRT Torch Generative API. When your model is ready, join the LiteRT community org and upload the model here for others to try!