Cactus (YC S25)

Cross-platform open-source framework for deploying LLMs, VLMs, Embedding Models and TTS models locally on smartphones. Google AI Edge and Apple Foundation Frameworks are platform-specific and only support specific models from the companies. To this end, Cactus: - Is available in Flutter and React-Native for cross-platform developers, most apps are built with these today. - Supports any GGUF model you can find on Huggingface; Qwen, Gemma, Llama, DeepSeek, Phi, Mistral, SmolLM, SmolVLM, InternVLM, Jan Nano etc. - Accommodates from FP32 to as low as 2-bit quantized models, for better efficiency and less device strain. - Supports tool calling to make models performant and truly helpful (set reminder, gallery search, reply messages). Tell us how we can make it great! Join our Discord: https://lnkd.in/dk4TRYjk