Meet Flint from @Recursive_SI! A ~40B parameter MoE open model for fast, accurate agentic coding use case made to run on-device.
Flint can generate >125 tps on a M4 Pro Macbook Pro and >150 tps on a 64GB NVIDIA RTX Spark on short contexts.
Try it on Ollama today:
ollama run
Introducing Flint, @Recursive_SI’s first model: a fast local coding model built with our automated research system, the Eureka Machine.
• Best-in-class fast local coding
• Up to 2x faster than comparable models: 125+ tokens/sec on a MacBook Pro, 150+ on RTX Spark
• Built from
Many concerns this weekend about slowing down AI, some targeting open models.
We need to be responsible. But we can't let this slow down, or worse, prohibit open models. It's the wrong risk. Open models have tremendous power to democratize AI and make it more personal.
The
Small models are truly capable of the majority of conversational use cases and even a majority of difficult reasoning ones. Amazing work @Avanika15@JonSaadFalcon + team and great feature in @FT !
dreams do come true 🥹. excited to see our work (w/@JonSaadFalcon, @HazyResearch, john hennessy and @Azaliamirh) feat. in a major way in @FT. the world is becoming increasingly less dependent on centralized cloud ai. we are just getting started 🚀🌖