Vincenzo Fornaro and Colibrì: “I’m Not Interested in Genius, I’m Interested in Curiosity”
I have already written about Colibrì, telling how it is possible to run a 744-billion-parameter Mixture-of-Experts model on a computer with barely 25 GB of RAM, treating the disk as an intelligent memory tier rather than a simple storage bin (you can read the full technical analysis here). What was missing was the voice of… Read more
