Post by Vedang Vatsa FRSA

In 1994, Bill Gates sat on 330,000 sheets of paper to demonstrate a single CD-ROM's storage capacity. Today, a 2-million token context window holds the equivalent of four of those CD-ROMs in active LLM memory. We went from physical distribution constraints to real-time cognitive synthesis in 30 years. The scale of intelligence is outpacing the scale of data.