AI advancements in 2024

2024 has been a landmark year for artificial intelligence, with rapid progress across research, products, and policy. Here's a rundown of the developments I think mattered most, and I'd love to hear what others think.

1. Multimodal models went mainstream. Systems like OpenAI's GPT-4o, Google's Gemini 1.5, and Anthropic's Claude 3.5 can now reason across text, images, audio, and video in a single model, with far larger context windows (up to 1M+ tokens). Real-time voice conversation moved from demo to product.

2. Open-weight models closed the gap. Meta's Llama 3.1 (including the 405B model), Mistral, and others showed that openly available models can rival proprietary ones on many benchmarks, accelerating local and on-device deployment.

3. Reasoning and agents. New "reasoning" models such as OpenAI's o1 that think step-by-step before answering pushed performance on math, coding, and science. Agentic workflows that plan, call tools, and act became a major product focus.

4. Generative video. Tools like OpenAI's Sora, Runway Gen-3, and Google's Veo dramatically improved text-to-video quality, raising both creative possibilities and real concerns about deepfakes.

5. AI in science. AlphaFold 3 extended structure prediction to DNA, RNA, and ligand interactions, and the 2024 Nobel Prizes recognized foundational AI work (chemistry for protein structure/design, physics for neural network foundations).

6. Hardware and cost. Nvidia's Blackwell generation and intense competition pushed capability higher while reigniting debates about data-center energy use and efficiency.

7. Regulation. The EU AI Act entered into force, and governments worldwide moved toward safety testing, transparency, and disclosure rules.

Open questions: Are we hitting diminishing returns from scaling, or will reasoning plus tools keep pushing capabilities? How should we handle copyright, jobs, energy, and safety? What do you think was the most important development of 2024 - or the most overhyped?