Chinese startup DeepSeek has released DeepSeek-V3. According to the benchmarks they shared, this is now the most capable open-source large language model currently available. It even achieves performance comparable to leading closed-source models even though it was trained on a budget of just $5.6 million—a fraction of what major tech companies typically spend.
-
DeepSeek-V3 was trained using just 2.8 million GPU hours, costing approximately $5.6 million - significantly less than competitors.
-
The model achieves performance comparable to GPT-4 and Claude 3.5 on various benchmarks, particularly excelling in mathematics and coding tasks.
-
The model's efficiency comes from innovative architecture and training techniques, including a novel approach to training called auxiliary-loss-free load balancing.