Meta, on Tuesday, launched its largest-ever open-source AI model Llama 3.1 405B, and claims to have closed the performance gap with top closed-source models such as Open AI’s GPT-4o and Anthropic’s Claude 3.5 Sonnet. The latest iteration of Llama, which has 405 billion parameters, was trained on a massive 15 trillion tokens using 16,000 of Nvidia’s ultra-expensive H100 GPUs.
