Google Gemini 2 AI model (just released) were trained with over 100,000 Trillium chips have been deployed in a single network fabric, enabling massive-scale AI operations. xAI has already trained Grok 3 with 100,000 Nvidia H100s but has not released it yet. xAI has added 100,000 chips and will train Grok 4 with 200,000 Nvidia ...

Read more

---

Link :
https://www.nextbigfuture.com/2024/12/google-versus-xai-ai-compute-scaling.html