Oak Ridge National Laboratory is the world's largest supercomputing Frontier, with a collection of 37,888 MI250X GPUs and 9,472 Epyc7A53 CPUs.The researchers trained a GPT-3.5 scale model using only 8% GPUs.
The world's largest supercomputer, Frontier, uses 3072 AMDGPUs to train a super-trillion parameter LLM.
Previous: 美国防部称正快速提升AI能力