Followers | 13 |
Posts | 1803 |
Boards Moderated | 0 |
Alias Born | 06/15/2011 |
![](http://investorshub.advfn.com/images/default_ih_profile2_4848.jpg?cb=0)
Wednesday, April 10, 2024 7:44:54 PM
Tech Industry Artificial Intelligence
Elon Musk says the next-generation Grok 3 model will require 100,000 Nvidia H100 GPUs to train
News
By Anton Shilov published yesterday
GPU shortages and power are the two main obstacles for AI development.
Nvidia GH200 SC23 Announcement
(Image credit: Nvidia)
Elon Musk, CEO of Tesla and founder of xAI, made some bold predictions about the development of artificial general intelligence (AGI) and discussed the challenges facing the AI industry. He predicts that AGI could surpass human intelligence as soon as next year or by 2026, but that it will take an extreme number of processors to train, which in turn requires huge amounts of electricity, reports Reuters.
Musk's venture, xAI, is currently training the second version of its Grok large language mode and expects to complete its next training phase by May. The training of Grok's version 2 model required as many as 20,000 Nvidia H100 GPUs, and Musk anticipates that future iterations will demand even greater resources, with the Grok 3 model needing around 100,000 Nvidia H100 chips to train.
Advertisement
The advancement of AI technology, according to Musk, is currently hampered by two main factors: supply shortages on advanced processors — like Nvidia's H100, as it's not easy to get 100,000 of them quickly — and the availability of electricity.
Nvidia's H100 GPU consumes around 700W when fully utilized, and thus 100,000 GPUs for AI and HPC workloads could consume a whopping 70 megawatts of power. Since these GPUs need servers and cooling to operate, it's safe to say that a datacenter with 100,000 Nvidia H100 processors will consume around 100 megawatts of power. That's comparable to the power consumption of a small city.
Musk stressed that while the compute GPU supply has been a significant obstacle so far, the supply of electricity will become increasingly critical in the next year or two. This dual constraint underscores the challenges of scaling AI technologies to meet growing computational demands.
Despite the challenges, advancements in compute and memory architectures will enable the training of increasingly massive large language models (LLMs) in the coming years. Nvidia revealed its Blackwell B200 at GTC 2024, a GPU architecture and platform that's designed to scale to LLMs with trillions of parameters. This will play a critical role in development of AGI.
In fact, Musk believes than an artificial intelligence smarter than the smartest human will emerge in the next year or two. "If you define AGI as smarter than the smartest human, I think it is probably next year, within two years," Musk said in an interview on X Spaces. That means it's apparently time to go watch Terminator again, and hope that our future AGI overlords will be nicer than Skynet.
Recent NVDA News
- U.S. Stocks Close Mixed Following Lackluster Session • IH Market News • 06/21/2024 08:38:41 PM
- Honeywell Acquires CAES Systems for $1.9 Billion, Sarepta Therapeutics Surges 34%, Gilead Continues Gains • IH Market News • 06/21/2024 12:00:38 PM
- U.S. Futures Decline Ahead of Triple Witching, Oil Prices Edge Lower • IH Market News • 06/21/2024 12:00:27 PM
- Dow Closes Firmly Positive But Nasdaq, S&P 500 Give Back Ground • IH Market News • 06/20/2024 08:30:11 PM
- Nvidia May Lead Early Upward Move On Wall Street • IH Market News • 06/20/2024 01:10:49 PM
- U.S. Index Futures Surge; Oil Prices Increase • IH Market News • 06/20/2024 10:56:57 AM
- Trump Media Resells Stocks and Warrants; KB Home Exceeds Q2 Expectations, and More News • IH Market News • 06/20/2024 10:55:11 AM
- Nvidia Overtakes Microsoft To Become World’s Most Valuable Company • IH Market News • 06/19/2024 09:32:08 AM
- Form 144 - Report of proposed sale of securities • Edgar (US Regulatory) • 06/18/2024 09:16:15 PM
- Hewlett Packard Enterprise and NVIDIA Announce ‘NVIDIA AI Computing by HPE’ to Accelerate Generative AI Industrial Revolution • Business Wire • 06/18/2024 04:30:00 PM
- Fisker Files for Bankruptcy, Chegg Stocks Rise on 23% Workforce Reduction, and More • IH Market News • 06/18/2024 11:02:13 AM
- Form 144 - Report of proposed sale of securities • Edgar (US Regulatory) • 06/17/2024 09:06:07 PM
- Form 4 - Statement of changes in beneficial ownership of securities • Edgar (US Regulatory) • 06/17/2024 09:00:47 PM
- NVIDIA Announces Omniverse Microservices to Supercharge Physical AI • GlobeNewswire Inc. • 06/17/2024 01:00:00 PM
- Form 144 - Report of proposed sale of securities • Edgar (US Regulatory) • 06/14/2024 08:51:55 PM
- Form 144 - Report of proposed sale of securities • Edgar (US Regulatory) • 06/14/2024 08:29:57 PM
- Form 4 - Statement of changes in beneficial ownership of securities • Edgar (US Regulatory) • 06/13/2024 09:52:15 PM
- Form 144 - Report of proposed sale of securities • Edgar (US Regulatory) • 06/13/2024 08:39:28 PM
- NVIDIA Stockholder Meeting Set for June 26; Individuals Can Participate Online • GlobeNewswire Inc. • 06/12/2024 09:00:00 PM
- Form 4 - Statement of changes in beneficial ownership of securities • Edgar (US Regulatory) • 06/10/2024 08:55:57 PM
- Apple Showcases AI at WWDC 2024, Nvidia Stock Split Starts Today, and More News • IH Market News • 06/10/2024 11:29:44 AM
- Form 4 - Statement of changes in beneficial ownership of securities • Edgar (US Regulatory) • 06/07/2024 09:15:17 PM
- Form 4 - Statement of changes in beneficial ownership of securities • Edgar (US Regulatory) • 06/07/2024 09:14:22 PM
- Form 4 - Statement of changes in beneficial ownership of securities • Edgar (US Regulatory) • 06/07/2024 09:12:44 PM
- Form 8-K - Current report • Edgar (US Regulatory) • 06/07/2024 08:19:34 PM
Last Shot Hydration Drink Announced as Official Sponsor of Red River Athletic Conference • EQLB • Jun 20, 2024 2:38 PM
ATWEC Announces Major Acquisition and Lays Out Strategic Growth Plans • ATWT • Jun 20, 2024 7:09 AM
North Bay Resources Announces Composite Assays of 0.53 and 0.44 Troy Ounces per Ton Gold in Trenches B + C at Fran Gold, British Columbia • NBRI • Jun 18, 2024 9:18 AM
VAYK Assembling New Management Team for $64 Billion Domestic Market • VAYK • Jun 18, 2024 9:00 AM
Fifty 1 Labs, Inc Announces Acquisition of Drago Knives, LLC • CAFI • Jun 18, 2024 8:45 AM
Hydromer Announces Attainment of ISO 13485 Certification • HYDI • Jun 17, 2024 9:22 AM