Followers | 14 |
Posts | 1826 |
Boards Moderated | 0 |
Alias Born | 06/15/2011 |
![](http://investorshub.advfn.com/images/default_ih_profile2_4848.jpg?cb=0)
Wednesday, April 10, 2024 7:44:54 PM
Tech Industry Artificial Intelligence
Elon Musk says the next-generation Grok 3 model will require 100,000 Nvidia H100 GPUs to train
News
By Anton Shilov published yesterday
GPU shortages and power are the two main obstacles for AI development.
Nvidia GH200 SC23 Announcement
(Image credit: Nvidia)
Elon Musk, CEO of Tesla and founder of xAI, made some bold predictions about the development of artificial general intelligence (AGI) and discussed the challenges facing the AI industry. He predicts that AGI could surpass human intelligence as soon as next year or by 2026, but that it will take an extreme number of processors to train, which in turn requires huge amounts of electricity, reports Reuters.
Musk's venture, xAI, is currently training the second version of its Grok large language mode and expects to complete its next training phase by May. The training of Grok's version 2 model required as many as 20,000 Nvidia H100 GPUs, and Musk anticipates that future iterations will demand even greater resources, with the Grok 3 model needing around 100,000 Nvidia H100 chips to train.
Advertisement
The advancement of AI technology, according to Musk, is currently hampered by two main factors: supply shortages on advanced processors — like Nvidia's H100, as it's not easy to get 100,000 of them quickly — and the availability of electricity.
Nvidia's H100 GPU consumes around 700W when fully utilized, and thus 100,000 GPUs for AI and HPC workloads could consume a whopping 70 megawatts of power. Since these GPUs need servers and cooling to operate, it's safe to say that a datacenter with 100,000 Nvidia H100 processors will consume around 100 megawatts of power. That's comparable to the power consumption of a small city.
Musk stressed that while the compute GPU supply has been a significant obstacle so far, the supply of electricity will become increasingly critical in the next year or two. This dual constraint underscores the challenges of scaling AI technologies to meet growing computational demands.
Despite the challenges, advancements in compute and memory architectures will enable the training of increasingly massive large language models (LLMs) in the coming years. Nvidia revealed its Blackwell B200 at GTC 2024, a GPU architecture and platform that's designed to scale to LLMs with trillions of parameters. This will play a critical role in development of AGI.
In fact, Musk believes than an artificial intelligence smarter than the smartest human will emerge in the next year or two. "If you define AGI as smarter than the smartest human, I think it is probably next year, within two years," Musk said in an interview on X Spaces. That means it's apparently time to go watch Terminator again, and hope that our future AGI overlords will be nicer than Skynet.
Recent NVDA News
- U.S. Index Futures Modestly Higher Before Key Economic Data Release; Early Closure for July 4th Holiday • IH Market News • 07/03/2024 11:01:33 AM
- Apple Joins OpenAI Board, Logitech President Opts Out of Reelection, and More News • IH Market News • 07/03/2024 10:59:39 AM
- U.S. Stocks Close Higher; Nasdaq Outperforms • IH Market News • 07/01/2024 09:10:17 PM
- Interactive Brokers Loses $48 Million on NYSE, Amazon Achieves Historic Market Value, and More News • IH Market News • 06/27/2024 11:13:41 AM
- Doordash and Deliveroo Terminate Talks; Universal Announces UK Theme Park Plan, and More News • IH Market News • 06/26/2024 11:08:35 AM
- Dow Dips, Nasdaq Gains, Oil Prices Rise • IH Market News • 06/26/2024 11:00:03 AM
- U.S. Stocks Close On Mixed Note Again; Technology Stocks Rebound • IH Market News • 06/25/2024 10:00:00 PM
- U.S. Index Futures Mixed Following Tech Sell-Off, WTI and Brent Crude Dip Slightly • IH Market News • 06/25/2024 10:37:15 AM
- SolarEdge Stock Falls 13%, Wegovy Approved in China, Grail Nasdaq Debut, Apple Rejects Meta Chatbot • IH Market News • 06/25/2024 10:36:11 AM
- U.S. Stocks End Mixed After Cautious Session • IH Market News • 06/24/2024 09:01:19 PM
- DIGIASIA Corp Advances into AI Solutions for Financial Services, Telecom, and Government Sectors with NVIDIA GPU Allocation • GlobeNewswire Inc. • 06/24/2024 08:05:00 PM
- Futures Pointing To Roughly Flat Open On Wall Street • IH Market News • 06/24/2024 01:08:46 PM
- U.S. Index Futures Show Mixed Results, Oil Prices Edge Lower • IH Market News • 06/24/2024 11:01:54 AM
- UPS Divests Coyote Logistics in $1.025 Billion Deal with RXO, Under Armour Agrees to $434 million Settlement, and More News • IH Market News • 06/24/2024 11:00:20 AM
- U.S. Stocks Close Mixed Following Lackluster Session • IH Market News • 06/21/2024 08:38:41 PM
- Honeywell Acquires CAES Systems for $1.9 Billion, Sarepta Therapeutics Surges 34%, Gilead Continues Gains • IH Market News • 06/21/2024 12:00:38 PM
- U.S. Futures Decline Ahead of Triple Witching, Oil Prices Edge Lower • IH Market News • 06/21/2024 12:00:27 PM
- Dow Closes Firmly Positive But Nasdaq, S&P 500 Give Back Ground • IH Market News • 06/20/2024 08:30:11 PM
- Nvidia May Lead Early Upward Move On Wall Street • IH Market News • 06/20/2024 01:10:49 PM
- U.S. Index Futures Surge; Oil Prices Increase • IH Market News • 06/20/2024 10:56:57 AM
- Trump Media Resells Stocks and Warrants; KB Home Exceeds Q2 Expectations, and More News • IH Market News • 06/20/2024 10:55:11 AM
- Nvidia Overtakes Microsoft To Become World’s Most Valuable Company • IH Market News • 06/19/2024 09:32:08 AM
- Form 144 - Report of proposed sale of securities • Edgar (US Regulatory) • 06/18/2024 09:16:15 PM
- Hewlett Packard Enterprise and NVIDIA Announce ‘NVIDIA AI Computing by HPE’ to Accelerate Generative AI Industrial Revolution • Business Wire • 06/18/2024 04:30:00 PM
- Fisker Files for Bankruptcy, Chegg Stocks Rise on 23% Workforce Reduction, and More • IH Market News • 06/18/2024 11:02:13 AM
Glidelogic Corp. Becomes TikTok Shop Partner, Opening a New Chapter in E-commerce Services • GDLG • Jul 5, 2024 7:09 AM
Freedom Holdings Corporate Update; Announces Management Has Signed Letter of Intent • FHLD • Jul 3, 2024 9:00 AM
EWRC's 21 Moves Gaming Studios Moves to SONY Pictures Studios and Green Lights Development of a Third Upcoming Game • EWRC • Jul 2, 2024 8:00 AM
BNCM and DELEX Healthcare Group Announce Strategic Merger to Drive Expansion and Growth • BNCM • Jul 2, 2024 7:19 AM
NUBURU Announces Upcoming TV Interview Featuring CEO Brian Knaley on Fox Business, Bloomberg TV, and Newsmax TV as Sponsored Programming • BURU • Jul 1, 2024 1:57 PM
Mass Megawatts Announces $220,500 Debt Cancellation Agreement to Improve Financing and Sales of a New Product to be Announced on July 11 • MMMW • Jun 28, 2024 7:30 AM