Followers | 14 |
Posts | 1815 |
Boards Moderated | 0 |
Alias Born | 06/15/2011 |
Wednesday, February 28, 2024 7:36:51 AM
Jensen Huang defends colossal GPU purchases made by hyperscalers, claims they're 'fairly allocated'
icon Simon Sharwood
Thu 22 Feb 2024 // 01:32 UTC
Nvidia CEO Jensen Huang has claimed responsibility for hyperscalers' decisions to extend the operating life of their server fleets, and suggested they've done so because they can't improve performance by persisting with general-purpose computing and must instead adopt accelerated machines.
As the boss of the planet's leading purveyor of accelerated computing, he would say that. But on Wednesday's Q4 earnings call he and CFO Collette Kress pointed to Microsoft and ServiceNow both achieving record adoption of new products that include Nvidia-powered AI as evidence that accelerated computing is the new must-have.
Nvidia's numbers also lend credence to Huang's belief that accelerated computing is booming – big time – because CPU-centric architectures can't run the AI workloads the world wants.
We reconfigured our products for China in a way that is not software hackable
Q4 2024 revenue came in at $22.1 billion – up 265 percent year-over-year. Full year revenue of $60.9 billion was up 126 percent compared to FY 2023. Datacenter revenue was the big driver, growing 409 percent year-over-year to $18.4 billion for the quarter, and rising 217 percent to a full-year total of $47.5 billion. That last figure means Nvidia is a bigger enterprise player than HPE, and also bigger than IBM's hardware biz.
Kress revealed a likely driver for future growth – the forthcoming H200 accelerator – will debut in Q2 and forecast strong demand as it nearly doubles inference performance compared to Nvidia's current champion card, the H100.
Huang and Kress both warned that demand will initially exceed supply for the H200, and the CFO added that next-generation Hopper products will be supply-constrained. Huang explained that the complexity of Nvidia products means it's not immediately possible to step up production to levels that meet demand.
"Whenever we do new products, it ramps from zero to a very large number and you can't do that overnight," he explained, pointing out that Hopper products have 35,000 components.
He later acknowledged buyers' concerns about shortages in the context of purchases of hundreds of thousands of H100s by hyperscalers. "We allocate fairly to ensure use," he claimed, explaining that Nvidia won't let its hyperscale customers get their hands on hardware before they have datacenters ready to run it.
What's going on with Eos, Nvidia's incredible shrinking supercomputer?
Nvidia wants a piece of the custom silicon pie, reportedly forms unit to peddle IP
Cisco, Nvidia expand collab to push Ethernet into AI clusters
Where there's a will, there's a way to get US chips into China
China delivered a "mid-single digit percentage" of datacenter revenue, and was forecast to do the same in Q1 of 2025.
Huang conceded this quarter's result represented a significant decline in the Middle Kingdom, caused by a company-wide pause in sales sparked by stricter US sanctions on exports of AI tech introduced in October 2023.
Huang said Nvidia stopped shipping kit to China in response and has since developed products it believes will qualify for an export license.
"We reconfigured our products in a way that is not software hackable in any way," he claimed. "Now we are sampling for customers in China and we will do our best to succeed there."
He added his belief that "The US government would like us to be as successful in China as possible."
Networking revenue reached a $13 billion annual run rate and grew 5x year-over-year. CFO Kress predicted further networking growth, helped by the debut this quarter of Nvidia's SpectrumX Ethernet range. SpectrumX is Nvidia's set of tweaks to Ethernet to make it better able to handle AI workloads. Huang described SpectrumX as "AI-optimized" in contrast to InfiniBand's status as "AI-dedicated."
Enterprise software has become a billion-dollar business for Nvidia, and Huang forecast that would grow substantially, led by the Nvidia Enterprise AI suite.
Huang revealed Nvidia has substantial teams who work closely with cloud service providers to help them run apps on accelerators, but noted that hands-on approach won't scale to every app and every user. As generative AI becomes a common enterprise workload, Nvidia is building libraries to ensure common software can also get the best out of its accelerators – at a price of $4500/GPU/year for its Nvidia Enterprise AI offering.
"My guess is that every enterprise in the world will run on Nvidia AI Enterprise," he predicted. "This is likely going to be a very significant business. We are really just getting started."
Gaming is Nvidia's OG biz, and grew 15 percent year over year to reach $10.45 billion revenue.
Q1 revenue was forecast at $24 billion – growth rather less steep than Nvidia has reported in some recent quarters. A seasonal slowdown in gaming revenue was cited as one reason for the forecast. That said, Nvidia's Q4 result beat guidance by a couple of billion dollars.
Investors clearly liked what they heard: Nvidia's share price ended the trading day at $675.00 and sped to $743.98 after the bell before settling to $730.50. ®
Recent NVDA News
- Interactive Brokers Loses $48 Million on NYSE, Amazon Achieves Historic Market Value, and More News • IH Market News • 06/27/2024 11:13:41 AM
- Doordash and Deliveroo Terminate Talks; Universal Announces UK Theme Park Plan, and More News • IH Market News • 06/26/2024 11:08:35 AM
- Dow Dips, Nasdaq Gains, Oil Prices Rise • IH Market News • 06/26/2024 11:00:03 AM
- U.S. Stocks Close On Mixed Note Again; Technology Stocks Rebound • IH Market News • 06/25/2024 10:00:00 PM
- U.S. Index Futures Mixed Following Tech Sell-Off, WTI and Brent Crude Dip Slightly • IH Market News • 06/25/2024 10:37:15 AM
- SolarEdge Stock Falls 13%, Wegovy Approved in China, Grail Nasdaq Debut, Apple Rejects Meta Chatbot • IH Market News • 06/25/2024 10:36:11 AM
- U.S. Stocks End Mixed After Cautious Session • IH Market News • 06/24/2024 09:01:19 PM
- DIGIASIA Corp Advances into AI Solutions for Financial Services, Telecom, and Government Sectors with NVIDIA GPU Allocation • GlobeNewswire Inc. • 06/24/2024 08:05:00 PM
- Futures Pointing To Roughly Flat Open On Wall Street • IH Market News • 06/24/2024 01:08:46 PM
- U.S. Index Futures Show Mixed Results, Oil Prices Edge Lower • IH Market News • 06/24/2024 11:01:54 AM
- UPS Divests Coyote Logistics in $1.025 Billion Deal with RXO, Under Armour Agrees to $434 million Settlement, and More News • IH Market News • 06/24/2024 11:00:20 AM
- U.S. Stocks Close Mixed Following Lackluster Session • IH Market News • 06/21/2024 08:38:41 PM
- Honeywell Acquires CAES Systems for $1.9 Billion, Sarepta Therapeutics Surges 34%, Gilead Continues Gains • IH Market News • 06/21/2024 12:00:38 PM
- U.S. Futures Decline Ahead of Triple Witching, Oil Prices Edge Lower • IH Market News • 06/21/2024 12:00:27 PM
- Dow Closes Firmly Positive But Nasdaq, S&P 500 Give Back Ground • IH Market News • 06/20/2024 08:30:11 PM
- Nvidia May Lead Early Upward Move On Wall Street • IH Market News • 06/20/2024 01:10:49 PM
- U.S. Index Futures Surge; Oil Prices Increase • IH Market News • 06/20/2024 10:56:57 AM
- Trump Media Resells Stocks and Warrants; KB Home Exceeds Q2 Expectations, and More News • IH Market News • 06/20/2024 10:55:11 AM
- Nvidia Overtakes Microsoft To Become World’s Most Valuable Company • IH Market News • 06/19/2024 09:32:08 AM
- Form 144 - Report of proposed sale of securities • Edgar (US Regulatory) • 06/18/2024 09:16:15 PM
- Hewlett Packard Enterprise and NVIDIA Announce ‘NVIDIA AI Computing by HPE’ to Accelerate Generative AI Industrial Revolution • Business Wire • 06/18/2024 04:30:00 PM
- Fisker Files for Bankruptcy, Chegg Stocks Rise on 23% Workforce Reduction, and More • IH Market News • 06/18/2024 11:02:13 AM
- Form 144 - Report of proposed sale of securities • Edgar (US Regulatory) • 06/17/2024 09:06:07 PM
- Form 4 - Statement of changes in beneficial ownership of securities • Edgar (US Regulatory) • 06/17/2024 09:00:47 PM
- NVIDIA Announces Omniverse Microservices to Supercharge Physical AI • GlobeNewswire Inc. • 06/17/2024 01:00:00 PM
VAYK Exited Caribbean Investments for $320,000 Profit • VAYK • Jun 27, 2024 9:00 AM
North Bay Resources Announces Successful Flotation Cell Test at Bishop Gold Mill, Inyo County, California • NBRI • Jun 27, 2024 9:00 AM
Branded Legacy, Inc. and Hemp Emu Announce Strategic Partnership to Enhance CBD Product Manufacturing • BLEG • Jun 27, 2024 8:30 AM
POET Wins "Best Optical AI Solution" in 2024 AI Breakthrough Awards Program • POET • Jun 26, 2024 10:09 AM
HealthLynked Promotes Bill Crupi to Chief Operating Officer • HLYK • Jun 26, 2024 8:00 AM
Bantec's Howco Short Term Department of Defense Contract Wins Will Exceed $1,100,000 for the current Quarter • BANT • Jun 25, 2024 10:00 AM