Followers | 14 |
Posts | 1813 |
Boards Moderated | 0 |
Alias Born | 06/15/2011 |
Thursday, November 23, 2023 8:03:23 PM
Update: It seems like NVIDIA's new GPUs aren't trying to circumvent any US policies (as previously speculated) but instead are designed in accordance with the import rules and fully comply with the parameters set.
According to the latest report by Dylan Patel of Semianalysis, it looks like NVIDIA has plans to launch at least three new AI GPUs for the Chinese market which include the H20 SXM, PCIe L20, and the PCIe L2. All of these chips are based on the Hopper GPU architecture and will feature a maximum theoretical performance of 296 TFLOPs.
The exact specifications of these GPU configurations of these chips aren't known yet but the Hopper H20 SMX features 96 GB memory capacities operating at up to 4.0 Tb/s, 296 TFLOPs Compute power, and using the GH100 die with a performance density of 2.9 TFLOPs/die versus H100's 19.4. The H100 SXM is 6.68x faster than the H20 SXM as per the listed table but those are FP16 Tensor Core FLOPs (with Sparsity) and not the INT8 or FP8 FLOPs. The GPU has a 400W TDP and features 8-way configurations in an HGX solution. It retains the 900 GB/s NVLINK connection & also offers 7-Way MIG (Multi-Instance GPU) functionality.
The NVIDIA L20 comes with 48 GB of memory and a peak of 239 TFLOPs of compute performance while the L2 is configured with 24 GB of memory and a peak of 193 TFLOPs of compute power. The GPUs come in PCIe form factors making them a viable solution for office-based workstations and servers. These are much more cut-down configurations than what the Chinese customers were getting before in the form of the H800 and A800 but it looks like the NVIDIA software stack for AI and HPC is just too valuable to give up for some of these customers and they will be willing to take the reduced specs in order to get access to these modern Hopper architectures.
Also, while they are cut down from a traditional compute point of view, the report states that in LLM inferencing, the H20 SXM will actually be faster than the H100 since it shares similarities to next year's H200. This would suggest that at least one part of the GPU isn't that cut down versus the rest of the chip. The NVIDIA HGX H20 SXM chip and the L20 PCIe GPU are expected to launch by December 2023 while the L2 PCIe accelerator will be available in January 2024. Product sampling is going to commence one month earlier than release.
Furthermore, one of the China specific GPUs is over 20% faster than the H100 in LLM inference, and is more similar to the new GPU that Nvidia is launching early next year than to the H100!
via SemiAnalysis
NVIDIA has yet to officially announce these chips but they are likely going to keep it under wraps and silently update their partners about the plans rather than making it a full-blown AI product announcement. The recent restrictions imposed by the US government on China have prompted the Chinese to search for AI alternatives
NVIDIA knows the potential that some of these competing companies hold and will try to support its Chinese customer base as much as possible while conforming to US regulations. The company also has a massive demand for AI across the globe and despite a recent cancellation of $5 Billion US worth of orders, the green team will just reallocate its supply elsewhere so that customers who previously had to wait more than a year to get hands-on GPUs can now get their hands on NVIDIA's AI gold early.
Recent NVDA News
- Interactive Brokers Loses $48 Million on NYSE, Amazon Achieves Historic Market Value, and More News • IH Market News • 06/27/2024 11:13:41 AM
- Doordash and Deliveroo Terminate Talks; Universal Announces UK Theme Park Plan, and More News • IH Market News • 06/26/2024 11:08:35 AM
- Dow Dips, Nasdaq Gains, Oil Prices Rise • IH Market News • 06/26/2024 11:00:03 AM
- U.S. Stocks Close On Mixed Note Again; Technology Stocks Rebound • IH Market News • 06/25/2024 10:00:00 PM
- U.S. Index Futures Mixed Following Tech Sell-Off, WTI and Brent Crude Dip Slightly • IH Market News • 06/25/2024 10:37:15 AM
- SolarEdge Stock Falls 13%, Wegovy Approved in China, Grail Nasdaq Debut, Apple Rejects Meta Chatbot • IH Market News • 06/25/2024 10:36:11 AM
- U.S. Stocks End Mixed After Cautious Session • IH Market News • 06/24/2024 09:01:19 PM
- DIGIASIA Corp Advances into AI Solutions for Financial Services, Telecom, and Government Sectors with NVIDIA GPU Allocation • GlobeNewswire Inc. • 06/24/2024 08:05:00 PM
- Futures Pointing To Roughly Flat Open On Wall Street • IH Market News • 06/24/2024 01:08:46 PM
- U.S. Index Futures Show Mixed Results, Oil Prices Edge Lower • IH Market News • 06/24/2024 11:01:54 AM
- UPS Divests Coyote Logistics in $1.025 Billion Deal with RXO, Under Armour Agrees to $434 million Settlement, and More News • IH Market News • 06/24/2024 11:00:20 AM
- U.S. Stocks Close Mixed Following Lackluster Session • IH Market News • 06/21/2024 08:38:41 PM
- Honeywell Acquires CAES Systems for $1.9 Billion, Sarepta Therapeutics Surges 34%, Gilead Continues Gains • IH Market News • 06/21/2024 12:00:38 PM
- U.S. Futures Decline Ahead of Triple Witching, Oil Prices Edge Lower • IH Market News • 06/21/2024 12:00:27 PM
- Dow Closes Firmly Positive But Nasdaq, S&P 500 Give Back Ground • IH Market News • 06/20/2024 08:30:11 PM
- Nvidia May Lead Early Upward Move On Wall Street • IH Market News • 06/20/2024 01:10:49 PM
- U.S. Index Futures Surge; Oil Prices Increase • IH Market News • 06/20/2024 10:56:57 AM
- Trump Media Resells Stocks and Warrants; KB Home Exceeds Q2 Expectations, and More News • IH Market News • 06/20/2024 10:55:11 AM
- Nvidia Overtakes Microsoft To Become World’s Most Valuable Company • IH Market News • 06/19/2024 09:32:08 AM
- Form 144 - Report of proposed sale of securities • Edgar (US Regulatory) • 06/18/2024 09:16:15 PM
- Hewlett Packard Enterprise and NVIDIA Announce ‘NVIDIA AI Computing by HPE’ to Accelerate Generative AI Industrial Revolution • Business Wire • 06/18/2024 04:30:00 PM
- Fisker Files for Bankruptcy, Chegg Stocks Rise on 23% Workforce Reduction, and More • IH Market News • 06/18/2024 11:02:13 AM
- Form 144 - Report of proposed sale of securities • Edgar (US Regulatory) • 06/17/2024 09:06:07 PM
- Form 4 - Statement of changes in beneficial ownership of securities • Edgar (US Regulatory) • 06/17/2024 09:00:47 PM
- NVIDIA Announces Omniverse Microservices to Supercharge Physical AI • GlobeNewswire Inc. • 06/17/2024 01:00:00 PM
FEATURED POET Wins "Best Optical AI Solution" in 2024 AI Breakthrough Awards Program • Jun 26, 2024 10:09 AM
HealthLynked Promotes Bill Crupi to Chief Operating Officer • HLYK • Jun 26, 2024 8:00 AM
Bantec's Howco Short Term Department of Defense Contract Wins Will Exceed $1,100,000 for the current Quarter • BANT • Jun 25, 2024 10:00 AM
ECGI Holdings Targets $9.7 Billion Equestrian Apparel Market with Allon Brand Launch • ECGI • Jun 25, 2024 8:36 AM
Avant Technologies Addresses Progress on AI Supercomputer-Driven Data Centers • AVAI • Jun 25, 2024 8:00 AM
Green Leaf Innovations, Inc. Expands International Presence with New Partnership in Dubai • GRLF • Jun 24, 2024 8:30 AM