Followers | 13 |
Posts | 1802 |
Boards Moderated | 0 |
Alias Born | 06/15/2011 |
![](http://investorshub.advfn.com/images/default_ih_profile2_4848.jpg?cb=0)
Thursday, November 23, 2023 8:03:23 PM
Update: It seems like NVIDIA's new GPUs aren't trying to circumvent any US policies (as previously speculated) but instead are designed in accordance with the import rules and fully comply with the parameters set.
According to the latest report by Dylan Patel of Semianalysis, it looks like NVIDIA has plans to launch at least three new AI GPUs for the Chinese market which include the H20 SXM, PCIe L20, and the PCIe L2. All of these chips are based on the Hopper GPU architecture and will feature a maximum theoretical performance of 296 TFLOPs.
The exact specifications of these GPU configurations of these chips aren't known yet but the Hopper H20 SMX features 96 GB memory capacities operating at up to 4.0 Tb/s, 296 TFLOPs Compute power, and using the GH100 die with a performance density of 2.9 TFLOPs/die versus H100's 19.4. The H100 SXM is 6.68x faster than the H20 SXM as per the listed table but those are FP16 Tensor Core FLOPs (with Sparsity) and not the INT8 or FP8 FLOPs. The GPU has a 400W TDP and features 8-way configurations in an HGX solution. It retains the 900 GB/s NVLINK connection & also offers 7-Way MIG (Multi-Instance GPU) functionality.
The NVIDIA L20 comes with 48 GB of memory and a peak of 239 TFLOPs of compute performance while the L2 is configured with 24 GB of memory and a peak of 193 TFLOPs of compute power. The GPUs come in PCIe form factors making them a viable solution for office-based workstations and servers. These are much more cut-down configurations than what the Chinese customers were getting before in the form of the H800 and A800 but it looks like the NVIDIA software stack for AI and HPC is just too valuable to give up for some of these customers and they will be willing to take the reduced specs in order to get access to these modern Hopper architectures.
Also, while they are cut down from a traditional compute point of view, the report states that in LLM inferencing, the H20 SXM will actually be faster than the H100 since it shares similarities to next year's H200. This would suggest that at least one part of the GPU isn't that cut down versus the rest of the chip. The NVIDIA HGX H20 SXM chip and the L20 PCIe GPU are expected to launch by December 2023 while the L2 PCIe accelerator will be available in January 2024. Product sampling is going to commence one month earlier than release.
Furthermore, one of the China specific GPUs is over 20% faster than the H100 in LLM inference, and is more similar to the new GPU that Nvidia is launching early next year than to the H100!
via SemiAnalysis
NVIDIA has yet to officially announce these chips but they are likely going to keep it under wraps and silently update their partners about the plans rather than making it a full-blown AI product announcement. The recent restrictions imposed by the US government on China have prompted the Chinese to search for AI alternatives
NVIDIA knows the potential that some of these competing companies hold and will try to support its Chinese customer base as much as possible while conforming to US regulations. The company also has a massive demand for AI across the globe and despite a recent cancellation of $5 Billion US worth of orders, the green team will just reallocate its supply elsewhere so that customers who previously had to wait more than a year to get hands-on GPUs can now get their hands on NVIDIA's AI gold early.
Recent NVDA News
- U.S. Stocks Close Mixed Following Lackluster Session • IH Market News • 06/21/2024 08:38:41 PM
- Honeywell Acquires CAES Systems for $1.9 Billion, Sarepta Therapeutics Surges 34%, Gilead Continues Gains • IH Market News • 06/21/2024 12:00:38 PM
- U.S. Futures Decline Ahead of Triple Witching, Oil Prices Edge Lower • IH Market News • 06/21/2024 12:00:27 PM
- Dow Closes Firmly Positive But Nasdaq, S&P 500 Give Back Ground • IH Market News • 06/20/2024 08:30:11 PM
- Nvidia May Lead Early Upward Move On Wall Street • IH Market News • 06/20/2024 01:10:49 PM
- U.S. Index Futures Surge; Oil Prices Increase • IH Market News • 06/20/2024 10:56:57 AM
- Trump Media Resells Stocks and Warrants; KB Home Exceeds Q2 Expectations, and More News • IH Market News • 06/20/2024 10:55:11 AM
- Nvidia Overtakes Microsoft To Become World’s Most Valuable Company • IH Market News • 06/19/2024 09:32:08 AM
- Form 144 - Report of proposed sale of securities • Edgar (US Regulatory) • 06/18/2024 09:16:15 PM
- Hewlett Packard Enterprise and NVIDIA Announce ‘NVIDIA AI Computing by HPE’ to Accelerate Generative AI Industrial Revolution • Business Wire • 06/18/2024 04:30:00 PM
- Fisker Files for Bankruptcy, Chegg Stocks Rise on 23% Workforce Reduction, and More • IH Market News • 06/18/2024 11:02:13 AM
- Form 144 - Report of proposed sale of securities • Edgar (US Regulatory) • 06/17/2024 09:06:07 PM
- Form 4 - Statement of changes in beneficial ownership of securities • Edgar (US Regulatory) • 06/17/2024 09:00:47 PM
- NVIDIA Announces Omniverse Microservices to Supercharge Physical AI • GlobeNewswire Inc. • 06/17/2024 01:00:00 PM
- Form 144 - Report of proposed sale of securities • Edgar (US Regulatory) • 06/14/2024 08:51:55 PM
- Form 144 - Report of proposed sale of securities • Edgar (US Regulatory) • 06/14/2024 08:29:57 PM
- Form 4 - Statement of changes in beneficial ownership of securities • Edgar (US Regulatory) • 06/13/2024 09:52:15 PM
- Form 144 - Report of proposed sale of securities • Edgar (US Regulatory) • 06/13/2024 08:39:28 PM
- NVIDIA Stockholder Meeting Set for June 26; Individuals Can Participate Online • GlobeNewswire Inc. • 06/12/2024 09:00:00 PM
- Form 4 - Statement of changes in beneficial ownership of securities • Edgar (US Regulatory) • 06/10/2024 08:55:57 PM
- Apple Showcases AI at WWDC 2024, Nvidia Stock Split Starts Today, and More News • IH Market News • 06/10/2024 11:29:44 AM
- Form 4 - Statement of changes in beneficial ownership of securities • Edgar (US Regulatory) • 06/07/2024 09:15:17 PM
- Form 4 - Statement of changes in beneficial ownership of securities • Edgar (US Regulatory) • 06/07/2024 09:14:22 PM
- Form 4 - Statement of changes in beneficial ownership of securities • Edgar (US Regulatory) • 06/07/2024 09:12:44 PM
- Form 8-K - Current report • Edgar (US Regulatory) • 06/07/2024 08:19:34 PM
Last Shot Hydration Drink Announced as Official Sponsor of Red River Athletic Conference • EQLB • Jun 20, 2024 2:38 PM
ATWEC Announces Major Acquisition and Lays Out Strategic Growth Plans • ATWT • Jun 20, 2024 7:09 AM
North Bay Resources Announces Composite Assays of 0.53 and 0.44 Troy Ounces per Ton Gold in Trenches B + C at Fran Gold, British Columbia • NBRI • Jun 18, 2024 9:18 AM
VAYK Assembling New Management Team for $64 Billion Domestic Market • VAYK • Jun 18, 2024 9:00 AM
Fifty 1 Labs, Inc Announces Acquisition of Drago Knives, LLC • CAFI • Jun 18, 2024 8:45 AM
Hydromer Announces Attainment of ISO 13485 Certification • HYDI • Jun 17, 2024 9:22 AM