🐂 Not all bull runs are created equal. November’s AI picks include 5 stocks up +20% eachUnlock Stocks

Nvidia upgrades flagship chip to handle bigger AI systems

Published 13/11/2023, 23:31
© Reuters. FILE PHOTO: NVIDIA HGX AI Supercomputer on display during the annual Foxconn Tech Day in Taipei, Taiwan October 18, 2023. REUTERS/Ann Wang/File Photo
MSFT
-
ORCL
-
GOOGL
-
AMZN
-

By Stephen Nellis

(Reuters) - Nvidia on Monday added new features to its top-of-the-line chip for artificial intelligence, saying the new offering will start to roll out next year with Amazon.com (NASDAQ:AMZN), Alphabet (NASDAQ:GOOGL)'s Google and Oracle (NYSE:ORCL).

The H200, as the chip is called, will overtake Nvidia's current top H100 chip. The primary upgrade is more high-bandwidth memory, one of the costliest parts of the chip that defines how much data it can process quickly.

Nvidia dominates the market for AI chips and powers OpenAI's ChatGPT service and many similar generative AI services that respond to queries with human-like writing. The addition of more high-bandwidth memory and a faster connection to the chip's processing elements means that such services will be able to spit out an answer more quickly.

The H200 has 141-gigabytes of high-bandwidth memory, up from 80 gigabyte in its previous H100. Nvidia did not disclose its suppliers for the memory on the new chip, but Micron Technology (NASDAQ:MU) said in September that it was working to become an Nvidia supplier.

© Reuters. FILE PHOTO: NVIDIA HGX AI Supercomputer on display during the annual Foxconn Tech Day in Taipei, Taiwan October 18, 2023. REUTERS/Ann Wang/File Photo

Nvidia also buys memory from Korea's SK Hynix, which said last month that AI chips are helping to revive sales.

Nvidia on Wednesday said that Amazon Web Services, Google Cloud, Microsoft (NASDAQ:MSFT) Azure and Oracle Cloud Infrastructure will be among the first cloud service providers to offer access to H200 chips, in addition to specialty AI cloud providers CoreWeave, Lambda and Vultr.

Latest comments

Risk Disclosure: Trading in financial instruments and/or cryptocurrencies involves high risks including the risk of losing some, or all, of your investment amount, and may not be suitable for all investors. Prices of cryptocurrencies are extremely volatile and may be affected by external factors such as financial, regulatory or political events. Trading on margin increases the financial risks.
Before deciding to trade in financial instrument or cryptocurrencies you should be fully informed of the risks and costs associated with trading the financial markets, carefully consider your investment objectives, level of experience, and risk appetite, and seek professional advice where needed.
Fusion Media would like to remind you that the data contained in this website is not necessarily real-time nor accurate. The data and prices on the website are not necessarily provided by any market or exchange, but may be provided by market makers, and so prices may not be accurate and may differ from the actual price at any given market, meaning prices are indicative and not appropriate for trading purposes. Fusion Media and any provider of the data contained in this website will not accept liability for any loss or damage as a result of your trading, or your reliance on the information contained within this website.
It is prohibited to use, store, reproduce, display, modify, transmit or distribute the data contained in this website without the explicit prior written permission of Fusion Media and/or the data provider. All intellectual property rights are reserved by the providers and/or the exchange providing the data contained in this website.
Fusion Media may be compensated by the advertisers that appear on the website, based on your interaction with the advertisements or advertisers.
© 2007-2024 - Fusion Media Limited. All Rights Reserved.