The Register: Samsung releases 24Gb GDDR7 DRAM for testing in beefy AI systems

Source URL: https://www.theregister.com/2024/10/17/samsung_gddr7_dram_chip/
Source: The Register
Title: Samsung releases 24Gb GDDR7 DRAM for testing in beefy AI systems

Feedly Summary: Production slated for Q1 2025, barring any hiccups
Samsung has finally stolen a march in the memory market with 24 Gb GDDR7 DRAM being released for validation in AI computing systems from GPU customers before production – expected early next year – kicks off.…

AI Summary and Description: Yes

Summary: Samsung is set to lead the memory market with the introduction of its 24 Gb GDDR7 DRAM, specially designed for AI computing systems, improving power efficiency by over 30% compared to its predecessor, GDDR6. This advancement in high-bandwidth memory technology addresses the growing demands for intensive AI and gaming workloads.

Detailed Description:
Samsung has announced that it will be releasing a new memory product, the 24 Gb GDDR7 DRAM, which is positioned to cater to the increasing needs of AI computing systems. This advancement comes at a critical time for Samsung’s semiconductor division, which has faced challenges in recent years.

Key Points:

– **Performance Improvements**:
– The GDDR7 DRAM is expected to offer a performance boost of over 30% in power efficiency compared to prior GDDR6 technology.
– The chip boasts a high bandwidth capability, with speeds up to 42.5 Gbps per pin, translating to a potential bandwidth of 1.36 TBps over a 256-bit wide bus.

– **Technological Advances**:
– Utilizing PAM3 technology, the GDDR7 can process three signal levels, enhancing its efficiency over the dual-level standard used in GDDR6.
– This innovation means that the GDDR7 DRAM is expected to perform exceptionally well for demanding applications like AI processing and high-resolution gaming.

– **Market Strategy and Competition**:
– Samsung aims to gain a competitive edge before its rivals, SK Hynix and Micron, can release their versions of GDDR7.
– The initial validation of these chips with GPU customers is slated to begin before the year closes, with mass production anticipated to start in early 2025.

– **Applications**:
– The new DRAM technology is particularly tailored for high-capacity video memory setups, making it suitable for next-generation GPUs from Nvidia and AMD, such as the rumored GeForce 5000 series.

This development is significant for AI, cloud, and infrastructure security professionals as it underscores the advancing technology in graphics memory that powers AI applications, which in turn affects the overall infrastructure capabilities required to support these demanding processes. Enhanced memory performance is crucial for ensuring efficient and secure AI computing systems, especially as the sophistication and intensity of these workloads continue to grow.