Tag: memory bandwidth
-
Hacker News: AMD crafts custom EPYC CPU with HBM3 for Azure: 88 Zen 4 cores and 450GB of HBM3
Source URL: https://www.tomshardware.com/pc-components/cpus/amd-crafts-custom-epyc-cpu-for-microsoft-azure-with-hbm3-memory-cpu-with-88-zen-4-cores-and-450gb-of-hbm3-may-be-repurposed-mi300c-four-chips-hit-7-tb-s Source: Hacker News Title: AMD crafts custom EPYC CPU with HBM3 for Azure: 88 Zen 4 cores and 450GB of HBM3 Feedly Summary: Comments AI Summary and Description: Yes Summary: Microsoft has unveiled a new series of high-performance computing (HPC) Azure virtual machines, the HBv5 series, which utilize a custom AMD CPU…
-
The Register: Microsoft unveils beefy custom AMD chip to crunch HPC workloads on Azure
Source URL: https://www.theregister.com/2024/11/20/microsoft_azure_custom_amd/ Source: The Register Title: Microsoft unveils beefy custom AMD chip to crunch HPC workloads on Azure Feedly Summary: In-house DPU and HSM silicon also shown off Ignite One of the advantages of being a megacorp is that you can customize the silicon that underpins your infrastructure, as Microsoft is demonstrating at this…
-
The Register: Nvidia’s MLPerf submission shows B200 offers up to 2.2x training performance of H100
Source URL: https://www.theregister.com/2024/11/13/nvidia_b200_performance/ Source: The Register Title: Nvidia’s MLPerf submission shows B200 offers up to 2.2x training performance of H100 Feedly Summary: Is Huang leaving even more juice on the table by opting for mid-tier Blackwell part? Signs point to yes Analysis Nvidia offered the first look at how its upcoming Blackwell accelerators stack up…
-
Cloud Blog: Unlocking LLM training efficiency with Trillium — a performance analysis
Source URL: https://cloud.google.com/blog/products/compute/trillium-mlperf-41-training-benchmarks/ Source: Cloud Blog Title: Unlocking LLM training efficiency with Trillium — a performance analysis Feedly Summary: Rapidly evolving generative AI models place unprecedented demands on the performance and efficiency of hardware accelerators. Last month, we launched our sixth-generation Tensor Processing Unit (TPU), Trillium, to address the demands of next-generation models. Trillium is…
-
The Register: Apple throws shade on pokey AI PCs, claims its maxed out M4 chips are 4x faster
Source URL: https://www.theregister.com/2024/10/31/apple_m4_ai_chip/ Source: The Register Title: Apple throws shade on pokey AI PCs, claims its maxed out M4 chips are 4x faster Feedly Summary: Busy week for Cupertino sees shrunken Mac minis, updated lappies, and new SoCs With the arrival of its M4 silicon on the Mac this week, Apple wants the world to…