Tag: Hyperdisk
-
Cloud Blog: Data loading best practices for AI/ML inference on GKE
Source URL: https://cloud.google.com/blog/products/containers-kubernetes/improve-data-loading-times-for-ml-inference-apps-on-gke/ Source: Cloud Blog Title: Data loading best practices for AI/ML inference on GKE Feedly Summary: As AI models increase in sophistication, there’s increasingly large model data needed to serve them. Loading the models and weights along with necessary frameworks to serve them for inference can add seconds or even minutes of scaling…
-
Cloud Blog: 65,000 nodes and counting: Google Kubernetes Engine is ready for trillion-parameter AI models
Source URL: https://cloud.google.com/blog/products/containers-kubernetes/gke-65k-nodes-and-counting/ Source: Cloud Blog Title: 65,000 nodes and counting: Google Kubernetes Engine is ready for trillion-parameter AI models Feedly Summary: As generative AI evolves, we’re beginning to see the transformative potential it is having across industries and our lives. And as large language models (LLMs) increase in size — current models are reaching…
-
Cloud Blog: Powerful infrastructure innovations for your AI-first future
Source URL: https://cloud.google.com/blog/products/compute/trillium-sixth-generation-tpu-is-in-preview/ Source: Cloud Blog Title: Powerful infrastructure innovations for your AI-first future Feedly Summary: The rise of generative AI has ushered in an era of unprecedented innovation, demanding increasingly complex and more powerful AI models. These advanced models necessitate high-performance infrastructure capable of efficiently scaling AI training, tuning, and inferencing workloads while optimizing…
-
Cloud Blog: C4 VMs now GA: Unmatched performance and control for your enterprise workloads
Source URL: https://cloud.google.com/blog/products/compute/c4-machine-series-is-now-ga/ Source: Cloud Blog Title: C4 VMs now GA: Unmatched performance and control for your enterprise workloads Feedly Summary: Today, we’re excited to announce the general availability of the C4 machine series, the most performant general-purpose VM for Compute Engine and Google Kubernetes Engine (GKE) customers. C4 VMs are engineered from the ground…