Tag: throughput

  • Simon Willison’s Weblog: Zero-latency SQLite storage in every Durable Object

    Source URL: https://simonwillison.net/2024/Oct/13/zero-latency-sqlite-storage-in-every-durable-object/#atom-everything Source: Simon Willison’s Weblog Title: Zero-latency SQLite storage in every Durable Object Feedly Summary: Zero-latency SQLite storage in every Durable Object Kenton Varda introduces the next iteration of Cloudflare’s Durable Object platform, which recently upgraded from a key/value store to a full relational system based on SQLite. This is a fascinating piece…

  • Cloud Blog: BigQuery tables for Apache Iceberg: optimized storage for the open lakehouse

    Source URL: https://cloud.google.com/blog/products/data-analytics/announcing-bigquery-tables-for-apache-iceberg/ Source: Cloud Blog Title: BigQuery tables for Apache Iceberg: optimized storage for the open lakehouse Feedly Summary: For several years, BigQuery native tables have supported enterprise-level data management capabilities such as ACID transactions, streaming ingestion, and automatic storage optimizations. Many BigQuery customers store data in data lakes using open-source file formats such…

  • Cloud Blog: Parallelstore is now GA, fueling the next generation of AI and HPC workloads

    Source URL: https://cloud.google.com/blog/products/storage-data-transfer/parallelstore-high-performance-file-service-for-hpc-and-ai-is-ga/ Source: Cloud Blog Title: Parallelstore is now GA, fueling the next generation of AI and HPC workloads Feedly Summary: Organizations use artificial intelligence (AI) and high-performance computing (HPC) applications to process massive datasets, run complex simulations, and train generative models with billions of parameters for diverse use cases such as LLMs, genomic…

  • Cloud Blog: Cut costs and boost efficiency with Dataflow’s new custom source reads

    Source URL: https://cloud.google.com/blog/products/data-analytics/cut-costs-and-boost-efficiency-with-dataflows-new-source-reads/ Source: Cloud Blog Title: Cut costs and boost efficiency with Dataflow’s new custom source reads Feedly Summary: Scaling workloads often comes with a hefty price tag, especially in streaming environments, where latency is heavily scrutinized. So it makes sense we want our pipelines to run without bottlenecks — because costs and latency…