Google Cloud Pub/Sub is a scalable cloud infrastructure service that moves many gigabytes per second between data sources and data sinks. Storage is a critical component in providing guaranteed at-least-once delivery for every message that passes through Pub/Sub. In this talk, we will be looking at requirements and tradeoffs for throughput, latency, consistency, availability, durability, and maintainability. We will explore the space of design choices for building storage for Pub/Sub, investigate the choices we made, and understand the features of underlying technology.
Data Council, PO Box 2087, Wilson, WY 83014, USA - Phone: +1 (415) 800-4938 - Email: community (at) datacouncil.ai