Google Cloud Datastream enables serverless real-time replication from databases and applications to analytical systems.
What is Datastream?
Datastream is a serverless Change Data Capture (CDC) and replication service. It captures database and application changes in real-time and streams them to BigQuery, Cloud Storage, or other targets. The service requires no infrastructure management and scales automatically with data volume.
Core Features
- Serverless CDC: Automatic capture of data changes without infrastructure
- Real-time streaming: Changes transferred to the target promptly
- Broad source support: Oracle, MySQL, SQL Server, PostgreSQL/AlloyDB, MongoDB, Spanner, and SaaS sources such as Salesforce
- Schema detection: Automatic detection and propagation of schema changes
- Private connectivity: Secure connection to on-premises databases via VPN/Interconnect
- Unified streams: One stream can replicate multiple tables and schemas
Typical Use Cases
Real-time Analytics with BigQuery
Continuous replication of transaction data from Oracle, MySQL, or SQL Server to BigQuery for real-time dashboards and analytics. The source database isn’t burdened with analytics queries.
Database Migration with Minimal Downtime
Prepare for database migration through continuous data synchronization. Cutover happens with significantly reduced downtime since the target database is already largely in sync.
Event-Driven Architectures
Trigger Cloud Functions or Dataflow pipelines based on database changes. Datastream delivers the changes; downstream services process them.
Integrating SaaS Data
Replicate Salesforce and other SaaS application data to BigQuery for unified analytics alongside classic database sources.
Benefits
- No infrastructure: Fully serverless without clusters or servers to manage
- Minimal source load: CDC via transaction logs barely impacts the source
- Easy setup: Streams configured via Console or Terraform in a short time
- Broad connectivity: Databases and increasingly SaaS applications as sources
Integration with innFactory
As a certified Google Cloud partner, innFactory supports you with Datastream: building real-time analytics pipelines, migrating on-premises databases, integrating with existing ETL processes, and architecting event-driven systems.
Available Tiers & Options
Datastream
- Fully serverless
- Real-time CDC without coding
- Private connectivity
- Broad source support including SaaS applications
- Some sources (e.g., Salesforce Marketing Cloud, ServiceNow, Microsoft Dataverse) still in preview
Typical Use Cases
Technical Specifications
Frequently Asked Questions
Which source databases does Datastream support?
Datastream supports Oracle, MySQL, SQL Server, PostgreSQL (including AlloyDB for PostgreSQL and AlloyDB Omni), MongoDB, and Spanner as database sources. It also supports application sources such as Salesforce (GA), plus Salesforce Marketing Cloud, Microsoft Dataverse, and ServiceNow (each in preview). Targets include BigQuery, Cloud Storage, and, via Dataflow templates, additional databases.
What's the difference between Datastream and Database Migration Service?
Datastream is designed for continuous real-time replication, while Database Migration Service is optimized for one-time migrations. Datastream is suitable for analytics pipelines; DMS for database migrations.
How does Change Data Capture work with Datastream?
Datastream reads changes from the source's transaction log (e.g., Oracle Redo Logs, MySQL Binlog, SQL Server change tables) and streams them in real-time to the target. The source is minimally impacted.
Can Datastream connect to on-premises databases?
Yes, via private connectivity with Cloud VPN or Interconnect, on-premises databases such as Oracle, MySQL, SQL Server, or PostgreSQL can be configured as sources.
How is Datastream billed?
Billing is based on processed data volume, typically with CDC data and backfill data considered separately. Google Cloud's current pricing page is authoritative for exact prices and any minimum fees.
Note: All product information on this page has been compiled with care, but is provided without guarantee and may be outdated or incomplete. Cloud services evolve rapidly — features, pricing, SLAs, and availability change frequently. Authoritative and up-to-date information can only be found on the official product page of Google Cloud (official documentation). This page does not represent an offer by Google Cloud.
