Exam Professional Cloud Database Engineer topic 1 question 84 discussion

D. Anytime you see words like “develop” or “manually” be suspicious given this is cloud and everything is supposed to be automated and point-and-click easy. Eliminate A. Federated queries are SQL queries initiated FROM BigQuery to Cloud Spanner or Cloud SQL databases. So B doesn’t make sense. The Database Migration Service does not support BigQuery as a destination database engine. Eliminate C. That leaves D. From Google’s documentation, “Datastream is a serverless and easy-to-use Change Data Capture (CDC) and replication service that allows you to synchronize data across heterogeneous databases, storage systems, and applications reliably and with minimal latency. Datastream supports change data streaming from Oracle and MySQL databases to Google Cloud Storage (GCS). The service offers streamlined integration with Dataflow templates to power up to date materialized views in BigQuery for analytics, replicate their databases into Cloud SQL or Cloud Spanner for database synchronization, or leverage the event stream directly from GCS to realize event-driven architectures.”

Agree with D

D because we need replication: As a data analyst, you can query data in Cloud SQL from BigQuery using federated queries (...) Alternatively, to replicate data into BigQuery, you can also use Cloud Data Fusion or Datastream. Datastream is a serverless and easy-to-use change data capture (CDC) and replication service that lets you synchronize data reliably, and with minimal latency. Datastream provides seamless replication of data from operational databases into BigQuery. reference: https://cloud.google.com/bigquery/docs/cloud-sql-federated-queries https://cloud.google.com/datastream/docs/overview

You can not connect Datastream directly to Cloud SQL with an internal IP without using A compute instance where a SQL Proxy is deployed to bridge the traffic between Datastream and Cloud SQL. Because connecting to Cloud SQL from Datastream is not possible https://github.com/rocketechgroup/mysql-to-bq-datastream

B As a data analyst, you can query data in Cloud SQL from BigQuery using federated queries. BigQuery Cloud SQL federation enables BigQuery to query data residing in Cloud SQL in real time, without copying or moving data. Query federation supports both MySQL (2nd generation) and PostgreSQL instances in Cloud SQL. Alternatively, to replicate data into BigQuery, you can also use Cloud Data Fusion or Datastream. For more about using Cloud Data Fusion, see Replicating data from MySQL to BigQuery. https://cloud.google.com/bigquery/docs/cloud-sql-federated-queries

I'll go for D

D: Use Datastream to capture *** changes, and use Dataflow to write those changes to BigQuery. Dataflow is a fully managed streaming analytics service that minimizes latency, processing time, and cost through autoscaling and batch processing. Dataflow is a managed service for executing a wide variety of data processing patterns. The documentation on this site shows you how to deploy your batch and streaming data processing pipelines using Dataflow, including directions for using service features.