Google BigQuery Connector for AWS Glue

What do you like best about the product?

- Easy to setup the connection from Glue to GCP to get up and running with loading data from Bigquery tables to AWS glue
- We use it for bringing the GA data amounting to multiple gigabytes and process it using Pyspark in AWS glue

What do you dislike about the product?

Haven't faced any issues while setting up or using the AWS Glue Connector for Google BigQuery, but having more details and upto date documentation would be a good way to improve it

What problems is the product solving and how is that benefiting you?

For bringing data from Big Query table to AWS glue and process it using AWS glue pyspark and push the processed data to S3 location and then back to another table in Bigquery

What do you like best about the product?

AWS glue has been a game changer for me. We've been utilizing the Glue Schema Registries, it provides versioning of schema, which wasn't available when we were dealing with Pub/Sub Schema.

What do you dislike about the product?

Unfortunately the Glue client is available only in Java. Particularly for the SerDe operations on our Avro Data.

What problems is the product solving and how is that benefiting you?

We use it mostly to provide schemas for our tables in BigQuery. The idea behind using Glue is to inferr avro schema from the data we have from CDC, and move it to BigQuery.

Recommendations to others considering the product:

Strong Tool to manage out your metadata!