“ Just to confirm, are you following this
“ I had the same issue https://stackoverflow.com/questions/73941651/datastream-from-cloud-sql-postgresql-to-bigquery-bigquery-too-many-primary-key it seems that it is coming from the unique index. ”
“ I would expect BigQuery to respect the REPLICA IDENTITY from the source tables and act similar to PostgreSQL's rules for setting up a publication:
From: https://www.postgresql.org/docs/current/logical-replication-publication.html ”
“ For information on how to set the replica identity see:
https://www.postgresql.org/docs/current/sql-altertable.html#SQL-CREATETABLE-REPLICA-IDENTITY ”
“ Finding the replica identity for a table is done as described here: https://stackoverflow.com/questions/55249431/find-replica-identity-for-a-postgres-table ”
“ Ugh, dealing with the BIGQUERY_TOO_MANY_PRIMARY_KEYS error can be such a headache—it's like Datastream is testing my patience! Sometimes, debugging feels like trying to sort through 100+ dirty pick-up lines—you’re just hoping one of them works, but most are a total miss. Anyone have tips to get this cleaned up without losing my sanity? https://dirtypickuplines.online/ ”