Snowflake Target

​

Key Features

• CDC Streaming: utilizes Snowpipe streaming to deliver real-time changes from the source system.
• Insert Operation: writes CDC updates as inserts into the target Snowflake database, preserving the full change history.
• Dynamic Table: constructs a dynamic table to mirror the source table, enabling easy access to replicated data.
• Time Travel Support: retains historical data for time travel queries, facilitating data analysis and auditing.
• Key-Pair Authentication: relies on Snowflake’s key-pair authentication mechanism — no passwords.
• Schema evolution: new columns are added automatically as the source schema evolves.

​

Prerequisites

• A Snowflake account where you wish to sync your data.
• A role with the required permissions on the target database and schema:
  • USAGE on the database and schema
  • USAGE on the warehouse used to run the connector
  • CREATE TABLE on the schema
  • CREATE DYNAMIC TABLE on the schema
  • INSERT, UPDATE, DELETE on target tables
• A key pair (no passphrase) for authentication. To set it up:
  1. Generate the key pair:
     openssl genrsa 2048 | openssl pkcs8 -topk8 -inform PEM -out rsa_key.p8 -nocrypt
     openssl rsa -in rsa_key.p8 -pubout -out rsa_key.pub
     
  2. Register the public key on the Snowflake user:
     ALTER USER <your_user> SET RSA_PUBLIC_KEY='<public_key_body>';
     
  3. Copy the private key without the header and footer lines:
     -----BEGIN PRIVATE KEY-----
     -----END PRIVATE KEY-----
     

​

Configuration

​

How It Works