
Unveiling the Power of Zero-ETL Integration between Amazon RDS for MySQL and Amazon Redshift
Let's Explore the Power of Zero-ETL Integration between Amazon RDS for MySQL and Amazon Redshift
- Sign in to the AWS Management Console and open the Amazon RDS console at https://console.aws.amazon.com/rds/.
- In the navigation pane, choose Parameter groups.
- Choose Create parameter group.
- In the Parameter group family list, select a DB parameter group family.
- In the Type list, if applicable, select DB Parameter Group.
- In the Group name box, enter the name of the new DB parameter group.
- In the Description box, enter a description for the new DB parameter group then choose Create.
- Open parameter group that created before then modify parameters bellow
· binlog_format = ROW
1
2
3
aws redshift-serverless update-workgroup \
--workgroup-name target-workgroup \
--config-parameters parameterKey=enable_case_sensitive_identifier,parameterValue=true
- In Amazon RDS, click Zero-ETL integration at left side menu
- Click zero-ETL integration
- Input integration identifier name then click Next
- In Select source database, choose RDS database then click Next
- In Select target Redshift Datawarehouse, choose redshift datawarehouse then click Next
- In tags and encryption click Next
- Review again, if ok then click Create zero-ETL Integration.
- Wait about 30 minutes till finish
- In Amazon Redshift, click Zero-ETL integration at left side menu
- Click Create Database Integration then input database name for zero-ETL integration in Amazon Redshift. In this article, i use database name redshift_zero_etl
1
CREATE DATABASE demo_zero_etl;
1
2
3
4
5
6
7
8
9
10
11
12
13
USE demo_zero_etl;
CREATE TABLE products (
product_id int,
product_name varchar(255),
PRIMARY KEY (product_id)
);
CREATE TABLE customers (
customer_id int,
customer_name varchar(255),
PRIMARY KEY (customer_id)
);
1
2
3
4
5
6
7
INSERT INTO products VALUES (1, 'Laptop X');
INSERT INTO products VALUES (2, 'Phone Y');
INSERT INTO products VALUES (3, 'Tablet Z');
INSERT INTO customers VALUES (1, 'Ani');
INSERT INTO customers VALUES (2, 'Budi');
INSERT INTO customers VALUES (3, 'Caca');
1
2
3
4
5
UPDATE products set product_name = 'Samsung S24'
WHERE product_id = 2;
UPDATE customers set customer_name = 'Andika'
WHERE customer_id = 3;
1
2
3
DELETE FROM products WHERE product_name = 'Tablet Z';
DELETE FROM customers WHERE customer_name = 'Budi';
- https://aws.amazon.com/about-aws/whats-new/2023/11/amazon-rds-mysql-zero-etl-integration-amazon-redshift-public-preview/
- https://docs.aws.amazon.com/redshift/latest/mgmt/zero-etl-using.html
- https://docs.aws.amazon.com/redshift/latest/mgmt/zero-etl-using.setting-up.html
- https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/zero-etl.setting-up.html#zero-etl.parameters
- https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_WorkingWithDBInstanceParamGroups.html