Select your cookie preferences

We use essential cookies and similar tools that are necessary to provide our site and services. We use performance cookies to collect anonymous statistics, so we can understand how customers use our site and make improvements. Essential cookies cannot be deactivated, but you can choose “Customize” or “Decline” to decline performance cookies.

If you agree, AWS and approved third parties will also use cookies to provide useful site features, remember your preferences, and display relevant content, including relevant advertising. To accept or decline all non-essential cookies, choose “Accept” or “Decline.” To make more detailed choices, choose “Customize.”

AWS Logo
Menu

How to Export Redshift Tables to S3 in Iceberg Format

Redshift to S3 Iceberg Migration - Preferably using Spark

migrationicebergredshifts3spark
Messiah
Published Feb 5, 2025
Comments
1
I’m new to AWS and need to export tables from Amazon Redshift to S3 in Iceberg format. Since Redshift’s UNLOAD command only supports Parquet, CSV, and JSON, I’m unsure of the best way to achieve this.
Would it be better to:
  1. Unload as Parquet first, then use an AWS service like Glue or EMR to convert and store it in Iceberg format?
  2. Directly write to Iceberg format using AWS Glue or another tool?
If either of these approaches works, I’d really appreciate a step-by-step guide on how to set it up. My priority is a cost-effective and scalable solution, so I’d love to know the best tools and best practices to use.
Any insights or recommendations would be greatly appreciated! Thanks in advance!
 
Comments
1

1 Comment

Log in to comment