Serverless data warehousing | The Big Dev Theory | S1 | Ep.2

Serverless data warehousing in realtime with Aiven for clickhouse, Lambda and S3

Stuart Clark
Amazon Employee
Published Feb 12, 2024
Last Modified Feb 14, 2024
In this episode of The Big Dev Theory on Twitch, we are joined by Ben Gamble Enterprise & Solutions Marketing Lead from Aiven
Getting access to data fast is often the difference between making a sale and losing a customer. But data is not always provided in the formats we want. S3 has been the engine behind much of the “big data” renaissance of the last few years, giving developers the ability to have a place to land almost anything. However , getting that data into a structured format can be a pain. By using AWS Lambdas and Aiven for clickhouse, we’ll build a serverless, asynchronous data loader for all kinds of data formants from CSVs to Parquet, and an access layer to serve it to a front end. If you want near instant access to data from your front end applications with all the power of a data warehouse, come and learn how to make it happen with just some python, some SQL and have a fully scalable system ready to go.

Links Shared in the stream

Each episode, we chat with AWS partners and bring experts with specialized knowledge in various areas of technology to provide informative and engaging live streams that help developers stay up-to-date with the latest trends and tools.


Stuart Clark, Senior Developer Advocate @ AWS
Shannon Brazil, Incident Responder, CIRT @AWS

What is the The Big Dev Theory?

The Big Dev Theory is a live stream broadcast every week on the AWS Twitch channel. Our live streams are designed to help developers learn about the advantages of our partner technologies and AWS, these events provide developers with the opportunity to learn from some of the top minds in the industry and connect with other developers who are working on similar projects. A key part of its mission to help developers build and innovate with confidence.

Any opinions in this post are those of the individual author and may not reflect the opinions of AWS.