Mounting S3 buckets to EC2 Instances | S02 E05 | Build On Generative AI
Getting lots of data to an EC2 instance can be a challenge. Well, let's look into solving this, and attach an S3 Bucket to an EC2 instance so you can get all the training data you need.
Darko Mesaros
Amazon Employee
Published Sep 18, 2023
In today's session Emily and Darko are joined by Devabrat and John, as we all take a closer look at Mountpoint S3. A wonderful little file client for mounting S3 buckets as a local "file system". Remember - S3 Buckets are NOT file Systems! 👏 A great use of this tool is being able to use specific EC2 Instances to run Machine Learning training jobs with out the need to copy the data from the S3 bucket to a local disk.
To quickly get started on Amazon Linux run the following:
1
2
wget https://s3.amazonaws.com/mountpoint-s3-release/latest/x86_64/mount-s3.rpm
sudo yum install -y ./mount-s3.rpm
Then just mount your favorite bucket locally, just make sure you have either an IAM role configured or AWS CLI configured with the appropriate permissions:
1
mount-s3 darkos-secret-bucket-files /mnt/cdrom
Check out the recording here:
Reach out to the hosts and guests: