AWS Logo
Menu

Introducing the Amazon Bedrock Service Quotas Checker - A Tool to Monitor Your Bedrock Limitations

I created a tool to easily check the quotas limit values about Bedrock.

Published Nov 10, 2024
AWS recently published a blog post about Bedrock quota limitations titled "How to handle quota issues when enabling Amazon Bedrock model access or increasing limits" (originally in Japanese).
My AWS account was also affected by these limitations, and I've been working on addressing them following the guidance in the blog posts above.
This inspired me to create a tool that helps retrieve the current Bedrock quota limitation values.

Introducing Amazon Bedrock Service Quotas Checker

This tool allows you to fetch quota limitation values across multiple regions simultaneously.

How to Use the Amazon Bedrock Service Quotas Checker

The tool is designed to be used with AWS CloudShell.
First, clone the repository:
Note: If you're using CloudShell, Boto3 is pre-installed, so no additional setup is required.
If you're running this in a different environment, please run `pip install -r requirements.txt` (this will only install Boto3).

Checking Values in the Current Region

If you don't specify any parameters, the tool will output quota limitation values for the region where your CloudShell is running:
This will display the requests per minute and tokens per minute for each model.
To filter for specific models, you can use "grep"

Checking Values Across Multiple Regions

Use the `--regions` option to target multiple regions:
Note: If you specify non-existent regions or regions where Bedrock is not available, the tool will silently skip them without throwing errors.

Checking Values Across All Bedrock-Supported Regions

To check all regions where Bedrock is available, use the `--all-region` option:
Note: For regions like Europe (Zurich) (eu-central-2) where Bedrock is available but not opted in, the tool will skip them without throwing errors.

Conclusion

Please feel free to use this tool and provide feedback through Pull Requests if you have any suggestions for improvements.
 

Comments