Amazon Bedrock: Anthropic’s model, Claude 2.1
This blog contains information regarding AWS Anthropic model Claude 2.1 and what it is difference
Published Jan 30, 2024
Anthropic’s model, Claude 2.1 was introduced in November 2023. It targets the enterprise level applications that can be used commercially.
Key Differences and enhancements:
- Supports 200,000 tokens, roughly 150,000 words or around 500 pages of documents where Claude 2.0 supports 100,000 tokens
- Helps to summarise, doing Q&A, forecast trends on various factors and did stats and comparison for multiple documents better than before
- 50% fewer hallucinations
- 30% reduction in incorrect answers
- 3–4 times lower rate of mistakes in comparison of the documents
- Can integrate different APIs
The model is available in AWS Bedrock in the US East (N. Virginia) and US West (Oregon) Regions.
Making a requests using AWS Bedrock:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
import anthropic_bedrock
from anthropic_bedrock import AnthropicBedrock
client = AnthropicBedrock(
aws_access_key="<aws access key>",
aws_secret_key="<aws secret key>",
aws_session_token="<aws_session_token>",
aws_region="us-east-2",
)
prompt_completion = client.completions.create(
model="anthropic.claude-v2:1",
max_tokens_to_sample=256,
prompt=f"{anthropic_bedrock.HUMAN_PROMPT} Tell me top 10 happenings on 10th January in the history of the world! {anthropic_bedrock.AI_PROMPT}",
)
print(prompt_completion.completion)