Select your cookie preferences

We use essential cookies and similar tools that are necessary to provide our site and services. We use performance cookies to collect anonymous statistics, so we can understand how customers use our site and make improvements. Essential cookies cannot be deactivated, but you can choose “Customize” or “Decline” to decline performance cookies.

If you agree, AWS and approved third parties will also use cookies to provide useful site features, remember your preferences, and display relevant content, including relevant advertising. To accept or decline all non-essential cookies, choose “Accept” or “Decline.” To make more detailed choices, choose “Customize.”

AWS Logo
Menu

Coding Perspective: PartyRock App Development with Amazon Bedrock APIs

An alternative approach to building Gen AI applications using Amazon Bedrock -architectural considerations & model selection.

generative-aiamazon-bedrockamazon-sagemakerpartyrock-hackathon
Shusrita Venugopal
Published Apr 10, 2024
Last Modified Apr 15, 2024
Comments

Overview of PartyRock

PartyRock serves as an Amazon Bedrock Playground, providing a fast and enjoyable platform to learn about Prompt Engineering and Foundational Models (FMs) for developing functional apps with generative AI. It offers a code-free app builder, allowing users to experiment with prompt engineering techniques and review generated responses while creating and exploring various applications. The PartyRock generative AI Hackathon garnered significant participation, reflecting its global popularity.

PartyRock: A Coding Perspective

During the hackathon, an intriguing bonus challenge was presented, inviting participants to explore an alternative development scenario for building applications using Amazon Bedrock in the absence of PartyRock, This prompted me to reflect on alternative development scenarios using Amazon Bedrock, given my background in information science and interest in coding.

Developing GenAI Applications Using Amazon Bedrock

Amazon Bedrock provides a fully managed service offering high-performing foundation models (FMs) from leading AI companies through a single API. Experimentation with top FMs for various use cases is simplified, allowing for customization with relevant data using techniques like Retrieval Augmented Generation (RAG).

My PartyRock App - Build With AWS

Build With AWS simplifies the selection of AWS services for users' applications. By inputting project details, users receive a tailored list of AWS services, along with step-by-step guidance on integration. The app also offers access to AWS resources and features a built-in chatbot for real-time assistance.
Try the app
View Demo / Snapshot

Architectural Considerations for developing "Build With AWS" app on Amazon Bedrock

Pre-requisites for development

  1. AWS cloud account with access to Amazon Bedrock.
  2. To use Amazon Bedrock, you must request access to BedRock's FMs (configure IAM policy to access Bedrock APIs). You may also have to submit your usecase to access a few models from Anthropic.
  3. For experimenting with this use case, I chose Amazon Titan Embeddings G1 - Text and Anthropic Claude foundational models.
  4. I had my code running in us-west-2 (Oregon) region and I used Amazon SageMaker studio for simplicity.
  5. To use BedRock APIs, python was installed.
  6. Install the boto3 and botocore AWS SDK for python (Boto3)
  7. Necessary Supporting Libraries: FAISS (Facebook AI Similarity Search) and LangChain (framework for developing applications powered by language models.).
In designing my GenAI application, several architectural considerations were crucial to ensure its effectiveness and usability, particularly given the need to handle domain-specific and proprietary data. Here, I'll delve into the architectural decisions made to address these requirements:

Querying Domain-Specific and Proprietary Data :

My application needed to access and utilize domain-specific and proprietary data effectively, such as the most relevant products and services offered by AWS. This involved querying information relevant to the application's requirements, including its machine learning and AI capabilities, the type of data used (relational or non-relational), and whether it was intended for a web or mobile application.

Retrieval Augmented Generation (RAG) Architecture :

To overcome the limitations posed by the size constraints of prompt-based models, I adopted the Retrieval Augmented Generation (RAG) architectural pattern. RAG leverages Knowledge Bases within Amazon Bedrock to provide contextual information sourced from private data repositories. By augmenting prompts with relevant retrieved data, RAG enhances response accuracy and tailors responses to the user's needs.
Why RAG?
Contextual Information: RAG furnishes foundation models (FMs) and agents with contextual information from private data sources, enabling more accurate and relevant responses.
- Improved Accuracy: By leveraging external data sources, RAG produces responses that are not only more relevant but also more accurate.
- Tailored Responses: RAG retrieves data from outside the language model and augments prompts, resulting in responses tailored to the user's specific requirements.

Implementing Retrieval Augmented Generation (RAG) Architecture with Knowledge Bases :

Knowledge Bases for Amazon Bedrock provides a fully managed capability to implement the RAG workflow, from ingestion to retrieval and prompt augmentation. I created a knowledge base by connecting an S3 bucket containing documentation for AWS services and products.
The ingestion process involved splitting data into smaller chunks, generating embeddings, and storing them in the associated vector store. I utilized open-source tools like Lang Chain to effectively implement the RAG pattern on the knowledge base.
Using the Retrieve API provided by Knowledge Bases for Amazon Bedrock, user queries were converted into embeddings and searched within the knowledge base. The relevant results, including retrieved text chunks and relevance scores, were obtained, offering more control over building custom workflows.
Amazon knowledge base

Model Selection :

In my exploration of foundational models for my GenAI application, I experimented with three primary models Amazon Titan, Mistral AI, and Anthropic's Claude.
  1. Amazon Titan:
    1. Description: Amazon Titan foundation models offer a wide range of high-performing image, multimodal, and text model choices through a fully managed API.
    2. Features: Pretrained on large datasets, Amazon Titan models are powerful and versatile, supporting various use cases while ensuring responsible AI usage.
    3. Customization: These models can be used as-is or customized with proprietary data to tailor them to specific application requirements.
  2. Mistral AI :
    1. Description: Mistral AI is committed to advancing AI technologies and elevating publicly available models to state-of-the-art performance.
    2. Features: I utilized the Mistral 7B model, a compact yet potent dense Transformer suitable for various tasks, including text summarization, question answering, and code completion.
    3. Customization: Mistral AI models are easily customizable and offer support for multiple languages, making them adaptable to diverse use cases.
  3. Anthropic's Claude:
    1. Description: Anthropic's Claude represents the cutting-edge of large language models, designed to prioritize speed, cost-effectiveness, and context understanding.
    2. Features: Claude is built on Anthropic's research into creating reliable, interpretable, and controllable AI systems, excelling in tasks such as dialogue generation, content creation, and complex reasoning.
    3. Customization: I opted for Claude Instant version 1, a faster and cost-effective option with a generous max token limit of 100K. It supports multiple languages and is suitable for various tasks, including text analysis, summarization, and document comprehension.
       

       
Comments

Comments

Log in to comment