aws-samples/bedrock-chat

AWS-native chatbot using Bedrock

What it solves

Bedrock Chat (BrChat) provides a complete, multilingual generative AI platform that allows organizations to deploy a secure, scalable chatbot interface. It solves the problem of quickly setting up a chat application that supports custom bots with specialized knowledge (RAG), task automation via agents, and a centralized bot store for sharing customized AI assistants across a user base.

How it works

The platform is built entirely on AWS managed services to eliminate infrastructure management. It uses Amazon Bedrock to access foundational models (such as Claude, Llama, and Nova) and Bedrock Knowledge Bases for Retrieval-Augmented Generation (RAG).

Key technical components include:

  • Backend: FastAPI running on AWS Lambda with Amazon API Gateway.
  • Frontend: A React and Tailwind CSS application delivered via Amazon CloudFront and S3.
  • Knowledge Management: Amazon OpenSearch Serverless for vector search and AWS Step Functions to orchestrate the ingestion of external documents.
  • User Management: Amazon Cognito for authentication and AWS WAF for IP-based access control.
  • Storage: Amazon DynamoDB for conversation history.

Who it’s for

It is designed for developers and organizations using AWS who want to deploy a production-ready generative AI chat interface with built-in support for multi-tenant knowledge bases, administrative controls, and the ability to publish customized bots as standalone APIs.

Highlights

  • Custom Bot Store: Create personalized bots with specific instructions and knowledge, then share them via an internal marketplace.
  • RAG Support: Integrated support for Amazon Bedrock Knowledge Bases, including a "multi-tenant" mode to bypass account limits on the number of knowledge bases.
  • Agentic Capabilities: Support for agents that can retrieve information from external tools or break complex tasks into multiple steps.
  • API Publishing: Ability to publish customized bots as standalone APIs for external integration.
  • Administrative Tools: Built-in features for API management, usage analytics, and bot governance.
  • Easy Deployment: One-click deployment via a shell script or AWS CDK for highly customizable environments.