AWS Bedrock Access Gateway: OpenAI-Compatible API for GenAI Models

Listen to this Post

Featured Image
AWS Bedrock provides a unified interface to access multiple foundational GenAI models. The bedrock-access-gateway project enables OpenAI-style API key authentication for Bedrock, making it easier to integrate with existing workflows.

Key Features

  • OpenAI-Compatible API – Use Bedrock like OpenAI with endpoint URLs and API keys.
  • Seamless Auth – API keys stored in AWS Secrets Manager.
  • Scalable Backend – Uses ALB with Lambda/Fargate.

πŸ”— GitHub Repo: aws-samples/bedrock-access-gateway

You Should Know:

1. Deploying Bedrock Access Gateway

git clone https://github.com/aws-samples/bedrock-access-gateway.git 
cd bedrock-access-gateway 
aws cloudformation deploy --template-file gateway.yaml --stack-name bedrock-gateway 

2. Generating & Storing API Keys

 Generate a random API key 
openssl rand -hex 32

Store in AWS Secrets Manager 
aws secretsmanager create-secret --name bedrock-api-key --secret-string "YOUR_API_KEY" 

3. Querying Bedrock via API

curl -X POST "https://YOUR-ALB-DNS.amazonaws.com/v1/completions" \ 
-H "Authorization: Bearer YOUR_API_KEY" \ 
-H "Content-Type: application/json" \ 
-d '{"prompt":"Explain AWS Bedrock in 50 words", "max_tokens":50}' 

4. Monitoring API Usage

aws cloudwatch get-metric-statistics \ 
--namespace AWS/ApplicationELB \ 
--metric-name RequestCount \ 
--dimensions Name=LoadBalancer,Value=YOUR-ALB-ARN \ 
--start-time $(date -u +"%Y-%m-%dT%H:%M:%SZ" --date="-5 minutes") \ 
--end-time $(date -u +"%Y-%m-%dT%H:%M:%SZ") \ 
--period 60 --statistics Sum 

5. Securing the Gateway

 Restrict ALB access to specific IPs 
aws elbv2 modify-security-group-rules \ 
--group-id YOUR-SG-ID \ 
--security-group-rules '[{"SecurityGroupRuleId": "sgr-123", "SecurityGroupRule": { "IpProtocol": "tcp", "FromPort": 443, "ToPort": 443, "CidrIpv4": "YOUR_IP/32" }}]' 

What Undercode Say

AWS Bedrock’s flexibility is enhanced by bedrock-access-gateway, bridging the gap between AWS IAM and OpenAI-style API keys. This setup is ideal for developers migrating from OpenAI to Bedrock while maintaining existing workflows.

πŸ”Ή Expected Commands Output:

{ "completion": "AWS Bedrock is a fully managed service offering access to high-performing foundation models (FMs) from leading AI companies, enabling scalable generative AI applications." } 

πŸ”Ή Prediction:

As more enterprises adopt multi-model GenAI strategies, tools like bedrock-access-gateway will become essential for unified API management across cloud providers.

Expected Output:

A functional OpenAI-compatible Bedrock API endpoint with secure key-based authentication.

IT/Security Reporter URL:

Reported By: Darryl Ruggles – Hackers Feeds
Extra Hub: Undercode MoN
Basic Verification: Pass βœ…

Join Our Cyber World:

πŸ’¬ Whatsapp | πŸ’¬ Telegram