Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

aws-samples/generative-ai-on-amazon-sagemaker

Generative AI on Amazon SageMaker and Amazon Bedrock

This repository provides comprehensive resources for working with generative AI models using Amazon SageMaker and Amazon Bedrock. Whether you're looking to fine-tune foundation models, build RAG applications, create agents, or implement responsible AI practices, you'll find practical examples and workshops here.

Repository Structure

Workshops

  • Build experimental RAG applications
  • Implement RAG with SageMaker and OpenSearch
  • Fine-tune embedding models
  • Customize models with RAFT
  • Apply guardrails to LLM outputs
  • Use SageMaker JumpStart for fine-tuning
  • Implement distributed training with FSDP and QLoRA
  • Deploy models on SageMaker HyperPod with Kubernetes
  • Basic inference with Bedrock and SageMaker
  • Implement tool calling capabilities
  • Build agent patterns (autonomous, orchestrator-worker, etc.)
  • Use agent frameworks (LangGraph, CrewAI, Strands, etc.)
  • Add observability with Langfuse and MLflow
  • Set up a Foundation Model Playground
  • Customize foundation models
  • Evaluate models with LightEval
  • Implement responsible AI with Bedrock Guardrails
  • Develop FMOps fine-tuning workflows with SageMaker Pipelines
  • Experiment Management with Comet [Image Classification, Fraud Detection]
  • Evaluting LLM applications with Comet Opik
  • Evaluating Agents with Opik
  • LLM Evaluation with Comet
  • Model Monitoring with Fiddler
  • RAG chatbot evaluation with Deepchecks

Getting Started

  1. Clone this repository
  2. Navigate to the workshop of your choice
  3. Follow the instructions in the workshop's README.md file
  4. Each workshop contains Jupyter notebooks that guide you through the process

Prerequisites

  • AWS account with appropriate permissions
  • Basic understanding of machine learning concepts
  • Familiarity with Python programming
  • Access to Amazon SageMaker and Amazon Bedrock services

Contributing

We welcome contributions! Please see CONTRIBUTING for details on how to submit pull requests, report issues, or suggest improvements.

Security

See CONTRIBUTING for more information about reporting security issues.

License

This library is licensed under the MIT-0 License. See the LICENSE file for details.

AltStyle によって変換されたページ (->オリジナル) /