LLM agents built for control. Designed for real-world use. Deployed in minutes.
python gemini openai customer-service hacktoberfest customer-success ai-agents ai-alignment llm genai llama3
-
Updated
Oct 16, 2025 - Python
#
ai-alignment
Here are 91 public repositories matching this topic...
Language: All
Filter by language
Sort: Most stars
Sort options
PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. 🏆 Best Paper Awards @ NeurIPS ML Safety Workshop 2022
machine-learning agi language-models ai-safety adversarial-attacks ai-alignment ml-safety gpt-3 large-language-models prompt-engineering chain-of-thought agi-alignment
-
Updated
Feb 26, 2024 - Python
A curated list of trustworthy deep learning papers. Daily updating...
security privacy deep-learning backdoor uncertainty ownership causality fairness watermarking poisoning robustness adversarial-machine-learning machine-unlearning interpretable-deep-learning ai-alignment green-ai membership-inference-attack hallucinations gradient-leakage out-of-distribution-generalization
-
Updated
Aug 20, 2025
📚 A curated list of papers & technical articles on AI Quality & Safety
machine-learning natural-language-processing awesome ai computer-vision ml artificial-intelligence awesome-list ai-safety model-validation robustness mlops ai-alignment model-testing ml-safety ethical-ai ml-testing llm llmops ai-quality
-
Updated
Apr 14, 2025
Code accompanying the paper Pretraining Language Models with Human Preferences
reinforcement-learning gpt language-models ai-safety ai-alignment pretraining decision-transformers rlhf
-
Updated
Feb 13, 2024 - Python
How to Make Safe AI? Let's Discuss! 💡|💬|🙌|📚
-
Updated
Mar 29, 2023
[AAAI'25 Oral] "MIA-Tuner: Adapting Large Language Models as Pre-training Text Detector".
-
Updated
Mar 17, 2025 - Python
Reading list for adversarial perspective and robustness in deep reinforcement learning.
deep-reinforcement-learning ai-safety machine-learning-security ai-security robust-machine-learning ai-alignment safe-reinforcement-learning robust-reinforcement-learning responsible-ai adversarial-reinforcement-learning secure-ai ml-security llm-security reinforcement-learning-safety llm-safety artificial-intelligence-security artificial-intelligence-alignment robust-deep-reinforcement-learning reinforcement-learning-security large-language-model-safety
-
Updated
Jul 25, 2025
A curated list of awesome academic research, books, code of ethics, data sets, institutes, maturity models, newsletters, principles, podcasts, reports, tools, regulations and standards related to Responsible, Trustworthy, and Human-Centered AI.
ai awesome-list ai-safety interpretable-ai explainable-ai xai ai-alignment fairness-ai responsible-ai ethical-ai trustworthy-ai ai-regulation ai-governance ai-standards
-
Updated
Oct 14, 2025
A curated list of awesome resources for Artificial Intelligence Alignment research
-
Updated
Jul 14, 2023
Sparse probing paper full code.
-
Updated
Dec 17, 2023 - Jupyter Notebook
Official Implementation of Nabla-GFlowNet (ICLR 2025)
-
Updated
May 3, 2025 - Python
Website to track people, organizations, and products (tools, websites, etc.) in AI safety
-
Updated
Oct 16, 2025 - HTML
[TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
-
Updated
Sep 15, 2023 - Python
An initiative to create concise and widely shareable educational resources, infographics, and animated explainers on the latest contributions to the community AI alignment effort. Boosting the signal and moving the community towards finding and building solutions.
-
Updated
Jul 9, 2023
Community list of awesome projects, apps, tools and more related to Polis.
civictech democracy pca civic-tech awesome-list collective-intelligence kmeans-clustering participation participatory-democracy polis ai-alignment wikisurvey
-
Updated
Oct 14, 2025 - JavaScript
Code and materials for the paper S. Phelps and Y. I. Russell, Investigating Emergent Goal-Like Behaviour in Large Language Models Using Experimental Economics, working paper, arXiv:2305.07970, May 2023
economics ai-safety gametheory experimental-economics behavioral-economics prisoners-dilemma ai-alignment experimental-psychology social-dilemmas gpt-3 gpt-4 llm principal-agent-problem
-
Updated
Dec 11, 2024 - Python
Scan your AI/ML models for problems before you put them into production.
-
Updated
Mar 31, 2025 - Python
a prototype for an AI safety library that allows an agent to maximize its reward by solving a puzzle in order to prevent the worst-case outcomes of perverse instantiation
-
Updated
Nov 8, 2022 - Python
Improve this page
Add a description, image, and links to the ai-alignment topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ai-alignment topic, visit your repo's landing page and select "manage topics."