Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

Deliver safe & effective language models

Framework for testing vulnerabilities of large language models (LLM).

MIT-licensed Framework for LLMs, RAGs, Chatbots testing. Configurable via YAML and integrable into CI pipelines for automated testing.

Test your production LLMs and simulate users

Create an evaluation framework for your LLM based app. Incorporate it into your test suite. Lay the monitoring foundation.

The prompt engineering, prompt management, and prompt evaluation tool for Go.

The Rhesis SDK enables developers to access curated test sets and generate dynamic ones for GenAI applications. It provides tools to tailor validations to your needs and integrate seamlessly to keep your Gen AI robust, reliable & compliant.

Python Tools for Developing with LLMs (cloud & offline)