Skip to main content

Phoenix home page

TypeScript API
Python API
GitHub
Phoenix Cloud
Phoenix Cloud

SDK & API Reference

Community
Blog

Cookbooks

AI Engineering Workflows

LLM Ops Overview
Write your First Custom Eval
Align Evals with Human Feedback
Prompt Optimization Techniques

Tracing

Agentic RAG Tracing
Generating Synthetic Datasets for LLM Evaluators & Agents
Structured Data Extraction
Product Recommendation Agent: Google Agent Engine & LangGraph
More Cookbooks

Human-in-the-Loop Workflows (Annotations)

Using Human Annotations for Eval Driven Development
Aligning LLM Evals with Human Feedback (TypeScript)
Creating a Custom LLM Evaluator with a Benchmark Dataset

Prompt Engineering

Optimizing Coding Agent Prompts - Prompt Learning
Optimizing Prompts for LLM Classification - Prompt Learning
Few Shot Prompting
ReAct Prompting
Chain of Thought Prompting
Prompt Optimization Techniques
LLM-as-a-Judge Prompt Optimization

Evaluation

OpenAI Agents SDK Cookbook
Evaluate a Talk-to-Your-Data Agent
Evaluate RAG
Code Readability Evaluation
Relevance Classification Evaluation
Using Ragas to Evaluate a Math Problem-Solving Agent
More Cookbooks

Datasets & Experiments

Analyzing Customer Review Evals with Repetition Experiments
Experiment with a Customer Support Agent
Model Comparison for an Email Text Extraction Service
Comparing LlamaIndex Query Engines with a Pairwise Evaluator
Prompt Template Iteration for a Summarization Service
Text2SQL Experiments
More Cookbooks

Retrieval & Inferences

Embeddings Analysis
More Cookbooks

Use Cases

Tracing

More Cookbooks

Trace through the execution of your LLM application to understand its internal structure and to troubleshoot issues with retrieval, tool execution, LLM calls, and more.

Use Cases

LlamaIndex + OpenAI RAG Application
LangChain + OpenAI RAG Application
LangChain OpenAI Agent
LlamaIndex OpenAI Agent
Multilingual Text2Cypher with Custom Evaluation Tracing

Product Recommendation Agent: Google Agent Engine & LangGraph Using Human Annotations for Eval Driven Development

⌘I

Powered by Mintlify