Skip to main content
​
09.25.2025
Since LLMs are probabilistic, their synthesis can differ even when the supplied prompts are exactly the same. This can make it challenging to determine if a particular change is warranted as a single execution cannot concretely tell you whether a given change improves or degrades your task.
So what can you do when an execution can change from one run to the next? That’s where repetitions come in.Repetitions help you reduce uncertainty in systems prone to variability, notably more β€œagentic” systems.

feat: support repetitions by axiomofjoy Β· Pull Request #9657 Β· Arize-ai/phoenixGitHub

Github

feat(playground): add repetitions to playground by axiomofjoy Β· Pull Request #9514 Β· Arize-ai/phoenixGitHub

Github