11 docs tagged with "evals"

How testrelic-deepeval captures DeepEval results and uploads them to TestRelic without modifying DeepEval — and what it deliberately does not do.

Reference for the testrelic command — login, logout, test, view, drain, version, and migrate-from-confident.

Authenticate, run a DeepEval evaluation, and see it land in the TestRelic eval workspace, Test Runs feed, and repo Evaluations tab.

Configure testrelic-deepeval with environment variables, the credentials file, base-url overrides, and project/repo identity.

Store DeepEval goldens in TestRelic so they're versioned, shared across your team, and pinnable to specific eval runs — push, pull, and label.

Practical testrelic-deepeval examples — a pytest suite, the evaluate() wrapper, an offline-then-drain workflow, and a GitHub Actions step.

Install testrelic-deepeval, log in, run a DeepEval suite, and view the eval run in TestRelic.

Move your DeepEval evals from Confident AI to TestRelic in three small changes — your test code stays the same.

How testrelic-deepeval captures DeepEval runs — the pytest plugin, the evaluate() wrapper, the offline queue, and the native evals upload path.

How the testrelic-deepeval pytest plugin captures your DeepEval TestRun, resolves credentials, passes through hyperparameters, and stays out of the way.

Capture DeepEval LLM-evaluation results and upload them to your TestRelic org instead of Confident AI.