Evaluation - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Xinyang Wu

Aug 3

RAG Beyond the Demo: Pipeline, Citations, Evaluation, and When Not to Bother

#rag #llm #embeddings #evaluation

7 min read

Saurav Bhattacharya

Aug 2

Your New Eval Rule Is Untested Code Guarding Production

#ai #agents #evaluation #testing

5 min read

Adha AK

Jul 30

OpenEval: Why LLM Evaluation Needs a Standard Format

#llm #evaluation #ai #testing

1 min read

Saurav Bhattacharya

Jul 26

Right Tool, Wrong Arguments: The Agent Failure Your Evals Wave Through

#ai #agents #evaluation #observability

4 min read

Jul 21

Your eval dashboard has 30 metrics. When one "moves," that is usually arithmetic, not a regression.

#statistics #machinelearning #datascience #evaluation

6 min read

Saurav Bhattacharya

Jul 29

Your Agent's Confidence Score Is Not a Probability

#ai #agents #evaluation #observability

4 min read

Pneumetron

Jul 15

PoPE: Placebo-Controlled Evaluation Challenges Error-Conditioned Self-Repair in Small Code LLMs

#llms #codegeneration #selfrepair #evaluation

3 min read

Muhammed Rasin O M

Jul 10

Half the answer keys in text-to-SQL benchmarks are wrong. So I generated the database from the answer key.

#evaluation #dataagents #benchmarks #syntheticdata

7 min read

Saurav Bhattacharya

Jul 31

Your Agent's Deadline Is a Correctness Test, Not an SLO

#ai #agents #evaluation #observability

4 min read

Saurav Bhattacharya

Jul 19

Stop Judging Every Run: Eval Sampling Is a Budget Decision, Not a Coverage One

#ai #agents #evaluation #observability

5 min read

Jul 5

Evaluating LLM Apps in Python

#python #ai #llm #evaluation

9 min read

Jul 5

Evaluating LLM Apps in Java

#java #ai #llm #evaluation

10 min read

Saurav Bhattacharya

Jul 2

Short-Circuit Your Agent Evals: Tier Order Is a Latency Budget, Not a Preference

#ai #agents #evaluation #typescript

5 min read

Breach Protocol

Jul 1

Your AI judge might be reliable — and still be wrong

#evaluation #llmjudges #rlhf #methodology

3 min read

Breach Protocol

Jul 1

Reliable, and still wrong

#evaluation #llmasjudge #benchmarks

3 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.