Training data, synthetic data, benchmarks, provenance and evaluation operations.

Why it is movingGenerative-AI observability is moving beyond token counts and latency charts. OpenTelemetry has established GenAI semantic-convention work for model, agent and MCP operations. Agent SDKs record nested model, tool, handoff and guardrail spans. Evaluation platforms increasingly run deterministic checks, human review and LLM judges over offline datasets or sampled production traces, then promote failures into regression suites. Cloud platforms expose agent, quality and safety evaluators, judge-model calibration and run comparison. The emerging production system is therefore a feedback control plane: telemetry records what happened, evaluators estimate whether it was acceptable, incident workflows identify root causes, and release policy decides whether a change may advance.

Why it is movingNVIDIA now treats synthetic generation, scoring, filtering and global deduplication as a repeatable data pipeline. Google and Microsoft are developing inference-only differentially private synthesis methods. AWS has added privacy-enhancing synthetic dataset generation to Clean Rooms. The U.S. Census Bureau continues to combine synthetic data with validation against protected real data. Research on model collapse, privacy leakage and contamination shows why generation alone is not enough: the useful artifact is a governed dataset release with measured utility, privacy, diversity, provenance and real-world fidelity.