Skip to content

Conversation

@cswatt
Copy link
Contributor

@cswatt cswatt commented Jan 15, 2026

What does this PR do? What is the motivation?

The existing LLM Obs Experiments page is getting very long, and more content (querying and widgets) is in the pipeline. Ahead of that, we're splitting this page into:

  • index: overview of feature
  • setup and usage: installing the SDK, creating projects/datasets/experiments, running experiments
  • datasets: more detailed info about datasets, managing datasets, version info etc.
  • api: experiments api reference doc

Merge instructions

Merge readiness:

  • Ready for merge

For Datadog employees:

Your branch name MUST follow the <name>/<description> convention and include the forward slash (/). Without this format, your pull request will not pass CI, the GitLab pipeline will not run, and you won't get a branch preview. Getting a branch preview makes it easier for us to check any issues with your PR, such as broken links.

If your branch doesn't follow this format, rename it or create a new branch and PR.

[6/5/2025] Merge queue has been disabled on the documentation repo. If you have write access to the repo, the PR has been reviewed by a Documentation team member, and all of the required checks have passed, you can use the Squash and Merge button to merge the PR. If you don't have write access, or you need help, reach out in the #documentation channel in Slack.

Additional notes

@cswatt cswatt requested a review from a team as a code owner January 15, 2026 16:54
@cswatt cswatt added the WORK IN PROGRESS No review needed, it's a wip ;) label Jan 15, 2026
@github-actions github-actions bot added the Architecture Everything related to the Doc backend label Jan 15, 2026
@cswatt cswatt changed the title experiments reorg DOCS-13083: Split LLM Obs Experiments into sub-pages Jan 15, 2026
Copy link
Contributor

@maycmlee maycmlee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks great! Just a couple of small nits, but approving. I think the structure works well! I just wondered if Datasets would make sense under Setup and Usage.


This page describes how to set up and use LLM Observability Experiments with the Python SDK.

## Setup LLM Observability
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
## Setup LLM Observability
## Set up LLM Observability

title: Experiments
description: Using LLM Observability Experiments feature
private: true
description: An overview of Datadog's LLM Observability Experiments feature
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
description: An overview of Datadog's LLM Observability Experiments feature
description: An overview of Datadog's LLM Observability Experiments feature.

@@ -0,0 +1,551 @@
---
title: Experiments API
description: Reference the LLM Observability Experiments HTTP API
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
description: Reference the LLM Observability Experiments HTTP API
description: Reference the LLM Observability Experiments HTTP API.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Architecture Everything related to the Doc backend WORK IN PROGRESS No review needed, it's a wip ;)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants