Document Topic Discovery MCP tools in Agent Observability MCP page#37468
Conversation
Preview links (active after the
|
aniszoubiramar
force-pushed
the
anis.amar/llm-obs-mcp-topic-discovery-tools
branch
2 times, most recently
from
3d97afe to
7151435
Compare
| : Get the topic hierarchy for a run with span IDs inlined on each leaf topic. Set `include_metrics=true` to also include per-span duration, cost, token counts, and evaluations. | ||
|
|
||
| `get_llmobs_pattern_points` | ||
| : Get a cursor-paginated page of clustering points (individual spans) assigned to a single topic. Each point includes the `span_id`, `session_id`, a short input preview, and its `cluster_probability`. Pass `next_page_token` back as `page_token` to continue paging. |
There was a problem hiding this comment.
I think we should remove the cluster_probability from the results for now. This is an artifact from the ML pipeline, it is no longer updated with the LLM pipeline (always 1.0).
Also when you say "a short input preview", do you truncate the preview in the BE ? because currently in Orgstore the entire input is stored
There was a problem hiding this comment.
Done — removed cluster_probability and I don't think we truncate the input in the backend as we use the same service functions as the /unstable endpoints
There was a problem hiding this comment.
Output truncated https://github.com/DataDog/dd-source/pull/467951/commits
| : List all completed Patterns runs for a config, newest first. Returns each run's `id`, `status`, timestamps, and the `config_snapshot` used. | ||
|
|
||
| `get_llmobs_patterns` | ||
| : Get the topic hierarchy discovered by a Patterns run. Topics are organized into levels, each with a `name`, `description`, `coherence_score`, and `point_count`. Omit `run_id` to read the most recent completed run. |
There was a problem hiding this comment.
Same for the coherence score. This is no longer computed, we should remove it from the results of the API
There was a problem hiding this comment.
Done — removed coherence_score from the description.
aniszoubiramar
force-pushed
the
anis.amar/llm-obs-mcp-topic-discovery-tools
branch
2 times, most recently
from
8b34d40 to
ca7be20
Compare
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
aniszoubiramar
force-pushed
the
anis.amar/llm-obs-mcp-topic-discovery-tools
branch
from
ca7be20 to
41d0a33
Compare
4 participants
What does this PR do? What is the motivation?
Documents the 7 new Topic Discovery (Patterns) read MCP tools added to the
llmobstoolset in dd-source#461008.Changes to
content/en/llm_observability/mcp_server.md:### Topic Discovery toolssubsection with all 7 tools (list_llmobs_pattern_configs,get_llmobs_pattern_config,get_llmobs_pattern_run_status,list_llmobs_pattern_runs,get_llmobs_patterns,get_llmobs_patterns_with_points,get_llmobs_pattern_points)### Topic Discovery analysisrecommended workflow (5-step read flow)Merge instructions
Merge readiness:
Additional notes
Corresponds to dd-source PR #461008 ([2/3] feat(llm-obs-mcp): add Topic Discovery read MCP tools).