Back to catalog

GITHUB TOPIC

llm-observability

9projects include this topic

The "llm-observability" topic on GitHub groups 9 open-source projects in the DeepSeek Harness (DSH) ecosystem, led by dsh-plugin with 17 GitHub stars. dsh-plugin — OpenTelemetry tracing for DeepSeek Harness (dsh): turns each agent turn into a GenAI span tree — steps, LLM calls with TTFT, tool executions, token usage — exported over standard OTLP to Jaeger, Grafana Tempo, SigNoz, Langfuse, or any compatible backend. Every project here is indexed by DSH Universe with live GitHub data — stars, activity and install status — so you can compare and install directly.

{count} projects

Exact GitHub Topic match

OperationsInfrastructure

dsh-plugin

loongsuite

OpenTelemetry tracing for DeepSeek Harness (dsh): turns each agent turn into a GenAI span tree — steps, LLM calls with TTFT, tool executions, token usage — exported over standard OTLP to Jaeger, Grafana Tempo, SigNoz, Langfuse, or any compatible backend.

Outside plugin validation
agent-observabilityai-codingdeepseek-harnessdistributed-tracing
OperationsPlugin

Langfuse observability for DeepSeek Harness (dsh): exports agent sessions as OpenTelemetry trace trees (GenAI semconv) to Langfuse's OTLP endpoint

Structure check pending
agent-tracingdeepseek-harnessdsh-pluginlangfuse
OperationsInfrastructure

dsh-observe

PerryLink

OpenTelemetry and Langfuse observability exporter for DeepSeek Harness: turn/step/tool/LLM spans, token and cost metrics, sanitized prompt/completion capture, async batching, bounded offline buffering, retry with backoff

Outside plugin validation
cordisdeepseekdeepseek-harnessdsh
Development toolsPlugin

DeepSeek Harness (DSH) read-only execution trace review plugin: rule-based analysis, independent model interpretation, evidence location, task overview and run comparison.

Structure check pending
agent-observabilityai-agentsdeepseek-harnessdeveloper-tools
Files & dataPlugin

DeepSeek Harness usage dashboard with API balance, daily spend, external vision-call accounting, per-model stats, call logs, cache rate, TTFT, and CSV export.

Structure check pending
dashboarddeepseek-harnessdshdsh-plugin
Development toolsPlugin

Persistent provider-reported token usage statistics for DeepSeek Harness with per-session, per-model, and daily activity data.

Structure check pending
ai-developer-toolscordisdeepseekdeepseek-harness
Development toolsPlugin

Local request and response inspector for session-associated DeepSeek Harness LLM calls

Structure check pending
debuggingdeepseek-harnessdeveloper-toolsdsh
OperationsPlugin

DeepSeek Harness (dsh) usage analytics plugin: peak/valley billing dock, token/cost/model dashboard, cross-session history, global filters | Usage analytics plugin: peak/valley billing dock + usage dashboard

Structure check pending
aicordiscost-trackingdashboard
Files & dataPlugin

dsh-governor

JoaquinDG

Behavioural supervision for DeepSeek Harness agents: retry storms, reasoning-budget burn, and a backstop that survives host suspend.

Structure check pending
agent-supervisioncordisdeepseek-harnessdsh-plugin