跳到主要内容

Agent调试工作台

  • 使用Swager UI搭建AI调试环境，进行测试请求
  • 健康检查
  • SSE调试
  • 检索结果调试
  • 大模型LLM耗时
  • LangGraph 步骤追踪
  • 支持：Embedding、向量检索、全文检索、融合和 Rerank 等调试接口链路

Swager UI搭建AI调试环境​

  • FastAPI 已默认提供 Swagger UI：http://localhost:8000/docs

调试RAG链路​

  • 增加/debug/chat 对话调试链路，包含完整的RAG链路
    • 将问题转换向量
    • 向量检索 + 全文检索（关键词检索）
    • RRF融合合并
    • Rerank重排序
    • LLM生成回答
  • 根据返回的 trace 是一次请求的阶段执行记录
  • 通过trace可查看完整链路：
json
{
  "trace": [
    {
      "stage": "embedding",
      "status": "completed",
      "durationMs": 120,
      "details": {
        "dimensions": 1536,
        "inputCount": 1,
        "queryCharacters": 8
      },
      "error": null
    },
    {
      "stage": "vector-search",
      "status": "completed",
      "durationMs": 80,
      "details": {
        "candidateCount": 6,
        "candidates": []
      },
      "error": null
    },
    {
      "stage": "full-text-search",
      "status": "completed",
      "durationMs": 35,
      "details": {
        "candidateCount": 4
      },
      "error": null
    },
    {
      "stage": "fusion",
      "status": "completed",
      "durationMs": 2,
      "details": {
        "algorithm": "rrf",
        "vectorCandidateCount": 6,
        "fullTextCandidateCount": 4,
        "outputCount": 6
      },
      "error": null
    },
    {
      "stage": "rerank",
      "status": "skipped",
      "durationMs": 0,
      "details": {
        "enabled": false
      },
      "error": null
    },
    {
      "stage": "llm",
      "status": "completed",
      "durationMs": 1800,
      "details": {
        "inputChars": 1800,
        "outputChars": 160,
        "streaming": false,
        "ttftMs": null
      },
      "error": null
    }
  ]
}

调试页面​

  • 增加debug页面