Learning Objectives

  • Use LLM Observability dashboards to spot patterns across traces
  • Navigate from dashboard widgets to relevant traces to find root causes of issues
  • Identify issues and failures in multi-step LLM pipelines
  • Construct effective trace queries using advanced filtering techniques
  • Clone and customize dashboards with relevant investigation widgets

Primary Audience

This course is designed for engineers who want hands-on practice investigating issues in AI applications. Software developers, AI engineers, and DevOps teams who work with LLM-powered systems will benefit from this course.

Prerequisites

Recommended:


This course assumes familiarity with the following:

  • LLM Observability traces and trace explorer
  • LLM spans and span kinds
  • Flame graphs and span list views
  • LLM Observability instrumentation

Technical Requirements

In order to complete the course, you will need the following:

- Chrome or Firefox

- Third-party cookies must be enabled to access labs

Course Navigation

At the bottom of each lesson, click MARK LESSON COMPLETE AND CONTINUE button so that you are marked complete for each lesson and can receive the certificate at the end of the course.

Course Enrollment Period

Please note that your enrollment in this course ends after 30 days. You can re-enroll at any time and pick up where you left off.

Course curriculum

    1. You're Ready to Investigate with LLM Observability

    1. LLM Observability Dashboards

    2. Lab: LLM Observability Metrics and Traces

    1. Summary

    2. Feedback Survey

Investigate with LLM Observability

  • 1 hours to complete
  • Beginner