Tutorials ASP.NET Core with Agentic AI Tutorial
AI Observability — Complete Guide
AI Observability — Complete Guide: free step-by-step lesson with examples, common mistakes, and interview tips — part of ASP.NET Core with Agentic AI Tutorial on Toolliyo Academy.
On this page
ASP.NET Core with Agentic AI Tutorial · Lesson 68 of 100
AI Observability
AI basics ✓ → Agents
Agents · 2 — Build · ~10 min · Module 7: Cloud-Native AI and DevOps
What is this?
AI observability unifies metrics, logs, traces, and eval scores for agent systems. AgentNest exports OpenTelemetry to Azure Monitor with dashboards for tokens, tool errors, and RAG hit rate.
Why should you care?
Without observability, CRM copilot degradation shows up only as angry tickets — not as actionable spans.
See it live — copy this example
Paste into an ASP.NET Core 8+ / AgentNest project, then run with dotnet run (set your API keys in user-secrets).
// Program.cs OpenTelemetry
builder.Services.AddOpenTelemetry()
.WithTracing(t => t.AddSource("AgentNest.Agents").AddAspNetCoreInstrumentation())
.WithMetrics(m => m.AddMeter("AgentNest.Ai").AddRuntimeInstrumentation())
.UseAzureMonitor();
What happened?
- OpenTelemetry registers AgentNest agent ActivitySource and custom meter, exporting traces and metrics to Azure Monitor.
- Follow the steps below — typing the code yourself is the fastest way to learn.
Practice next
- Instrument agents with ActivitySource and Meter("AgentNest.Ai").
- Create workbook: p95 latency, tokens/min, tool error rate.
- Correlate App Insights traces with AiAudit rows via operation_Id.
- Add custom metric rag.hit_rate from RagPipeline.
- Export same telemetry to Grafana for hybrid cloud tenants.
Remember
OpenTelemetry traces and metrics feed Azure Monitor. Dashboard tokens, tools, RAG, and HTTP together. Link traces to audit records for incident response.
Incident postmortem
ERP agent tool errors spike after plugin deploy.
Outcome: Trace view shows gl.fetch_balance failures; rollback pinpoints bad plugin version.
Interview prep for this lesson
Practice these questions aloud after reading—each links to a full structured answer.
Sign in to ask a question or upvote helpful answers.
No questions yet — be the first to ask!