Tutorials ASP.NET Core with Agentic AI Tutorial
AI Analytics — Complete Guide
AI Analytics — Complete Guide: free step-by-step lesson with examples, common mistakes, and interview tips — part of ASP.NET Core with Agentic AI Tutorial on Toolliyo Academy.
On this page
ASP.NET Core with Agentic AI Tutorial · Lesson 59 of 100
AI Analytics
AI basics ✓ → Agents
Agents · 2 — Build · ~10 min · Module 6: AI Security and Observability
What is this?
AI analytics measures adoption, quality, cost, and outcomes of copilot features. AgentNest tracks prompts per tenant, tool success rate, and human edit distance on CRM drafts.
Why should you care?
Product leaders justify GPU spend with usage dashboards; compliance wants proof hospital staff override unsafe suggestions.
See it live — copy this example
Paste into an ASP.NET Core 8+ / AgentNest project, then run with dotnet run (set your API keys in user-secrets).
// AgentNest.Analytics/AiUsageRecorder.cs
public sealed class AiUsageRecorder(AgentNestDbContext db)
{
public async Task RecordAsync(string tenantId, string feature, int tokens, bool thumbsUp, CancellationToken ct)
{
db.AiUsageDaily.Add(new AiUsageDaily
{
Day = DateOnly.FromDateTime(DateTime.UtcNow), TenantId = tenantId,
Feature = feature, Tokens = tokens, PositiveFeedback = thumbsUp ? 1 : 0
});
await db.SaveChangesAsync(ct);
}
}
What happened?
- AiUsageRecorder aggregates daily tokens and feedback per feature — CRM draft, hospital triage, ERP explain.
- Follow the steps below — typing the code yourself is the fastest way to learn.
Practice next
- Create AiUsageDaily table partitioned by month.
- Record usage in middleware after AI responses complete.
- Build Power BI dataset from SQL or export to Synapse.
- Add EditDistance metric comparing CRM draft to sent email.
- Alert when tenant token growth exceeds 200% week over week.
Remember
Aggregate tokens, feature, and feedback per tenant daily. Analytics inform cost allocation and quality improvements. Avoid storing raw prompt text in analytics DB.
Copilot ROI review
CFO asks which AgentNest modules justify Azure OpenAI invoice.
Outcome: AiUsageDaily shows CRM draft saves 12k tokens per rep per week with 78% positive feedback.
Interview prep for this lesson
Practice these questions aloud after reading—each links to a full structured answer.
Sign in to ask a question or upvote helpful answers.
No questions yet — be the first to ask!