←Back to catalogue
Video Course3.5 HoursAdvanced

Latency Engineering for AI

How to spend a latency budget across a multi-hop AI request, and how to defend p99 when one hop misbehaves.

Level
Advanced
Length
3.5 hours
Format
Video course + load-test kit
£65.00
Buy now→Instant download · 14-day refund policy
Speed gauge with performance rings

What you'll be able to do

  • ✓Allocate a latency budget per hop
  • ✓Set timeouts and hedges that help rather than harm
  • ✓Load-test an AI path realistically

Who it's for

Engineers with a latency SLO on an AI feature.

Contents

  1. 01Measuring tail latency
  2. 02Budget allocation
  3. 03Timeouts, retries and hedging
  4. 04Load testing AI endpoints
  5. 05Capacity planning