yaojun

The Future of AI Inference

Posted on 2026-03-14 Edited on 2026-06-30 In llm

Introduction

This is a summary of a recent video from NVIDIA’s Dynamo Day in January, covering two main topics: PD-disaggregated inference in 2025 and the future trends of AI inference in 2026.