home
Notes
Projects
Speaking
dark_mode
light_mode
Multi-Objective Optimization
There's a total of 1 notes tagged with "Multi-Objective Optimization".
The Pareto Frontier in LLM Inference Serving
★ Favorite
✦ Interactive
→
Why a single performance number tells only part of the story in LLM serving, and when you need the whole Pareto frontier instead. Covers the limits of scalarization on concave trade-offs, how Optuna and Google Vizier actually store trial values (the frontier is derived, not persisted), and how production tools like Prism, InferenceBench, and NVIDIA Dynamo present the frontier as the reportable artifact.
Published on Tue, Sep 1, 2026 • 16 min read
#performance
#system design
#inference serving
#benchmarking