home
  • Notes
  • Software
  • Talks
  • Guestbook

Kubernetes

Kubernetes is an open-source container orchestration platform that automates the deployment, scaling, and management of containerized applications.


Me
Published on Sun, Apr 30, 2023
Last modified on Wed, Sep 2, 2026
56 words - Page Source

Presentations

CSI Windows

PV/PVC controller

Debugging K8s e2e tests with delve

Playground

As I started to contribute to Kubernetes, I created a few environments for easier development.

Please check it out for examples of the following:

  • Running a client-go application through skaffold
  • Running the kube controller manager in debug mode
  • Running the kubelet in debug mode
#system design #distributed systems #container orchestration #scaling #user namespace
search Search Notes (⌘K)

Related Articles

  • Benchmarking & Capacity Planning for Systems Engineers
    A systems engineering guide to load testing and capacity planning: applying the problem statement method, characterizing production workloads, eliminating Coordinated Omission, choosing between open and closed loops, and sizing infrastructure with Little’s Law.
  • Queuing Theory for Systems Engineers
    A practical, example-first guide to queuing theory in systems engineering: single-server M/M/1 response time and the 50% load paradox, the hockey stick latency curve, Pollaczek-Khinchine service variance, multi-server resource pooling (M/M/c), and capacity planning rules of thumb with interactive visualizers.
  • Kafka

    Kafka is a distributed event streaming platform designed for building high-throughput, fault-tolerant, and scalable data streaming applications.


    This article covers key designs in Kafka, such as how messages for a topic are shared into partitions assigned to brokers. Then, we see some guarantees about producers, consumers, and consumer groups.
  • Cassandra

    Cassandra is a highly scalable, distributed NoSQL (non-relational) database management system designed for handling large amounts of data across multiple commodity servers.


    This article covers key design features of Cassandra, such as the usage of consistent hashing, the write pattern to a write-ahead log and a memtable, the read pattern from the memtable and from SSTables, and, most importantly, some examples of data modeling for different types of queries.
  • Optimizing the LLM Inference Stack
    An end-to-end framework for optimizing LLM inference: map hardware, kernels, host execution, runtimes, and orchestration, define service demand, rank bottlenecks with capacity and queueing, and choose experiments that improve goodput. Includes case studies from Makora and Baseten.

Recent Notes

  • Optimizing the LLM Inference Stack
    An end-to-end framework for optimizing LLM inference: map hardware, kernels, host execution, runtimes, and orchestration, define service demand, rank bottlenecks with capacity and queueing, and choose experiments that improve goodput. Includes case studies from Makora and Baseten.
  • The Pareto Frontier in LLM Inference Serving
    Why a single performance number tells only part of the story in LLM serving, and when you need the whole Pareto frontier instead. Covers the limits of scalarization on concave trade-offs, how Optuna and Google Vizier actually store trial values (the frontier is derived, not persisted), and how production tools like Prism, InferenceBench, and NVIDIA Dynamo present the frontier as the reportable artifact.
  • Benchmarking & Capacity Planning for Systems Engineers
    A systems engineering guide to load testing and capacity planning: applying the problem statement method, characterizing production workloads, eliminating Coordinated Omission, choosing between open and closed loops, and sizing infrastructure with Little’s Law.
  • Queuing Theory for Systems Engineers
    A practical, example-first guide to queuing theory in systems engineering: single-server M/M/1 response time and the 50% load paradox, the hockey stick latency curve, Pollaczek-Khinchine service variance, multi-server resource pooling (M/M/c), and capacity planning rules of thumb with interactive visualizers.
  • Performance Fundamentals
    Core concepts in systems performance engineering: formalizing latency, throughput, and resource utilization, Little’s Law, and analyzing multi-worker queue dynamics and diurnal traffic cycles with interactive simulators.
Browse all notes →
Plane by antonmoek - CC BY 4.0 Fullscreen experience Thank you for your visit, please sign the guestbook.