All pull requests

Pull requests

• feat(router): add AgentHints, ProgramAffinity plugin and SessionCachePinning manager

  size/XXL
  #1874·Asthenia0412 opened Oct 15, 2026·

  ·
  3

• kvcache-aware: stream memory-mode KV events over a router-initiated connection

  kind/enhancementsize/XXL
  #1867·YaoZengzeng opened Oct 10, 2026Member·

  ·
  36

• Support model express bootstrap acceleration

  kind/enhancementsize/XXL
  #1862·hzxuzhonghu opened Oct 9, 2026Member·

  ·
  12

• router: wake queues holding requests after each metrics scrape

  kind/bugsize/L
  #1853·btxu-db opened Oct 3, 2026Contributor·

  ·
  2

  8

• fix(router): wake session boost queue on backend updates

  kind/bugsize/XXL
  #1852·Piyush-13090 opened Oct 2, 2026·

  ·
  1

  5

• test: add KV-cache runtime E2E fixture

  kind/enhancementsize/L
  #1851·avinxshKD opened Oct 2, 2026Member·

  ·
  37

• Added proposal to support model express startup accelerate

  kind/enhancementsize/XL
  #1849·hzxuzhonghu opened Sep 30, 2026Member·

  ·
  51

  

• router: decrement on-flight count on the PodInfo counted at dispatch

  kind/bugsize/L
  #1837·btxu-db opened Sep 29, 2026Contributor·

  ·
  1

  5

• feat(router): enable lora-affinity filter plugin

  kind/enhancementsize/XS
  #1836·Psykii22 opened Sep 28, 2026·

  ·
  1

  7

• Proposal: Support In-Place Rolling Update

  kind/documentationsize/XL
  #1829·kube-gopher opened Sep 25, 2026Member·

  ·
  16

• router: bound the path and upstream_model metric labels

  kind/bugsize/XL
  #1821·bolubo opened Sep 24, 2026·

  ·
  4

• controller: exit on unexpected leader election loss

  kind/bugsize/M
  #1820·pujitha24 opened Sep 23, 2026Contributor·

  ·
  13

  

• controller: exit process on leader election loss

  kind/bugsize/M
  #1814·AdeshDeshmukh opened Sep 22, 2026Contributor·

  ·
  1

  3

• docs: add the OpenAI-compatible batch API proposal

  kind/documentationsize/XL
  #1812·aeron-gh opened Sep 22, 2026Contributor·

  ·
  50

• feat(model-serving): lossless upgrade for ModelServing rolling updates

  kind/featuresize/XXL
  #1807·chenhuiluo opened Sep 22, 2026Contributor·

  ·
  1

  14

• feat: make ModelServing Role names immutable

  kind/enhancementsize/L
  #1805·haoeeeee opened Sep 22, 2026·

  ·
  1

  2

• feat: manage headless services through ModelServing plugin hooks

  kind/featuresize/XXL
  #1801·VanderChen opened Sep 22, 2026Member·

  ·
  1

  8

• feat: support per-pod ports for host-network workloads

  kind/featuresize/XXL
  #1800·VanderChen opened Sep 22, 2026Member·

  ·
  13

• fix(modelserving): preserve semantic revisions across upgrades

  kind/bugsize/XXL
  #1799·VanderChen opened Sep 21, 2026Member·

  ·
  1

  3

• fix: preserve Role configuration in outdated ServingGroups

  kind/bugsize/L
  #1796·haoeeeee opened Sep 21, 2026·

  ·
  1

  1

• autoscaler: reject minReplicas greater than maxReplicas for homogeneo…

  kind/bugsize/M
  #1794·AdeshDeshmukh opened Sep 20, 2026Contributor·

  ·
  1

  9

• docs: propose same-user FIFO enforcement in the fairness queue

  kind/documentationsize/L
  #1791·bolubo opened Sep 20, 2026·

  ·
  5

• router: read every engine's vLLM metrics series

  kind/bugsize/L
  #1782·omlahore opened Sep 16, 2026Contributor·

  ·
  10

  

• examples,docs: advertise pod IP as NIXL side-channel host

  do-not-merge/contains-merge-commitskind/bugsize/L
  #1781·chethanuk opened Sep 16, 2026·

  ·
  1

  5

• feat: add Chinese language support to website

  kind/documentationkind/enhancementsize/XXL
  #1774·kube-gopher opened Sep 15, 2026Member·

  ·
  12