cluster.ninja

Kubernetes minor release · “Planternetes”

Kubernetes 1.28

This release lets nodes run up to three minor versions behind the control plane, so node upgrades can happen once a year. It also made non-graceful node shutdown stable and added alpha native sidecar containers.

End of life

End of life since 22 Oct 2024 (2.0 years ago). No more patches upstream.

Released15 Aug 2023
Maintenance mode—
End of life22 Oct 2024
Latest patch1.28.1523 Oct 2024
Patch releases15
Support span14.3 months

What 1.28 brought

change

Node/control-plane skew widened to n-3

kubelet and kube-proxy may now lag the control plane by three minor versions instead of two, letting operators upgrade nodes only once a year.

GA

Non-graceful node shutdown recovery

When a node dies unexpectedly, you can mark it so stateful pods and their volume attachments move to a healthy node instead of hanging in Terminating.

alpha

Native sidecar containers

Init containers with restartPolicy: Always act as sidecars: they start before app containers, keep running, and do not block pod completion.

beta

ValidatingAdmissionPolicy

CEL-based in-process admission policies move to beta; enable the admissionregistration.k8s.io/v1beta1 API and the feature gate to use them.

beta

Swap on Linux nodes

Swap can be enabled on Linux nodes in a controlled, predictable way.

GA

Retroactive default StorageClass

PVCs without a storageClassName, including existing ones, automatically get the cluster's default StorageClass.

Summarised in our own words from the official “Kubernetes v1.28: Planternetes” announcement (45 tracked enhancements), © The Kubernetes Authors, CC BY 4.0.

APIs that stopped being served in 1.28

No API versions were removed in 1.28.

Other removals and deprecations

Removed

  • The release removed CSI migration for GCE Persistent Disk (KEP-1488).

Deprecated

  • The in-tree Ceph RBD volume plugin was deprecated.
  • The in-tree CephFS volume plugin was deprecated.

From the release announcement; our wording.

Stable (GA) API kinds new in 1.28

SelfSubjectReview authentication.k8s.io/v1

Upgrading

Version skew with a 1.28 API server

  • kubelet, kube-proxy: 1.25 to 1.28
  • kube-controller-manager, scheduler: 1.27 to 1.28
  • kubectl: 1.27 to 1.29

From the official version skew policy as it stands today.

One minor at a time

The API server must not skip minor versions.

Patch releases

16 releases, newest first
  1. 1.28.1523 Oct 2024
  2. 1.28.1411 Sep 2024
  3. 1.28.1315 Aug 2024
  4. 1.28.1217 Jul 2024
  5. 1.28.1111 Jun 2024
  6. 1.28.1014 May 2024
  7. 1.28.916 Apr 2024
  8. 1.28.815 Mar 2024
  9. 1.28.714 Feb 2024
  10. 1.28.617 Jan 2024
  11. 1.28.520 Dec 2023
  12. 1.28.415 Nov 2023
  13. 1.28.318 Oct 2023
  14. 1.28.213 Sep 2023
  15. 1.28.124 Aug 2023
  16. 1.28.015 Aug 2023