Kubernetes in the Datacenter: Squarespace’s Journey Towards Self-Service Infrastructure

on YouTube ↗37m

" summary

Squarespace migrates hundreds of VMs into Kubernetes using Calico BGP on a leaf‑spine L3 fabric to announce pod and service IPs, replaces Graphite+Sensu with per‑team Prometheus operator instances and a central AlertManager, and uses Ceph RBD and CephFS via Kubernetes storageclasses for persistent storage. Java services hit garbage‑collector and thread‑count failures on 64‑core nodes, fixed by a base container that reads cgroup quotas and an LD_PRELOAD shim to override available processors, enabling rapid self‑service deployments and ~20 new services planned.

AI-written summary · about

" chapters (42)

1. 0:00Introduction
2. 0:24Background on Squarespace
3. 1:05Squarespace in 2013
4. 1:37Squarespace in 2014
5. 2:21Squarespace in 2016
6. 2:48Manual provisioning workflow
7. 3:58Microservices do not mix
8. 4:42Selfservice infrastructure
9. 5:09Kubernetes
10. 5:32Service Definitions
11. 7:46CPU Limit
12. 9:07Stress Testing
13. 9:56Java Libraries
14. 10:36Base Java Container
15. 11:13C Shared Library
16. 11:52SelfService Compute
17. 12:08Java Service Configuration
18. 12:53calico
19. 13:58topology
20. 16:19Pod IPs
21. 17:42SelfService Networking
22. 18:26Federation
23. 18:52Prometheus
24. 21:37Prometheus and Kubernetes
25. 22:38Prometheus Operator
26. 23:27Prometheus Alert Manager
27. 23:47Prometheus Alerts
28. 24:20SelfService Storage
29. 25:34SEF
30. 26:17Automatic Provisioners
31. 26:47RBD Provisionary
32. 27:29Purpose Persistent Volume
33. 28:00NFS Shared Storage
34. 28:52Benefits
35. 30:09Databases
36. 30:39Prometheus Cluster
37. 31:05New Services
38. 32:27Redundancy
39. 33:10Configuration
40. 33:53Performance
41. 34:37Memory
42. 35:26Maces

" related talks

• 35mKubernetes journeySébastien Lecocq, Geoffrey Thery · DevOps D-DAY 2019
• 38mBuilding the Perfect Infrastructure with KubernetesDmytro Nemesh · Highload fwdays'18
• 36mOptimizing Resource Usage in KubernetesCarlos Sanchez · Voxxed Days Ticino 2025
• 41mKubernetes the Very Hard WayLaurent Bernaille · LISA19
• 32mRunning Kubernetes in a Manufacturing Line – What Could Possibly...Mario Fahlandt, Tobias Schneck · KubeCon + CloudNativeCon Europe 2022
• 17mOur Journey to Kubernetes at ScaleMichael Vogeler, Tobias Schipka · ContainerDays 2022
• 40mOperating a Self-Healing Bare-Metal Kubernetes Platform at Global ScaleAparna Prabhu, Nikhil Pathak · Open Source Summit India 2026
• 29mA history of GOV.UK's infrastructure: the long voyage to KubernetesRichard Towers · DevOpsDays London 2023