Platform Engineering Monthly — September 2025
Welcome to the twenty-second edition of Platform Engineering Monthly! Suggestions or ideas for the next edition? Let me know!
📰 News
How we made ClickHouse log queries 99.5% faster with resource fingerprinting — Leveraging resource fingerprints, so blocks can be skipped more aggressively.
🔗https://signoz.io/blog/query-performance-improvement/Will Amazon S3 Vectors Kill Vector Databases — or Save Them? — S3 have added vector DBs, which is a pretty significant feature, with folks asking if this will resplace vector DBs or force them to be tiered caches.
🔗https://zilliz.com/blog/will-amazon-s3-vectors-kill-vector-databases-or-save-themDocker Desktop bug let containers hop the fence with ease — PSA a critical bug in docker allowed containers to talk to Docker’s Engine API, without auth, enabling host-level access. Containers by themselves aren’t always the isolated environment they claim to be.
🔗https://www.theregister.com/2025/08/26/docker_desktop_bug/s1ngularity: supply chain attack leaks secrets on GitHub — The attack compromised GitHub tokens & NPM creds, injected malicious versions of the Nix package, leaked secrets and ran malware on dev machines/CI pipelines. 🔗https://www.wiz.io/blog/s1ngularity-supply-chain-attack
AWS services scale to new heights for Prime Day 2025: key metrics and milestones — Always an interesting read to see how Amazon has handled the scale.
🔗https://aws.amazon.com/blogs/aws/aws-services-scale-to-new-heights-for-prime-day-2025-key-metrics-and-milestones/Atlassian + DX: Engineering Intelligence for the AI Era — In an interesting move, Atlassian has purchased DX, it might be a good fit but might just give managers more charts.
🔗 https://www.theregister.com/2025/09/18/atlassian_dx_purchase/Kubernetes Finally Solves Its Biggest Problem: Managing Databases — K8s is making progress on better handling stateful systems as first-class citizens.
🔗https://thenewstack.io/kubernetes-finally-solves-its-biggest-problem-managing-databases/
🦮 Tutorials / How-tos
Hierarchical Federation in Prometheus: Managing Millions of Metrics Cleanly — Lower level Prometheus is for detailed metrics and higher level aggregate servers pull summaries to help scale Prometheus.
🔗https://kapillamba4.medium.com/hierarchical-federation-in-prometheus-managing-millions-of-metrics-cleanly-8d8bac940ff3GitHub Actions: A Cloudy Day for Security – Part 1 (Securing GH Actions) — Considering the recent supply chain attacks focusing on dev machines and CI pipelines, it’s prudent to focus on securing Github Actions and CI Pipelines in general.
🔗 https://binarysecurity.no/posts/2025/08/securing-gh-actions-part1How I Learned System Design — Going from overwhelmed to mastery, by breaking topics down and practising real-world problems.
🔗 https://medium.com/@himanshusingour7/how-i-learned-system-design-d7444d454367AWS Cost Optimization – Key Principles for Beginners — Practical primer on controlling AWS spending via cost allocation, tagging and rightsizing.
🔗https://awsfundamentals.com/blog/key-principles-for-cost-optimization
📁 Interesting Projects
Onedev — Open Source self-hosted Devops Platform with Git, CI/CD, issue tracking, Kanban, package registry & more!
🔗https://github.com/theonedev/onedevKubewall — Sinary-binary K8s dashboard with multi-cluster support.
🔗https://github.com/kubewall/kubewallTrailscaper — CLI tool to extract and query insights from AWS Cloudtrail.
🔗https://github.com/flosell/trailscraperGHBuster — Datadog tool to detect suspicious GitHub repositories and users using heuristics
🔗https://github.com/DataDog/ghbusterkconnect — CLI tool to discover and securely access K8s clusters across cloud environments (EKS, AWS, Rancher)
🔗https://github.com/fidelity/kconnect
📅 Events
KubeCon + CloudNativeCon North America
📅 November 10–13, 2025 | 📍 Atlanta, Georgia, USA
🔗 https://events.linuxfoundation.org/kubecon-cloudnativecon-north-america/Platform Engineering Summit (Enterprise)
📅 October 22–23, 2025 | 📍 London, UK
🔗 https://www.iqpc.com/events-platform-engineering-summitDevOpsCon New York (with Platform Engineering focus)
📅 September 29 – October 3, 2025 | 📍 New York, USA / Online
🔗 https://devopscon.io/new-york/Platform Engineering Day (co-located with KubeCon NA)
📅 November 10, 2025 | 📍 Atlanta, Georgia, USA
🔗 https://events.linuxfoundation.org/kubecon-cloudnativecon-north-america/co-located-events/platform-engineering-day
Have platform engineering tips to share? Reply to this email or connect with me on LinkedIn.