Skip to main content

Toolbox Highlights from PlatformCon 2024: Tools and Techniques to Amplify Platform Engineering

· 11 min read
Victor Ikeme
Victor Ikeme
Platform Engineer | Kubernetes | Cloud-Native Advocate | OSS | Technical Writer

PlatformCon 2024's "Toolbox" track showcased a powerful array of tools and techniques designed to elevate platform engineering practices. From Kubernetes orchestration to GitOps pipelines and cloud-native observability, these sessions equipped attendees with the latest innovations and best practices.

Essential Tools and Techniques for Platform Engineering Success​

1. Streamlining Local-Remote Development with Score:

Ben Meier & Susanne Tünker (Humanitec) highlighted Score, an open-source workload specification tool that minimizes inconsistencies between local development and production environments, ensuring smoother transitions and reliable configurations.

2. Enhancing Observability with OpenTelemetry:

Mirko Novakovic (Dash0) demonstrated how OpenTelemetry (OTel) empowers engineers to leverage rich observational data to improve platform reliability and monitor performance effectively.

3. Creating On-Demand Pull Request Environments:

Kurt Madel (Loft Labs) showcased the creation of ephemeral pull request environments using Crossplane, Argo CD, and vCluster for efficient Kubernetes testing.

4. Optimizing S3 Storage Costs with S3DMap:

Dor Azouri (Pointfive) introduced S3DMap, a visualization tool providing insights into cost-effective data management strategies through interactive prefix and class mapping in S3.

5. Managing Multi-Tenant Kubernetes Clusters Effectively:

Lukas Gentele (Loft Labs) provided a practical guide for managing multi-tenant Kubernetes clusters, emphasizing maintaining tenant autonomy while ensuring robust isolation.

6. Accelerating Cloud-Native Development with Coder:

Tim Quinlan (Coder) presented Coder, a self-hosted development environment supporting various architectures for secure and scalable cloud-native development.

7. Building a Developer-Friendly Platform for Secure and Efficient Application Infrastructure:

David Ben Shabat (Quali) explained how Quali's platform enhances developer experience by streamlining infrastructure management while enforcing compliance and governance.

8. Automating Multi-Stage Deployments with Kargo (GitOps):

Jesse Suen & Kent Rancourt (Akuity) demonstrated Kargo, a GitOps solution that automates Kubernetes deployments across multiple stages, simplifying complex CI/CD configurations.

9. Improving Platform Team Efficiency with CDKTF:

Jean Burellier (Sanofi) explored how the Cloud Development Kit for Terraform (CDKTF) streamlines platform deployments, reducing development time and improving team efficiency.

10. Embracing GitOps at Scale: The Spotify Approach:

Tim Hansen (Spotify) shared Spotify's comprehensive GitOps strategy, managing infrastructure, building services, and monitoring deployments seamlessly within the Git ecosystem.

11. Streamlining Kubernetes Package Management with Yoke:

David Desmarais-Michaud (Nesto) addressed challenges in Kubernetes package management, introducing Yoke as an IaC solution that moves beyond text-based templating for streamlined Kubernetes deployments.

12. Platform Orchestrators: Addressing the Missing Middle:

Daniel Bryant discussed the crucial role of platform orchestrators in filling gaps within IDPs, weighing the pros and cons of building versus buying orchestration solutions.

13. Enhancing Security: Granular Secret Distribution with HashiCorp Vault:

Hila Fish demonstrated how HashiCorp Vault enables secure secret management and selective distribution for improved security and resource segregation.

14. Building Scalable Deep Learning Pipelines on AWS:

Rustem Feyzkhanov (Instrumental Inc.) detailed the creation of serverless deep learning pipelines on AWS, using services like Batch, Fargate, Lambda, and Step Functions for efficient, scalable model deployment.

15. Optimizing Microservice Environments with DynamicEnv:

Nissan Itzhakov (Riskified) introduced DynamicEnv, an open-source tool for creating cost-effective microservice testing environments that optimize setup processes.

16. Scaling GitHub Self-Hosted Runners on Kubernetes with ARC:

Karan Thakur (Moss) showcased the Actions Runner Controller (ARC) for deploying self-hosted GitHub runners on Kubernetes, enhancing CI/CD scalability.

17. Elevating DevEx: Building a Custom In-House CLI:

Kevin Beaulieu (Start DevX) highlighted the benefits of creating custom CLIs to streamline tool setup, automate configurations, and boost developer experience (DevEx).

18. Securing CI/CD Pipelines with Docker Scout:

Prabesh Thapa (Capsule) discussed Docker Scout, a DevSecOps solution for securing the software supply chain by integrating security within CI/CD pipelines.

19. Building Scalable IDPs with Kubernetes Operators:

George Hantzaras & Dan McKean (MongoDB) explored how Kubernetes operators empower platform teams to extend Kubernetes capabilities and create flexible, scalable IDPs.

20. Accelerating Testing: Component Testing with Playwright:

Sandeep Kapalawai (Maersk) showcased Playwright, a fast and reliable tool for cross-platform component testing to validate application quality and stability.

21. Detecting and Mitigating Abusive Behavior in Platforms:

Vijay Murganoor (Meta) detailed techniques for identifying malicious behavior in platforms, leveraging automation and analytics to proactively mitigate abuse.

22. Simplifying Developer Interactions with Kubernetes Operators:

Tom De Wolf (ACA Group) explained how Kubernetes operators and custom resources simplify interactions with platforms, increasing developer productivity.

23. Streamlining Infrastructure Management with KubeVela and Crossplane:

Tiago Reichert & Guilherme Greco (AWS) showcased KubeVela and Crossplane, which streamline infrastructure management using an Open Application Model (OAM) approach.

24. Revolutionizing Terraform Testing with Version 1.6:

Dharani Sowndharya (ThoughtWorks) demonstrated Terraform's new testing framework for validating real-world infrastructure.

25. Simplifying Integrations with Crossplane:

Aditya Soni & Seema Saharan (CNCF Ambassadors) guided attendees through setting up Crossplane, simplifying integrations with major cloud providers for platform engineering projects.

26. Preventing Outages: Anti-Disaster Pod Scheduling in Kubernetes:

Gil Bahat (Qubex.AI) detailed how Kubernetes scheduling options can prevent service outages, supporting Site Reliability Engineering (SRE) goals.

27. Enhancing Backstage Portals with Kratix:

Derik Evangelista discussed how Kratix enhances Backstage portals by adding resilience and seamless integration for developer platforms.

28. The Advantages of Data on Kubernetes:

Eric Shanks (Portworx) argued for hosting data on Kubernetes to improve data mobility and accessibility in multi-cloud environments.

29. Managing Multi-Cluster Kubernetes in IDPs:

Nick Eberts (Google) addressed the complexities of multi-cluster management in IDPs, emphasizing scalability and flexibility.

30. Driving 10x Developer Productivity with Self-Service Tools:

Burr Sutter (Red Hat) demonstrated how self-service tools in platform engineering enable developers to focus on innovation rather than platform complexities.

31. Building Scalable APIs with Supergraph(QL) and IaC:

Eric Belisle (Hasura) highlighted the power of GraphQL and IaC for creating scalable and efficient data APIs.

32. Optimizing DevEx with Dapr and Score:

Mathieu Benoit (Humanitec) demonstrated the synergy between Dapr and Score for a streamlined developer workflow, enhancing DevEx for containerized workloads.

PlatformCon 2024's "Toolbox" track provided a comprehensive overview of the tools and techniques driving innovation in platform engineering. These sessions equipped attendees with the practical knowledge and insights needed to build more efficient, reliable, and scalable platforms.

Toolbox Highlights from PlatformCon 2024: Tools and Techniques to Amplify Platform Engineering

The Toolbox track at PlatformCon 2024 presented a rich array of tools and methodologies designed to enhance platform engineering, streamline developer workflows, and boost productivity. From Kubernetes orchestration to GitOps pipelines and cloud-native observability, these sessions equipped platform engineers with the latest in toolsets and best practices. Here’s a look at the essential highlights and innovations shared in the Toolbox sessions.

Toolbox Sessions: Key Takeaways and Strategies​

  1. Bridging the Gap Between Local and Remote Environments in Your Platform

    • Speakers: Ben Meier & Susanne Tünker, Humanitec
    • Description: This session explored Score, an open-source workload specification, as a solution for minimizing inconsistencies between local and production environments, enabling smoother transitions and reliable configurations.

  2. OpenTelemetry Native Observability

    • Speaker: Mirko Novakovic, Dash0
    • Description: Novakovic demonstrated how OpenTelemetry (OTel) enhances observability, helping engineers leverage OTel signals to improve platform reliability and monitor performance.

  3. Ephemeral Pull Request Environments with Crossplane, Argo CD, and vCluster.Pro

    • Speaker: Kurt Madel, Loft Labs
    • Description: Madel showcased how to create on-demand pull request environments using Crossplane, Argo CD, and vCluster for quick, efficient testing in Kubernetes environments.

  4. S3DMap: A Visual Storage Map for Prefix-Level Cost Optimization

    • Speaker: Dor Azouri, Pointfive
    • Description: Azouri introduced S3DMap, a tool for visualizing S3 storage, providing insight into cost-effective data management strategies through interactive prefix and class mapping.

  5. Tenant Autonomy & Isolation in Multi-Tenant Kubernetes Clusters

    • Speaker: Lukas Gentele, Loft Labs
    • Description: Gentele offered a practical guide on managing multi-tenant Kubernetes clusters, focusing on maintaining tenant autonomy while ensuring robust isolation.

  6. Accelerate Cloud-Native Development with Coder

    • Speaker: Tim Quinlan, Coder
    • Description: Quinlan presented Coder, a self-hosted development environment that supports a range of architectures, ideal for secure, scalable cloud-native development.

  7. Creating a Dev-Friendly Platform to Run Application Infrastructure Securely & Efficiently

    • Speaker: David Ben Shabat, Quali
    • Description: Ben Shabat explained how Quali’s platform improves developer experience by streamlining infrastructure while enforcing compliance and governance at scale.

  8. Kargo - Multi-Stage Deployment Pipelines Using GitOps

    • Speakers: Jesse Suen & Kent Rancourt, Akuity
    • Description: This session demonstrated Kargo as a GitOps solution that enhances Kubernetes delivery by automating stage-to-stage deployment pipelines, reducing the need for complex CI/CD configurations.

  9. Harnessing the Power of CDKTF for Platform Team Efficiency

    • Speaker: Jean Burellier, Sanofi
    • Description: Burellier explored how the Cloud Development Kit for Terraform (CDKTF) simplifies platform deployments, reducing development time and enhancing team efficiency.

  10. Everything is Code: Embracing GitOps at Spotify

    • Speaker: Tim Hansen, Spotify
    • Description: Hansen shared how Spotify uses GitOps to manage infrastructure, build services, and monitor deployments, seamlessly integrating operations within the Git ecosystem.

  11. Yoke: An Exploration into Infrastructure as Code for Kubernetes Package Management

    • Speaker: David Desmarais-Michaud, Nesto
    • Description: This session addressed the challenges of Kubernetes package management, introducing Yoke as a solution to streamline IaC for Kubernetes, moving beyond text-based templating.

  12. Platform Orchestrators: The Missing Middle of Internal Developer Platforms?

    • Speaker: Daniel Bryant
    • Description: Bryant discussed the role of Platform Orchestrators in filling the gap in IDPs, weighing the pros and cons of building versus buying orchestration solutions.

  13. Extension Unlocked: Granular Secret Distribution with HashiCorp Vault

    • Speaker: Hila Fish
    • Description: Fish demonstrated secure methods for managing secrets with HashiCorp Vault, emphasizing selective distribution for improved security and resource segregation.

  14. Building Scalable End-to-End Deep Learning Pipelines in the Cloud

    • Speaker: Rustem Feyzkhanov, Instrumental Inc.
    • Description: Feyzkhanov explained the serverless deep learning pipeline on AWS, utilizing Batch, Fargate, Lambda, and Step Functions for efficient, scalable model deployment.

  15. DynamicEnv: Streamlining Microservice Environments for Cost-Effectiveness

    • Speaker: Nissan Itzhakov, Riskified
    • Description: Itzhakov introduced DynamicEnv, an open-source tool for creating cost-effective microservice testing environments that optimize setup processes.

  16. Deploying GitHub Self-Hosted Runners on Kubernetes with ARC

    • Speaker: Karan Thakur, Moss
    • Description: Thakur showcased Actions Runner Controller (ARC) for deploying self-hosted GitHub runners on Kubernetes, providing scalability for CI/CD workflows.

  17. Revolutionize Your Developer Experience with an In-House CLI

    • Speaker: Kevin Beaulieu, Start DevX
    • Description: Beaulieu emphasized the benefits of creating a custom CLI to streamline tool setup, automate configurations, and enhance developer experience (DevEx).

  18. Securing CI/CD Pipeline with Docker Scout

    • Speaker: Prabesh Thapa, Capsule
    • Description: Thapa discussed Docker Scout as a DevSecOps solution to secure the software supply chain, focusing on integrating security within CI/CD pipelines.

  19. Building Internal Developer Platforms with Kubernetes Operators

    • Speakers: George Hantzaras & Dan McKean, MongoDB
    • Description: This session explored how Kubernetes operators empower platform teams, extending Kubernetes capabilities to create scalable, flexible IDPs.

  20. Component Testing with Playwright

    • Speaker: Sandeep Kapalawai, Maersk
    • Description: Kapalawai showcased Playwright as a fast, reliable tool for cross-platform component testing, ideal for validating app quality and stability.

  21. Safeguarding Platforms: Detecting Abusive Behavior Patterns

    • Speaker: Vijay Murganoor, Meta
    • Description: Murganoor detailed techniques for identifying malicious behavior in platforms, leveraging automation and analytics to mitigate abuse.

  22. Raise the Level of Abstraction: Engineering a Platform Using Kubernetes Operators

    • Speaker: Tom De Wolf, ACA Group
    • Description: De Wolf explained how Kubernetes operators and custom resources can simplify developer interactions with platforms, enhancing productivity.

  23. Empowering Platform Engineering with KubeVela and Crossplane

    • Speakers: Tiago Reichert & Guilherme Greco, AWS
    • Description: This session showcased KubeVela and Crossplane as tools for streamlining infrastructure management through an Open Application Model (OAM) approach.

  24. Terraform Testing Revolution with Version 1.6

    • Speaker: Dharani Sowndharya, ThoughtWorks
    • Description: Sowndharya demonstrated Terraform’s new testing framework, emphasizing its capacity for real-world infrastructure validation.

  25. Embark on Your Platform Engineering Adventure with Crossplane

    • Speakers: Aditya Soni & Seema Saharan, CNCF Ambassadors
    • Description: Soni and Saharan guided participants through setting up Crossplane, simplifying integrations with major cloud providers for platform engineering projects.

  26. Let Pod Sort Them Out! Anti-Disaster Pod Scheduling Explained

    • Speaker: Gil Bahat, Qubex.AI
    • Description: Bahat detailed how Kubernetes scheduling options can prevent service outages, crucial for achieving Site Reliability Engineering (SRE) goals.

  27. Your Backstage Needs a Platform

    • Speaker: Derik Evangelista
    • Description: Evangelista discussed how Kratix enhances Backstage portals by adding resilience and seamless integration for developer platforms.

  28. Why Data on Kubernetes?

    • Speaker: Eric Shanks, Portworx
    • Description: Shanks argued for hosting data on Kubernetes to overcome friction in multi-cloud environments, supporting improved data mobility and accessibility.

  29. Multi-Cluster Kubernetes: Core to Your Internal Developer Platform

    • Speaker: Nick Eberts, Google
    • Description: Eberts addressed the challenges of multi-cluster management in IDPs, emphasizing scalability and flexibility across diverse clusters.

  30. Platform Engineering as the Catalyst for 10x Developer Productivity

    • Speaker: Burr Sutter, Red Hat
    • Description: Sutter showed how self-service tools drive productivity, enabling developers to focus on innovation rather than platform complexities.

  31. Supergraph(QL): Scalable API Strategy for Your Data Using GraphQL

    • Speaker: Eric Belisle, Hasura
    • Description: Belisle highlighted the potential of GraphQL and IaC in creating scalable, efficient data APIs that enhance developer workflow.

  32. Dapr + Score: Crafting and Improving Your Developer Experience

    • Speaker: Mathieu Benoit, Humanitec
    • Description: Benoit demonstrated the synergy between Dapr and Score for a comprehensive developer workflow, enhancing DevEx with containerized workloads.

The Toolbox sessions at PlatformCon 2024