Senior Data Platform Engineer

This is Adyen Adyen provides payments, data, and financial products in a single solution for customers like Meta, Uber, HM, and Microsoft - making us the financial technology platform of choice. At Adyen, everything we do is engineered for ambition. For our teams, we create an environment with opportunities for our people to succeed, backed by the culture and support to ensure they are enabled to truly own their careers. We are motivated individuals who tackle unique technical challenges at scale and solve them as a team. Together, we deliver innovative and ethical solutions that help businesses achieve their ambitions faster. Data Platform Engineer As a Data Platform Engineer , you will be responsible for managing one of the largest data platforms in the world. Your focus will be on ensuring that data, data services, and infrastructure are reliable, fault-tolerant, efficiently scalable, and cost-effective. These platforms support dozens of products, hundreds of developers, and thousands of daily jobs, reinforcing Adyen’s industry-leading capabilities. Most days are dedicated to development of new features or preparing Kubernetes clusters for our BigData platform, and giving support to all our end users that make use of our platforms.or applying releases we use a mix of planned releases and continuous deployment depending on the impact the release can have. Building new clusters and services and still ensure our end users are unblocked and our systems keep the agreed SLO uptime in shape. Beyond operations, you’ll have the opportunity to design, build, and deliver scalable systems as a Platform engineer. If you thrive on automation and reducing manual toil, you’ll play a strategic role in shaping the future of automation for our Big Data Platforms. You will collaborate with data and ML scientists and engineers to develop and roll out tools that enhance platform performance while operating and scaling multiple big data platforms. This includes managing a fleet of a few thousand nodes, tens of thousands of cores, hundreds of terabytes of RAM, and tens of petabytes of storage. This is a unique opportunity to work at scale and influence the infrastructure behind Adyen’s cutting-edge data capabilities. What you’ll do Design, develop, operate, and maintain scalable, reliable, fault-tolerant, and high-performance big data platforms. Work with distributed systems in all shapes and flavors (databases, file systems, compute, etc.). Shape and maintain continuous improvements and deployment of new clusters. Implement observability solutions (logging, monitoring, alerting) to ensure system reliability and performance. Optimize performance of large-scale distributed data platforms with appropriate cluster configurations, and resource management. Practice sustainable incident response and blameless postmortems, with a focus on automation and root cause analysis. Improve security and compliance by implementing access controls, encryption, and best practices for data governance. Design and build automation tools to reduce toil and enhance the reliability of data platforms. Self-service infrastructure to empower data teams while maintaining platform stability. Who you are Familiar with infrastructure automation and configuration management tools (e.g. Ansible, Terraform, Puppet). Strong system administrator/platform engineer background with experience in large-scale distributed systems. Experienced with infrastructure and private cloud systems (on-premise). A team player with strong communication skills, able to work closely with diverse stakeholders (analysts, data scientists, data engineers, infrastructure, and security teams). Experience developing and maintaining: Distributed data and compute systems (Hadoop, Druid, Trino, etc). Kubernetes (k8s, Docker) Hadoop ecosystems (Hive, YARN, HDFS, Kerberos). Good to have Experience as a Data Platform Engineer or Site Reliability Engineer for Data Platforms Fluency in Pyth ... (truncated, view full listing at source)