Data Engineer - Data Platform

Data Engineer - Data Platform BUILDING THE FUTURE OF CRYPTO Our Krakenites are a world-class team with crypto conviction, united by our desire to discover and unlock the potential of crypto and blockchain technology. What makes us different? Kraken is a mission-focused company rooted in crypto values. As a Krakenite, you’ll join us on our mission to accelerate the global adoption of crypto, so that everyone can achieve financial freedom and inclusion. For over a decade, Kraken’s focus on our mission and crypto ethos has attracted many of the most talented crypto experts in the world. Before you apply, please read the Kraken Culture https://www.kraken.com/culture page to learn more about our internal culture, values, and mission. We also expect candidates to familiarize themselves with the Kraken app. Learn how to create a Kraken account here https://support.kraken.com/hc/en-us/articles/226090548-How-to-create-an-account-on-Kraken. As a fully remote company, we have Krakenites in 70+ countries who speak over 50 languages. Krakenites are industry pioneers who develop premium crypto products for experienced traders, institutions, and newcomers to the space. Kraken is committed to industry-leading security https://blog.kraken.com/crypto-education/security-at-kraken, crypto education https://blog.kraken.com/category/crypto-education, and world-class client support https://blog.kraken.com/crypto-education/support-at-kraken through our products like Kraken Pro https://pro.kraken.com/, Desktop https://www.kraken.com/desktop, Wallet https://www.kraken.com/wallet, and Kraken Futures https://www.kraken.com/features/futures. Become a Krakenite and build the future of crypto! PROOF OF WORK THE TEAM Join our Data Engineering Team at Kraken! Are you passionate about designing and building scalable data systems that power one of the fastest-growing companies in cryptocurrency? We’re seeking a skilled Data Engineer to join our Data Platform team and help us architect the future of Kraken’s data ecosystem. As a Data Engineer at Kraken, you’ll be responsible for building and maintaining high-performance data pipelines, ensuring the reliability and scalability of our data infrastructure, and enabling teams across the company to access clean, consistent, and timely data. You’ll work with modern technologies and large-scale datasets, playing a key role in making data accessible for analytics, machine learning, and product innovation. THE OPPORTUNITY - Build scalable and reliable data pipelines that collect, transform, load and curate data from internal systems - Augment data platform with data pipelines from external systems. - Ensure high data quality for pipelines you build and make them auditable - Drive data systems to be as near real-time as possible - Support design and deployment of distributed data store that will be central source of truth across the organization - Build data connections to company's internal IT systems - Develop, customize, configure self service tools that help our data consumers to extract and analyze data from our massive internal data store - Evaluate new technologies and build prototypes for continuous improvements in data engineering. SKILLS YOU SHOULD HODL - 5+ years of work experience in relevant field (Data Engineer, DWH Engineer, Software Engineer, etc) - Experience with data-lake and data-warehousing technologies and relevant data modeling best practices (Presto, Athena, Glue, etc) - Proficiency in at least one of the main programming languages used: Python and Scala. Additional programming languages expertise is a big plus! - Experience building data pipelines/ETL in Airflow, and familiarity with software design principles. - Excellent SQL and data manipulation skills using common frameworks like Spark/PySpark, or similar. - Expertise in Apache Spark, or similar Big Data technologies, with a proven record of processing high volumes and velocity of datasets. - Experience with busine ... (truncated, view full listing at source)