Senior Software Engineer, Data Platform

<div class="content-intro"><h2>Build a Safer World. </h2> <p>TRM Labs provides blockchain analytics and AI solutions to help law enforcement and national security agencies, financial institutions, and cryptocurrency businesses detect, investigate, and disrupt crypto-related fraud and financial crime. TRM’s blockchain intelligence and AI platforms include solutions to trace the source and destination of funds, identify illicit activity, build cases, and construct an operating picture of threats. TRM is trusted by leading agencies and businesses worldwide who rely on TRM to enable a safer, more secure world for all.</p></div><p><span style="font-weight: 400;">The Data Platform team collaborates with an experienced group of data scientists, engineers, and product managers to build highly available and scalable data infrastructure for TRM's products and services. As a Senior Data Engineer on the Data Platform team, you will be responsible for executing mission-critical systems and data services that analyze blockchain transaction activity at petabyte scale, and ultimately work to build a safer financial system for billions of people.</span></p> <p><strong><span class="notion-enable-hover" data-token-index="0" data-reactroot="">The impact you’ll have here:</span></strong></p> <ul> <li>Build highly reliable data services to integrate with dozens of blockchains.</li> <li>Develop complex ETL pipelines that transform and process petabytes of structured and unstructured data in real-time.</li> <li>Design and architect intricate data models for optimal storage and retrieval to support sub-second latency for querying blockchain data.</li> <li>Oversee the deployment and monitoring of large database clusters with an unwavering focus on performance and high availability. </li> <li>Collaborate across departments, partnering with data scientists, backend engineers, and product managers to design and implement novel data models that enhance TRM’s products.</li> </ul> <p><strong><span class="notion-enable-hover" data-token-index="0" data-reactroot="">What we’re looking for:</span></strong></p> <ul> <li>A Bachelor's degree (or equivalent) in Computer Science or a related field.</li> <li>A proven track record, with 8+ years of hands-on experience in architecting distributed system architecture, guiding projects from initial ideation through to successful production deployment.</li> <li>Exceptional programming skills in Python, as well as adeptness in SQL or SparkSQL.</li> <li>Versatility that spans the entire spectrum of data engineering in one or more of the following areas:<br> <ul> <li>In-depth experience with data stores such as ClickHouse, ElasticSearch, Postgres, Redis, and Neo4j.</li> <li>Proficiency in data pipeline and workflow orchestration tools like Airflow, DBT, Luigi, Azkaban, and Storm.</li> <li>Expertise in data processing technologies and streaming workflows including Spark, Kafka, and Flink.</li> <li>Competence in deploying and monitoring infrastructure within public cloud platforms, utilizing tools such as Docker, Terraform, Kubernetes, and Datadog.</li> <li>Proven ability in loading, querying, and transforming extensive datasets.</li> </ul> </li> </ul> <p><strong><span class="notion-enable-hover" data-token-index="0">About the Team:</span></strong></p> <ul> <li>The Data Platform team is the funnel between all of TRM's data world and product world. We care about all layers of stack including petabyte of data stores, pipelines, and processes.</li> <li>We have quite a big scope as a the team with new and exciting projects every quarter. As a result, we collaborate across the board with most teams at TRM.</li> <li>We believe in async communication and are also not afraid to jump on a quick huddle if that helps to move things faster. We are both scrappy when the situation demands and also process-oriented when we need to achieve our OKRs.</li> <li>We are always looking for people who can elevate the quality our tech and our executio ... (truncated, view full listing at source)