Staff Data Engineer

Anduril Industries is a defense technology company with a mission to transform U.S. and allied military capabilities with advanced technology. By bringing the expertise, technology, and business model of the 21st century’s most innovative companies to the defense industry, Anduril is changing how military systems are designed, built and sold. Anduril’s family of systems is powered by Lattice OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As the world enters an era of strategic competition, Anduril is committed to bringing cutting-edge autonomy, AI, computer vision, sensor fusion, and networking technology to the military in months, not years. ABOUT THE TEAM As a Staff Data Engineer on the Analytics Team, you will be collaborating with stakeholders across the company to design, build and implement data pipelines and models that enable our next generation of technology to be deployed around the world. You will also shape the current and future vision of the entire data platform. The Analytics space is engrained in our team’s DNA, as we regularly discuss shifts in the industry and keep up with the top relevant blogs. If this culture and Anduril’s mission speaks to you, you’ve found the right place. ABOUT THE JOB We’re looking for Software and Data Engineers who are seeking high impact collaborative roles focused on driving operational execution. Ideally you are looking to learn what it takes to build the next generation of defense technology. As a Staff Engineer, you should be a player-coach; your role is to set an example for your team and define what great looks like while also being their advocate mentor. Your leadership should take a high performing team on towards the next level WHAT YOU'LL DO Lead the design and roadmap for our data platform Partner with operations, product, and engineering to advocate best practices and build supporting systems and infrastructure for the various data needs Own the ingest and egress frameworks for data pipelines that stitch together various data sources in order to produce valuable data products that drive the business Palantir Foundry is our central hub for data driven applications, visualizations and large scale data analysis across the Anduril org. We manage a large user base and provide true data self service at scale. We use SQLMesh for data transformations, giving our engineers the ability to work with SQL while enjoying software engineering best practices like version control, testing, and CI/CD for data pipelines. For querying data, we utilize Athena, an aws serverless solution that allows our team to run analytics directly on our data lake without managing infrastructure. We've implemented Apache Iceberg as our table format, providing advanced data management capabilities like schema evolution and time travel queries. We use Flyte for orchestration. It is a highly scalable, kubernetes native modern orchestration platform similar to Airflow or Dagster. Operate in a "player-coach" capacity, leading members of the team, while remaining hands on as a contributor REQUIRED QUALIFICATIONS 6+ years of experience in a data engineering role building products, ideally in a fast-paced environment 2+ years in a Lead role, demonstrating autonomy and process ownership You are motivated by our mission. We are working to solve the biggest problems in defense Good foundations in Python or another language Experience with Spark, PySpark, SQL and dbt Experience with Enterprise Data Systems like Palantir Foundry Experience with or interest in learning how to develop data services and data products Experience with AWS, Azure, or GCP security ecosystem, containerization, and associated tooling Knowledge of data visualization tools, such as Tableau Understand the importance of engineering with security’s best practices in mind You are empathetic: you are eager to see the world from your users’ perspective Y ... (truncated, view full listing at source)