Data Platform Engineer

Data Platform Engineer About Treeswift: In the face of rising threats like severe storms and wildfires, increasing pressure on affordability, and unprecedented demands for system expansion, Treeswift empowers energy companies to modernize their field work to meet the unprecedented growth and challenges ahead. To accomplish our mission we deploy our sensors into our customers' field operations, typically on backpacks or vehicles. The resulting trove of LiDAR and imagery data is processed through our AI models to deliver actionable analytics through our web platform. To date, our technology has enabled utilities to reduce wildfire, regulatory and outage risk from vegetation, avoid delays and cost overruns in new construction, and accelerate recovery from severe storms. After starting our work with utilities in June 2024, we are now working with three of the five largest utilities in the United States and are rapidly expanding across new customers and use cases. To tackle this challenge we are bringing together a team of mission-driven experts with deep industry experience in robotics (Penn, Caltech, CMU) and enterprise software development (Palantir, Stripe, Oracle, MongoDB). We have raised funding from leading investors including Penny Pritzker’s Inspired Capital. Treeswift is headquartered in lower Manhattan, and maintains an office in Philadelphia. We also have some customer-facing team members based closer to our customer sites (i.e. Bay Area). We hope you join us on this journey! About the role You are a skilled and motivated Data Platform Engineer. You will: - Design, build, and maintain data pipelines at scale. We run Apache Airflow 3 on Astronomer with pipelines that process terabytes of real-world physical data across many file types—imagery, audio, point clouds, and more. You will develop and evolve DAGs that orchestrate complex, multi-step workflows: dozens of tasks, fan out/in in pipelines, Python and Kubernetes operators split across generalized and specialized node pools, and dynamic DAG generation. You will work closely with our in-house ML team (feature pipelines and model deployment live in these DAGs) and coordinate with our hardware team on ingestion and formats. Scope is a mix of pipeline development and platform ownership and we are happy to adjust the scope and balance of responsibilities based on your interests and strengths. - Help us scale and harden our data platform. We have one dedicated data engineer today; you will be the second. The broader engineering team is highly collaborative and you will work with members of the full-stack and machine learning teams. We are looking for someone to improve DAG design and execution, resource and cost tuning, reliability and observability, and contribute to how we run Airflow and Kubernetes in the cloud. If you enjoy writing pipelines and improving the platform that runs them, this role has room for both. - Stay curious, collaborative, and cross-functional. We are a small team where many people wear multiple hats. You will work alongside ML engineers, hardware engineers, and software engineers. Turning a technically complex set of requirements from a critical industry into a rich data set is at the center of what we do. We take pride in managing complexity and providing high-fidelity data that our customers can use to make better-informed decisions. - Be an owner at Treeswift; make the company better in whatever form that takes. We value the full picture you bring—whether that’s deep expertise in orchestration, a knack for debugging at scale, or hidden talents outside work. We launched our platform last fall and have only scratched the surface of what’s possible in terms of finding ways to add value for our customer. You will partner closely with some of the largest utilities in the country and contribute to efforts to develop new workflows in work planning, construction and disaster response. This is a full-time, hybrid role based out of our Lower M ... (truncated, view full listing at source)