FinOps Data Engineer

At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market. What unites Anaplanners across teams and geographies is our collective commitment to our customers’ success and to our Winning Culture. Our customers rank among the who’s who in the Fortune 50. Coca-Cola, LinkedIn, Adobe, LVMH and Bayer are just a few of the 2,400+ global companies who rely on our best-in-class platform. Our Winning Culture is the engine that drives our teams of innovators. We champion diversity of thought and ideas, we behave like leaders regardless of title, we are committed to achieving ambitious goals, and we love celebrating our wins – big and small. Supported by operating principles of being strategy-led, values -based and disciplined in execution, you’ll be inspired, connected, developed and rewarded here. Everything that makes you unique is welcome; join us and let’s build what’s next - together! Your Impact The Data Engineer will be responsible for building and maintaining robust data pipelines, managing and transforming data, and ensuring the quality and integrity of data across various platforms. The candidate will have hands-on experience with Google Data Products and AWS Data Products, metadata management tools, orchestration tools and strong expertise in SQL, Python, and ETL processes. Key Responsibilities: Google Data Products: Use Google Data Products including BigQuery, Dataflow, and Cloud Composer/ Apache Airflow to design, develop, optimize and maintain data pipelines and workflows. AWS Data Services: Use AWS Data Products such as S3, Glue, Athena, Redshift, API Gateway to design, develop, optimize and maintain data pipelines and workflows. Metadata Management Data Quality: Implement and manage metadata, data quality, and data lineage using tools from AWS, GCP and Azure to ensure data integrity, relevance and compliance. E2E Data Engineering: Provide input into the end-to-end data engineering lifecycle, as well as project/ programme lifecycle including managing non-functional requirements, operations, and performance tuning. Solution Design: Collaborate with stakeholders to design E2E solutions, including prototyping, usability testing, and data visualization, to meet business needs. SQL NoSQL Databases: Develop, optimize, and manage data storage solutions using SQL and NoSQL databases/virtual databses, ensuring data is efficiently structured and accessible. Python Programming: Work with semi-structured and unstructured data, including making ReST API calls, subscribing to message topics, using Python for data manipulation and transformation. ETL Tools Data Modeling: Develop and maintain ETL processes using tools from AWS, GCP and Azure, and create data models to support business requirements. Collaboration: Work closely with FinOps team, Engineering, Corporate BI Teams, and as needed with data scientists/ analysts, and other stakeholders to deliver high-quality data products and solutions. Your Qualifications Python: 3 to 4 years of hands-on experience with Python, especially in handling semi/unstructured data and REST API integration. Relational Databases: 3 to 4 years of experience working with relational databases like Google Big Query, AWS Athena, AWS Redshift, or at least MySQL/RDBMS, with a strong focus on writing optimized queries. ETL Tools: 4 to 5 years of working knowledge with ETL tools (e.g., Apache Airflow, Google Composer, AWS Glue or Informatica, MuleSoft, SSIS) and data modeling. Google Cloud Experience: 2 years of experience with Google BigQuery, Dataflow, and Cloud Composer. AWS Experience: 2 years of experience with AWS S3, Glue, Athena, Redshift, API Gateway Data Engineering Lifecycle: Experience managing the complete data engineering lifecycle, including solution design, development, and operations. Familiarity wi ... (truncated, view full listing at source)