Senior Data Engineer

Job Requisition ID # 26WD97023 Position Overview We are looking for an exceptional data engineer to transform, optimize, test, and maintain architectures for enterprise analytics databases, data pipelines, and processing systems, as well as optimizing data flow and collection for cross-functional teams. The mission of the team is to empower decision-makers and the broader data communities through trusted data assets and scalable self-serve analytics. The focus of your work will be engineering new pipelines and maintaining, creating frameworks, enhancing existing data pipelines with new features to ensure accurate data delivery to stakeholders promptly, also support ad-hoc reporting requirements that facilitate data-driven actionable insights and decision-making at Autodesk. Responsibilities Develop and maintain data pipelines required for the extraction, transformation, cleaning, pre-processing, aggregation, and loading of data from a wide variety of data sources using Python, SQL, DBT, and other data technologies Design, implement, test, and maintain data pipelines/ new features based on stakeholders’ requirements Develop/maintain scalable, available, quality-assured analytical building blocks/datasets by close coordination with data analysts Optimize/ maintain workflows/ scripts on present data warehouses and present ETL Design / develop/maintain components of data processing frameworks Build and maintain data quality and durability tracking mechanisms to provide visibility into and address inevitable disruptions in data ingestion, processing, and storage Translate deeply technical designs into business-appropriate representations as well as analyze business needs and requirements ensuring the implementation of data services directly correlates to the strategy and growth of the business Focus on automation use cases, CI/CD approaches, and self-service modules relevant to data domains Address questions and concerns from downstream data consumers through appropriate channels Create data tools for analytics and BI teams that assist them in building and optimizing our product into an innovative industry leader Stay up to date with data engineering best practices, and patterns, evaluate and analyse new technologies, capabilities, and open-source software in the context of our data strategy to ensure we are adapting, extending, or replacing our core technologies to stay ahead of the industry Contribute to Analytics engineering process Minimum Qualifications Bachelor's degree in computer science, information systems, or a related discipline 5 years in a Data Engineer role Built processes supporting data transformation, data structures, metadata, dependency, data quality, and workload management Working experience with Snowflake, Hands-on experience with Snowflake utilities, SnowSQL, SnowPipe. Should have worked on Snowflake Cost optimization scenarios Overall solid programming skills, able to write modular, maintainable code, preferably Python & SQL Have experience with workflow management solutions like Airflow Have experience with Data transformations tools like DBT Experience working with Git Experience working with big data stack environments, like, Hive, Spark and Presto Strong analytical, problem solving and interpersonal skills Familiar with Scrum Experience liaising with team members in different geographies Preferred Qualifications Snowflake DBT Matillion Fivetran Airflow CI/CD (Jenkins) Basic understanding of Power BI/Visualization tools AWS environment, for example S3, Lambda, Glue, Cloud watch Basic understanding of Salesforce, Marketo, and Adobe Analytics Experience working with remote teams spread across multiple time-zones Strong organizational skills and attention to detail Have a hunger to learn and the ability to operate in a self-guided manner #LI-NB1 Learn More About Autodesk Welcome to Autodesk! Amazing things are created every day with our software – from the gre ... (truncated, view full listing at source)