Senior Data Engineer

Our Purpose Mastercard powers economies and empowers people in 200 countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Data Engineer The Program Modernization team at MasterCard drives transformation and champions modernization across technology, risk, and service operations. We establish the foundation for scalable programs, resilient systems and control governance that empowers transformation. The mission of the Technology Modernization team is to enable all the Mastercard programs across the organization to thrive in an evolving regulatory environment by fostering a culture of strong technology controls and effective execution. The team designs and delivers innovative, data-driven solutions that fulfill assurance obligations and regulatory requirements by proactively identifying risks, build real-time tools that leverage technology to continuously test and monitor the control environment. These capabilities enables audit-ready compliance portal for inventorying, managing, testing, and evidencing technology controls. Role overview As a Senior Data Engineer in Program Modernization team, you will have the opportunity to lead high performance data pipelines which load into Technology Evidence Mining System. Our solution provides analytical capabilities and aims to modernize and unify how compliance-related evidence is collected, stored, and accessed across ProCOM. This is addressed through the creation of an AI-powered compliance assistant that standardizes responses across the Technology control domains to support evidence collection to meet regulatory and customer requirements. You will play a vital role within a rapidly growing organization, while working closely with experienced and driven engineers to solve challenging problems. Responsibilities include: Leverage new technologies and approaches to innovating with increasingly large data sets- Work with project team to meet scheduled due dates, while identifying emerging issues and recommending solutions for problems Create solutions with high level of innovation, cost effectiveness, high quality and faster time to market. Perform assigned tasks and production incident independently Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency Required skills: 8 to 10 years of development and data analysis experience in Data Warehouse related projects in product or service based organization Expertise in ETL testing in end-to-end DW projects in Big Data environment using Spark Experience of programming language like Python/ Unix scripting to build and enhance test automation framework Prior experience with Multi-AZ and Cloud Native architecture and development Proven ability in working with Databases like Oracle, Postgres and have strong SQL knowledge Experience of working on NiFi will be an added advantage Experience of working in Agile teams Strong analytical skills required for doing data analysis and defect management process Strong communication skills - both verbal and written ñ and strong relationship, collaboration skills and organizational skills Ability to be high-energy, detail-oriented, proactive and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results Ability to quickly learn and implement new technologies, and perform POC to explore best solution for the problem statement Flexibility to work as a member of a matrix based diverse and geogra ... (truncated, view full listing at source)