Senior DevOps Engineer

<div class="p-rich_text_section"> <h3><strong>About the Role</strong></h3> <p>We are seeking a Senior Data DevOps Engineer to enhance our data platform and automation capabilities on AWS. This role sits at the intersection of DevOps and Data Engineering, with a focus on scalability, automation, and reliability. You will design, implement, and optimize data pipelines and infrastructure leveraging AWS-native services and open-source tools like Airflow. You will partner with data engineers, analysts, and platform teams to deliver a secure, high-performance, and resilient data ecosystem. We are seeking a Senior Data DevOps Engineer to enhance our data platform and automation capabilities on AWS. This position combines DevOps and Data Engineering expertise, with a strong emphasis on scalability, automation, and reliability. You will be responsible for designing, implementing, and optimizing data pipelines and infrastructure using AWS-native services and open-source tools such as Airflow.In this role, you will collaborate with data engineers, analysts, and platform teams to establish a secure, high-performance, and resilient data ecosystem. </p> <h3><strong>Key Responsibilities</strong></h3> <ul> <li>Architect, implement, and maintain AWS-based data infrastructure leveraging DMS, Redshift, Glue, and Athena.</li> <li>Build and manage Airflow DAGs for orchestrating ETL/ELT workflows.</li> <li>Automate data migrations and integrations with AWS DMS and Glue.</li> <li>Develop and maintain Terraform modules for data infrastructure.</li> <li>Design and manage CI/CD pipelines for data workflows and infrastructure changes.</li> <li>Optimise Redshift clusters, Glue jobs, and Athena queries for performance and cost efficiency.</li> <li>Ensure reliable data delivery pipelines that power Looker dashboards and reports.</li> <li>Implement observability (logging, monitoring, alerting) for data pipelines and services.</li> <li>Enforce IAM, security policies, and compliance standards across the data ecosystem.</li> <li>Collaborate with data engineers and analysts to improve data reliability, scalability, and governance.</li> <li>Construct and manage Airflow DAGs for orchestrating ETL/ELT workflows.</li> <li>Automate data migrations and integrations using AWS DMS and Glue.</li> <li>Mentor junior engineers and disseminate best practices in DevOps/DataOps.</li> </ul> <h3><strong>Required Skills Experience</strong></h3> <ul> <li>7+ years of experience in <strong>DevOps, DataOps, or Cloud Data Engineering</strong>.</li> <li>Strong hands-on expertise with <strong>AWS data services</strong>:</li> <ul> <li><strong>DMS</strong> for database migrations/replication.</li> <li><strong>Redshift</strong> for warehousing and performance tuning.</li> <li><strong>Glue</strong> for ETL workflows.</li> <li><strong>Athena</strong> for query optimization over S3.</li> </ul> <li>Strong experience with <strong>Apache Airflow</strong> for pipeline orchestration.</li> <li>Proficiency in <strong>Terraform</strong> for IaC (infrastructure as code).</li> <li>Scripting/automation expertise in <strong>Python</strong> and <strong>Bash</strong>.</li> <li>Strong CI/CD knowledge (GitLab CI, GitHub Actions, Jenkins, or ArgoCD).</li> <li>Familiarity with <strong>Looker</strong> (modeling best practices, ensuring reliable data delivery to dashboards).</li> <li>Strong experience with <strong>monitoring and observability</strong> for data platforms (Grafana, Prometheus, Datadog, ELK).</li> <li>Solid understanding of <strong>cloud security, IAM, and networking</strong> in AWS.<br><br></li> </ul> <h3><strong>Nice-to-Have</strong></h3> <ul> <li>Experience with <strong>streaming data platforms</strong> (Kafka, Kinesis).</li> <li>Exposure to <strong>MLOps tools</strong> (SageMaker, ML pipelines).</li> <li>Strong SQL skills and <strong>LookML</strong> knowledge for Looker optimization.</li> <li>Prior experience <strong>leading or mentoring DevOps/DataOps engineers</strong>.</li> </ul> <p>Knowled ... (truncated, view full listing at source)