Principal Software Engineer

About the Job: Make a difference in the technology that is at the core of some of the most innovative and influential businesses in the world. Red Hat’s Multi-product and Engineering Experience (MPEX) Integrity Engineering organization is looking for a highly skilled Principal Software Engineer focused on Chaos Engineering to join our team in India . In this role, you will work at the forefront of reliability, resilience, and failure testing for Red Hat’s Hybrid Platforms. You will serve as a technical architect and leader for Chaos Engineering efforts, defining Chaos Engineering standards and practices for Hybrid Platforms and influencing platform reliability decisions across multiple product areas. You will help create robust, production-ready systems by validating real-world failure scenarios and ensuring platform stability across complex, multi-product environments. This role requires strong software development and testing skills, deep Linux or Unix expertise, and experience designing and operating large, distributed, and layered systems. Collaboration is central to Red Hat’s open-source culture, and you will work closely with engineering, product, QE, and SRE teams to scale Chaos Engineering adoption and drive measurable improvements in customer-facing reliability. What will you do Define, document, and communicate a clear vision for Chaos Engineering aligned with strategic initiatives across the Hybrid Platforms organization. Design and implement Chaos testing strategies focused on real-world failure modes, customer scenarios, and multi-product interactions. Technically lead Hybrid Platforms teams in identifying, reproducing, and resolving resilience and stability issues uncovered through Chaos testing. Collaborate closely with engineering, product, QE, and SRE stakeholders to close gaps in resilience coverage. Integrate Chaos testing into CI pipelines such as OpenShift CI to enable early detection of regressions and reliability risks. Execute upgrade and lifecycle Chaos testing to validate platform behavior during disruptive operations and transitions. Document defects uncovered through Chaos testing and actively advocate for their prioritization and resolution. Create and maintain dashboards and reports to track Chaos test coverage, outcomes, and reliability trends. Clearly communicate customer and business impact of resilience findings to technical and non-technical stakeholders. Stay current with industry trends, tools, and best practices in Chaos Engineering and distributed systems. Enhance testing infrastructure, automation, and observability to scale Chaos testing adoption across teams. What will you bring 10 years of experience in software engineering, SRE, platform engineering, quality engineering, or reliability-focused roles. Strong Linux or Unix system administration and networking skills, including experience with Git-based workflows. Hands-on experience with containers and orchestration platforms such as Red Hat OpenShift and Kubernetes. Experience working with large-scale distributed systems and virtualization technologies such as KVM, VMware, or Libvirt. Advanced programming skills in Python, including building and maintaining automated testing frameworks and tooling. Experience implementing and integrating testing workflows into CI systems, preferably OpenShift CI. Proven ability to technically lead and mentor engineers through complex, cross-team initiatives. Strong written and verbal communication skills in English, with experience collaborating across globally distributed teams. Preferred Qualifications Experience with Chaos Engineering tools and frameworks such as Krkn or similar platforms. Familiarity with automation and configuration management tools such as Ansible. Knowledge of open-source development models and communities. Experience working in agile development environments. Certifications such as ISTQB, CSTE, or related credentials are optional. # LI-CS1 About ... (truncated, view full listing at source)