Software Architect - Data Platform

Harness is the AI Software Delivery Platform company, led by technologist and entrepreneur Jyoti Bansal (founder of AppDynamics, acquired by Cisco for $3.7B). Harness has raised approximately $570M in funding and is valued at $5.5B, backed by leading investors including Goldman Sachs, Menlo Ventures, IVP, Unusual Ventures, Citi Ventures, and more. As AI accelerates code creation, the real bottleneck has shifted to everything after the code – testing, deployments, application security, reliability, compliance, and cost optimization. Harness brings AI and automation to this “outer loop,” helping teams ship software faster while maintaining security and governance throughout the entire software delivery lifecycle. Powered by Harness AI and the Software Delivery Knowledge Graph, the Harness Platform applies deep context and intelligent automation across the software delivery lifecycle with governance and policy-driven controls embedded throughout the platform. Over the past year, Harness powered over 185M deployments, 82M builds, 18T flag evaluations, 8M security scans, 9.1B optimized tests, 3T protected API calls, and helped manage $2.8B in cloud spend — enabling customers like United Airlines, Morningstar, and Choice Hotels to accelerate releases by up to 75%, reduce cloud costs by up to 60%, and achieve 10x DevOps efficiency. With a global team across 14 offices and 25 countries, Harness is shaping the future of AI software delivery — and we’re looking for exceptional talent to help us move even faster. Position Summary We are building a Unified Data Platform to serve 20+ product modules, enabling ingestion, processing, and retrieval of data to power analytics, machine learning various intelligent systems at scale. This person will be cross-functionally involved in various initiatives to modernize or scale the data-platform catering to different product modules. About the Role You will lead the design, architecture development of the Unified Data platform. You will be working closely with senior engineering leaders, mentor senior/junior engineers, problem solve with product teams work with customer success teams. You will actively participate in building MVPs and POCs in various areas around data ingestion(streaming/batch), transformation or analytics. Author functional/non-functional specifications and design documents Design and implement automation of infrastructure setup using helm, terraform and similar technologies. Perform peer reviews of specifications, designs, and code Work alongside Site Reliability Engineers and cross functional teams to diagnose/troubleshoot any production performance related issues About You Bachelor’s or Master’s degree in Computer Science or related field. 15+ years of hands-on software(backend) development experience - most of which should be in the data platform space involving distributed systems microservices. Proven expertise in building low-latency, highly concurrent microservices for handling ingestion analytics. Deep exposure to both batch (spark) stream processing (Flink, Spark Streaming, Kafka Streams). Deep exposure to Datalake storage backed by S3, GCS or NFS. Deep exposure to OLAP data-stores like Pinot, Druid, Clickhouse Must have worked with open source technologies in the data platform space Familiarity with document datastores such as MongoDB Familiarity with RDS like postgress, mysql. Exposure to scaling and operating production data systems at 10K+ qps Deep exposure to JVM based languages like Java, Scala, Kotlin Experience in building custom DSL based ingestion or query abstractions. Deep understanding of Kubernetes infra deployment, observability alerting. Open-source contributions to major Apache projects in the data space(e.g. Apache Spark or Kafka) is a big plus. Work Location Bangalore. The successful candidate will be expected to be in the Bangalore office 2x/ week. What You Will Have at Harness Experience building a transformative produc ... (truncated, view full listing at source)