Software Engineer III - Data

Our Mission: Our mission is to multiply what matters: growth, retention, and efficiency. We envision a future where companies, teams and people reach their full potential. Our People: People are the heart and soul of 6sense. We serve with passion and purpose. We live by our Being 6sense values of Win as One Team, Stay Curious, Do The Right Thing, Own the Outcome, and Create Belonging. Every 6sensor plays a part in defining the future of our industry-leading technology. 6sense is a place where difference-makers roll up their sleeves, take risks, act with integrity, and measure success by the value we create for our customers. We want 6sense to be the best chapter of your career. About the Team The Core Data team is a globally distributed group (India US) focused on building and maintaining 6sense’s most critical data assets. This includes: ID Graph + Firmographics + MCD (IDnF) Data Acquisition from public sources Technographics and Psychographics B2B Intent Network (3Pi) Signals (Job Postings, News Feeds) People Privacy data (MPD) Role Overview As a Data Engineer IC3 in the Core Data team, you’ll be responsible for designing and building scalable data pipelines, integrating new data sources, and continuously improving the quality and reliability of our data assets. You will collaborate closely with data scientists, ML engineers, product managers, and other engineering teams to ensure robust, compliant, and high-impact data delivery. This is an individual contributor role suited for someone with 4–6 years of hands-on experience who is ready to own end-to-end data engineering responsibilities for core components in a production-grade platform. Responsibilities Design and maintain scalable data pipelines using distributed data processing frameworks (e.g., Spark, Airflow). Ingest, clean, transform, and validate large volumes of structured and unstructured data from public and third-party sources. Partner with internal stakeholders to deliver critical datasets. Contribute to maintaining the Master People Database (MPD) and ensure its integrity, deduplication, and enrichment. Optimize query performance and storage using tools like Snowflake or BigQuery. Collaborate in defining and implementing privacy-compliant data handling in accordance with GDPR/CCPA... requirements. Identify and fix data quality issues; write and maintain unit/integration tests for pipeline components. Own small to medium-sized projects end-to-end with guidance from senior engineers. Minimum Qualifications 4–6 years of experience as a Data Engineer, Big Data Engineer, or similar role. Proficiency in Java, Python, Spark, and SQL. Experience with at least one distributed data processing framework (e.g., Apache Spark, Apache Flink). Experience working with cloud platforms like AWS, GCP, or Azure (preferably AWS). Familiarity with orchestration tools like Apache Airflow or similar. Understanding of data modeling, schema design, and data governance principles. Experience with data versioning, monitoring, and logging tools. Strong communication and collaboration skills in cross-functional teams. Preferred Qualifications Experience with data ingestion from web scraping or public APIs (e.g., job boards, websites, news sources). Exposure to modern data stack tools like dbt , Delta Lake, Hive, Hadoop. Prior experience with identity resolution or entity matching pipelines. Understanding of privacy compliance frameworks such as GDPR and CCPA. Experience working in product-focused teams and delivering data for customer-facing features. Why Join Us? Be part of a mission-critical team building data assets that power every layer of our product. Work in a modern data stack environment with real-world scale and complexity. Collaborate with a globally distributed team of data experts. Own high-impact projects from ideation to production. Our Benefits: Full-time employees can take advantage of health coverage, paid parental l ... (truncated, view full listing at source)