Staff Data Platform Engineer

The role

You will own the data platform and set the architecture to make CertifyOS the source of truth for provider data. You will lead a team of engineers to deliver initiatives and be accountable for data reliability, freshness, and cost.

What you will do

• Lead a team of engineers to deliver data platform initiatives end to end
• Own data architecture across OLTP, OLAP, and NoSQL stores
• Design and operate distributed real-time and batch pipelines in Python and PySpark
• Lead entity resolution and MDM architecture for provider data
• Build and own data products with clear contracts, SLAs, and consumers
• Be accountable for data reliability, freshness, quality, and cost
• Drive performance and scale work
• Build the data foundations for AI/ML workloads
• Mentor engineers, raise the bar on design and code review, and partner with product, analytics, and ML
• Join the on-call rotation and turn incidents into systemic fixes

Required qualifications

• 10+ years building production data systems, including Staff or Tech Lead scope
• Led a team of engineers to deliver complex data systems
• Expert Python and production PySpark
• Deep distributed systems knowledge: consistency, partitioning, idempotency, backpressure, failure handling
• Significant entity resolution and MDM experience: matching, deduplication, survivorship, golden records at scale
• Built and owned data products used by other teams
• Shipped measurable performance and scale improvements
• Expertise across OLTP (Aurora, PostgreSQL, MySQL), OLAP (Redshift, Athena, Snowflake, ClickHouse), and NoSQL (MongoDB, DynamoDB, Cassandra)
• Stream processing and event-driven architecture (Kafka, Kinesis, SNS/SQS)
• Data observability in practice: quality checks, lineage, monitoring, alerting
• Built data platforms that serve ML workloads
• Influences technical direction across teams and communicates clearly with non-technical stakeholders

Nice to have

• Change Data Capture (CDC) patterns
• Data mesh or data-platform-as-a-product approaches
• Schema registries or data catalogs
• Orchestration tools (AWS Glue, EMR, Managed Flink, Airflow/MWAA, dbt)
• Healthcare or other regulated environments

Benefits

• 100% coverage of health, dental, and vision insurance premiums for employees
• Unlimited PTO, with at least two weeks off each year for US-based team
• Health insurance for employees in India
• Statutory leave benefits in India
• Additional wellness (menstrual) leave for women in India

About the company

CertifyOS is building the data infrastructure that powers modern healthcare. Their API-first platform automates provider licensing, enrollment, credentialing, and network monitoring.