Garnerhealth
Senior Data Engineer
New York City, New York. Posted 2 months ago
The role
The Senior Data Engineer will build, optimize, and maintain data pipelines. They will also define reusable data sets and design data validation frameworks using a modern data stack.
What you will do
- Build, optimize, and maintain data pipelines that power our business
- Define and build out abstracted reusable data sets to be used for Business Intelligence, Marketing, and Data Science Research
- Design, build, and evangelize a federated data validation frameworks to be used to monitor potential data inconsistencies
- Protect our users’ privacy and security through best practices
Required qualifications
- 4+ years of software/data engineering experience (distributed data processing, data warehousing, data governance, Big Data, data variance, data privacy, and data quality)
- Expertise in SQL, job experience, and demonstrated strength with Python
- Expertise in building scalable data pipelines, query optimization, data modeling, and defining reusable datasets
- Experience working with orchestration tools (especially Airflow), databases (especially PostgreSQL), datalakes (especially Iceberg), data warehouses (especially Snowflake)
- Expertise with SQL tuning, Spark development, medallion and event-driven architectures
Nice to have
- Familiarity with healthcare or insurance
- Familiarity with data security and HIPAA compliance
Benefits
- equity incentive
- flexible PTO
- Medical/Dental/Vision plan options
- 401(k) with company match
- flexible spending accounts
- Teladoc Health
About the company
Garner partners with employers to redesign how healthcare works by identifying best-performing doctors using proprietary clinical metrics. The company uses AI to help members access higher-quality care and lower healthcare costs.