Data Platform Engineer

The role

This role builds and administers self-serve infrastructure, governance automation, and access controls for domain teams. You will administer the Databricks platform and the Lakebase Postgres estate to enable decentralized data ownership.

What you will do

• Administer the Azure Databricks and Unity Catalog platform
• Build self-serve infrastructure including provisioning workflows and templates
• Act as the DBA for the platform's Postgres estate
• Build and maintain Infrastructure-as-Code using Terraform against Azure
• Implement and enforce the platform's approved access model
• Build the audit and lineage layer
• Operate platform observability across Databricks, Lakebase, and Azure services
• Execute the infrastructure lifecycle including provisioning and disaster recovery
• Support CI/CD for data workloads across domain teams
• Maintain integration between the platform and GitHub

Required qualifications

• Minimum of 4 years in a platform or infrastructure engineering role supporting a data or analytics organization
• Deep hands-on experience with Databricks (workspace administration, Unity Catalog, Delta Lake)
• Deep hands-on experience with Azure (Entra ID, networking, Key Vault, Infrastructure-as-Code via Terraform or Bicep)
• Hands-on PostgreSQL administration experience
• Real experience with identity and access architecture
• Practical experience building and maintaining CI/CD pipelines with GitHub Actions and/or Azure DevOps
• Proficiency with Python or another scripting language
• Experience using AI tools (e.g., GitHub Copilot, ChatGPT, Claude)
• Comfort owning the infrastructure lifecycle: provisioning, decommissioning, and disaster recovery
• Experience working in a regulated environment, ideally healthcare, with HIPAA and/or SOC 2 requirements
• Comfort operating with elevated privileges in a regulated, PHI-bearing environment
• Ability to hold a standard without owning it

Nice to have

• Exposure to data mesh or domain-oriented data architecture
• Hands-on experience with Databricks Lakebase or another cloud-native Postgres service
• Familiarity with Azure SQL Database
• Healthcare data environment experience (HIPAA-driven access controls, PHI segregation)
• Experience with observability tooling such as Datadog or OpenTelemetry-based pipelines
• Experience with Databricks Asset Bundles, DLT, or dbt in a multi-team deployment model
• Hold relevant certifications (e.g., Databricks Data Engineer Professional, Azure Administrator, etc.)

Benefits

• Medical Insurance
• Dental Insurance
• Vision Insurance
• Short & Long Term Disability
• Life Insurance
• 401k with company match
• Flexible Time Off
• Paid Parental Leave

About the company

Lantern is a specialty care platform connecting people with a Network of Excellence of top specialists. It delivers care with cost savings to employers and their workforces.