Staff Data Platform Engineer

The role

You will architect and scale data platform infrastructure for software-defined electric vehicles. The role focuses on designing and optimizing core data processing and analytics infrastructure with an emphasis on multi-region Databricks orchestration.

What you will do

• Design, deploy, and maintain data platform infrastructure using Terraform and IaC principles.
• Manage and optimize the Databricks platform for security, performance, and cost-effectiveness.
• Lead technical design of data systems for scalability, reliability, and performance.
• Communicate with data producers, consumers, and business leaders to gather requirements.
• Identify and resolve issues with the Databricks platform.
• Stay up-to-date with big data technologies, cloud computing, and DevOps practices.

Required qualifications

• Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
• 3+ years of hands-on experience in a similar role.
• Proven track record of building and maintaining large-scale data processing systems.
• Solid understanding of the Databricks platform and core concepts such as Delta, Spark, Unity Catalog, data governance, and workspace administration.
• History of using Terraform to manage large scale systems via Infrastructure as Code.
• Experience utilizing technologies to build and maintain CI/CD pipelines.
• Exceptional analytical and problem-solving skills.
• Excellent communication and interpersonal skills.
• Experience working with cloud-based technologies (e.g., AWS, GCP, Azure).

Nice to have

• PySpark Expertise: Background designing scalable data pipelines using the Spark ecosystem (e.g., Spark SQL, Spark Streaming).
• AWS proficiency: Familiarity with core services such as IAM permissions, VPC networking, EC2 compute, and S3 storage.

Benefits

• Competitive base salary
• Annual company performance bonus program
• Equity in the form of Restricted Stock Units (RSUs)
• Health coverage
• Retirement savings
• Time off
• Family planning programs

About the company

Rivian and Volkswagen Group Technologies is a joint venture addressing electric vehicle challenges through technology like operating systems, zonal controllers, and cloud solutions.