Sr. Data Platform Engineer (US)

The role

You will build and optimize batch and streaming data pipelines. You will extract, analyze, and model structured and unstructured datasets while applying machine learning techniques.

What you will do

• Build and optimize data pipelines (batch and streaming).
• Extracting, analyzing and modeling rich and diverse datasets of structured and unstructured data.
• Design software that is easily testable and maintainable.
• Support in setting data strategies and our vision.
• Keep track of emerging technologies and trends in the Data Engineering world.
• Work on extendable data processing systems that allows to add and scale pipelines.
• Apply machine learning techniques to extract value from our data sets.
• Leverage AI-powered development tools to accelerate development, refactoring, and code generation.

Required qualifications

• 4+ years of experience in Data Engineering.
• 4+ years of experience with Python.
• Experience in developing, maintaining, and ensuring the reliability, scalability, fault tolerance, and observability of data pipelines in a production environment.
• Fundamental knowledge of data engineering techniques: ETL/ELT, batch and streaming, DWH, Data Lakes, distributed processing.
• Strong knowledge of SDLC and solid software engineering practices.
• Familiar with infrastructure-as-code approach.
• Strong problem solving and the ability to communicate ideas effectively.
• Self-starter, independent, likes to take initiative.
• Familiarity with at least some of the technologies in our current tech stack: Python, PySpark, Pandas, SQL (PostgreSQL), ElasticSearch, Airflow, Docker, Databricks, AWS (S3, Batch, Athena, RDS, Dynamo

Nice to have

• Knowledge surrounding AI-assisted coding and experience with Cursor, Co-Pilot, or Codex
• A strong track record of leveraging AI IDEs like Cursor

Benefits

• Competitive salary
• Equity at a well-funded, fast-growing startup
• Unlimited vacation time
• 99% covered health + dental + vision insurance for employees and dependents
• 401K through Empower with options to invest how you want it

About the company

Craft is the leader in supplier risk intelligence, enabling enterprises to discover, evaluate, and continuously monitor their suppliers at scale. It is a post-Series B high-growth technology company headquartered in San Francisco.