Cuspai

Data Engineer

London, UK, Remote. Posted 21 days ago

The role

You will own the software lifecycle of data-rich tools, services, and web applications. You will build scalable data pipelines and develop Python APIs and web applications to enable researchers and machine learning engineers to collaborate on datasets.

What you will do

  • Own the full software lifecycle of data-rich tools, services, and web applications from design through to deployment and security.
  • Build scalable data ingestion, processing, and cleaning pipelines to handle both structured and complex unstructured data.
  • Develop data-intensive Python APIs and intuitive web applications/UIs.
  • Implement robust orchestration systems to automate pipeline execution and manage data flows.
  • Maintain strict standards for data privacy, governance, and security across all data architectures.
  • Deploy and manage containerised data services using basic infrastructure tooling.

Required qualifications

  • Software engineering background with a strong focus on data management.
  • Deep fluency in Python.
  • Hands-on experience with at least two database paradigms (e.g., Relational, Document, Columnar, Key-Value).
  • Proven track record writing data-rich Python APIs and surfacing data through web applications with a UI.
  • Experience working with complex unstructured data, large-scale datasets, and implementing data privacy standards.
  • Experience with at least one modern orchestration framework (e.g., Dagster, Flyte, Prefect, Ray).
  • Fundamental infrastructure experience with basic Docker and Kubernetes.

Nice to have

  • Experience working with geographically distributed data.
  • Experience with modern data lakehouse / warehouse technologies (e.g., Apache Iceberg, Delta Lake, Apache Hudi).
  • Prior experience collaborating with scientists, domain experts, or ML teams.

Benefits

  • Competitive salary
  • Equity in CuspAI
  • 28 days holiday (DE, NL, UK) or 21 days holiday (JP, SG, US), in addition to local public holidays
  • 26 weeks (primary caregiver) and 12 weeks (secondary caregiver) parental leave at full pay
  • Professional development budget

About the company

CuspAI is a frontier AI company on a mission to solve the breakthrough materials needed to power human progress. The founding team is comprised of researchers in AI, chemistry and engineering.