Flagshippioneeringinc

Principal Data Engineer

Cambridge, MA USA. Posted 16 days ago

The role

You will lead the architecture and evolution of the data platform for human genetics, multi-omics, and high-content imaging programs. You will set the direction for the AWS environment, pipelines, catalog, and access layers.

What you will do

  • Serve as technical owner and architect of the AWS environment, including account structure, IAM, networking, compute, and storage.
  • Lead and extend cost governance, including budgets, alerting, tagging enforcement, rightsizing, and storage lifecycle and tiering.
  • Define and own developer operations for the data platform, including infrastructure as code, CI/CD, container builds, and secrets and environment management.
  • Upgrade the data lake, managed orchestration, metadata and data ingestion workflows.
  • Partner with ML and computational biology leaders to define the interface between platform and modelling.

Required qualifications

  • 10+ years building and operating production data infrastructure, with a track record of architecting and owning platforms end to end.
  • Deep AWS expertise: S3, IAM, EC2, Batch, Lambda, and Spark (EMR or equivalent).
  • Experience as technical owner of production cloud environments, including multi-account architecture and cross-account access.
  • Strong Python and SQL, with a background in production-grade pipeline development.
  • Production experience with workflow orchestration (Nextflow, Airflow, Temporal, Step Functions, Redun, or similar).
  • Infrastructure as code (CloudFormation/CDK), CI/CD, containers, and observability.
  • Data modelling and warehouse or lakehouse design, including metadata management, lineage, and data quality practice.
  • Cost governance at scale, including budgets, tagging, rightsizing, and storage lifecycle across hundreds of terabytes.
  • Fluency with scientific data semantics (studies, samples, donors, cell lines, assays).

Nice to have

  • Familiarity with genetics and genomics data.
  • Microscopy or high-content screening data, including large binary object stores, transfer optimization, and image streaming for model training.
  • Databricks, OpenMetadata, or a comparable catalog in production.
  • Snowflake, particularly governed access patterns over cloud object storage.
  • ML infrastructure: SageMaker or Databricks ML, MLflow or Weights & Biases, feature stores.
  • Serving data to LLM or agent clients (MCP servers, tool APIs).
  • Experience leading data platform architecture as a senior or principal individual contributor, ideally in biotech, pharma R&D, or a research institute.

Benefits

  • Healthcare coverage
  • Annual incentive program
  • Retirement benefits
  • A broad range of other benefits

About the company

Vesalius Therapeutics is pioneering a new platform to generate breakthrough treatments for common diseases. It was founded in 2019 by Flagship Pioneering.

Principal Data Engineer at Flagshippioneeringinc | JobZoey