Senior Data Engineer

San Francisco, Remote. Posted 5 months ago

The role

You will build the data layer that powers AI-assisted curriculum authoring and content delivery. You will own pipelines, schemas, and validation frameworks to turn curriculum content into structured data products.

What you will do

Design and own the schema and data models representing curriculum content
Build ingestion pipelines for varied source formats including XML, JSON, PDF-derived, and API-delivered
Develop Python-based parsers, transformers, and validation scripts
Collaborate with Instructional Designers and product teams to translate workflows into requirements
Build and maintain embedding and vector database pipelines
Work in Git-based workflows treating data artifacts with software rigor

Required qualifications

4+ years of data engineering experience
Strong Python skills
Schema design instincts
Data quality mindset
Cross-functional collaborator
Provisioning and monitoring of infrastructure for data systems
Familiarity with IaC tools such as Terraform and Terragrunt
Experience with ECS, EKS clusters, lambdas and S3 buckets
Bachelor’s or Master’s degree in CS or equivalent work experience

Nice to have

Background in education, curriculum design, or ed-tech
Experience with vector databases (Pinecone, Weaviate, pgvector) or embedding pipeline tooling
Familiarity with agentic AI patterns or Model Context Protocol (MCP)

Benefits

Competitive salary
Meaningful equity
Health insurance benefits: medical (various PPO/HMO/HSA plans), dental, vision, disability and life insurance
401k plan
One Medical membership (in participating locations)
Flexible vacation time policy
10 paid sick days per year
Paid holidays
Paid bereavement leave
Paid family leave after birth/adoption
Commuter and FSA plans

About the company

Kiddom is transforming K–12 education by bringing high-quality curriculum, instructional tools, and student analytics together in one coherent system. They are building Learning Intelligence Technology (LIT) to help educators plan, teach, assess, and respond to student needs.