Senior Software Engineer, Data Engineering

The role

You will architect and build a data lakehouse to manage high-rate radio data streams. This role involves designing vector database infrastructure and data management systems for AI/ML workloads.

What you will do

• Architect and build the data lakehouse including ingestion pipelines, open table formats, and governance.
• Design and operate vector database infrastructure for embedding storage and similarity search.
• Build large-scale data management systems for lifecycle, lineage, versioning, and cost management.
• Design data platform capabilities to support ML use cases like feature pipelines and low-latency retrieval.
• Establish schema and data-contract standards and build self-serve tooling.
• Own reliability and performance of data pipelines in production.
• Mentor engineers and lead technical design across the data domain.

Required qualifications

• 4–6+ years of software / data engineering experience, including several years designing and operating large-scale data platforms in production.
• Deep experience with lakehouse architectures and technologies such as Apache Iceberg, Delta Lake, or Hudi; Parquet; Spark, Flink, Trino, DuckDB, or similar engines.
• Hands-on experience with vector databases and embedding retrieval including indexing trade-offs and scaling.
• Strong experience with AWS or another major cloud provider.
• Fluency in Python and SQL.
• Experience with orchestration tools.
• Demonstrated experience designing data architectures specifically for ML / AI workloads.
• Strong grasp of data modeling, consistency, and the trade-offs between batch and streaming.

Nice to have

• Experience with streaming ingestion at high volume (Kafka, Kinesis, Pulsar).
• Experience with time-series, geospatial, or signal / sensor data.
• Familiarity with data governance and security requirements in regulated environments.
• Experience with Rust, Go, or C++ for performance-critical data paths.

Benefits

• Above-market salary
• Equity
• Benefits package
• Early Series A Equity
• Excellent health, dental, and vision coverage
• 401(k) match - up to 4% of your salary
• Flexible PTO
• Daily office lunches in NYC

Before you apply

• To conform to U.S. Government technology export regulations, you must be a U.S. citizen, lawful permanent resident of the U.S., protected individual as defined by 8 U.S.C. 1324b(a)(3), or eligible to

About the company

DS creates systems that power the next generation of radio spectrum intelligence. They collect radio data from around the world to train neural networks and run them on small chips.