Staff Data Engineer

The role

You will build and operate data integrations that feed a mission-critical platform for cyber operations. You will design and build data pipelines, monitor system health, and support field deployments.

What you will do

• Design and build data pipelines using AWS Glue jobs written in PySpark
• Investigate unfamiliar source systems and data formats
• Design schemas and data models including analytical models in ClickHouse
• Write testable, debuggable, and maintainable code
• Write integration code that meets security standards of classified environments
• Deploy, operate, and iterate on integrations
• Package pipelines for restricted environments
• Support field deployments remotely
• Monitor the health of data pipelines and platform services using the LGTM stack
• Diagnose and resolve production issues in the data path

Required qualifications

• 5+ years of experience in data engineering, or software engineering with a substantial data infrastructure focus
• Expert Python skills
• Hands-on experience building and operating ETL/ELT pipelines with Spark (PySpark), ideally as AWS Glue jobs
• Strong SQL and schema design skills
• Experience with column-oriented analytical databases
• Experience debugging production data systems
• Demonstrated ability to work independently on production systems
• Ability to work on-site full-time at Twenty's New York City office

Nice to have

• Experience with data lake and large-scale query technologies (Apache Iceberg, Delta Lake, Trino, Presto, Athena)
• Experience with streaming and message queue technologies (Kafka, NATS, Kinesis, RabbitMQ)
• Hands-on experience with observability tooling (Grafana, Datadog, Spl Splunk, or similar)
• Experience deploying and operating software in air-gapped, classified, or otherwise restricted environments
• Familiarity with containerized environments (Docker and container orchestration) and CI/CD concepts

Benefits

• Medical, dental, and vision plan options
• Life / AD&D, disability coverage options
• Paid parental leave: 12 weeks for birthing parents, 4 weeks for non-birthing parents, 6 weeks for adoptive, foster, or intended parents
• Paid holidays
• Flexible PTO
• 401(k) with pre-tax and Roth options
• HSA/FSA options
• Dependent care FSA

Before you apply

• U.S. citizenship required
• Eligibility to obtain a U.S. Government security clearance

About the company

Founded in 2024, Twenty Technologies industrializes offensive cyber operations for the U.S. and its allies. Headquartered in Arlington, Virginia, Twenty has raised $168M from various investors.