Data Engineer

The role

This person will build, test, and maintain ETL pipelines for structured and unstructured data. They will design data warehouse solutions and contribute to data architecture decisions.

What you will do

• Build, test, and maintain robust ETL pipelines for structured and unstructured data sources
• Integrate with ML models for data enrichment
• Develop data transformation, validation, and quality monitoring processes
• Design and implement data warehouse solutions and data models
• Establish data quality frameworks with monitoring, alerting, and remediation processes
• Contribute to overall data architecture decisions
• Lead implementation of data platform improvements

Required qualifications

• 3+ years experience building production data pipelines and working with modern data stack tools
• 3+ years implementing and maintaining data warehouses and dimensional data models
• Strong SQL skills
• Experience with data modeling best practices
• Proficiency in Python for data engineering tasks
• Experience with workflow orchestration and automation tools
• Experience implementing data quality and governance practices
• Strong collaboration skills working with data scientists, analysts, and engineering teams

Nice to have

• Experience working with geospatial data
• Working with large-scale datasets
• Experience with web scraping
• Understanding of ML and AI based infrastructure
• Familiarity with JavaScript

Before you apply

• All persons hired will be required to verify identity and eligibility to work in the United States
• Complete the required employment eligibility verification document form upon hire

About the company

Base Operations decodes the world’s threat landscape into actionable security insights. They developed their technology at Harvard and MIT and use cutting-edge AI.