Quintoandar
Grupo QuintoAndar | Staff Data Engineer
São Paulo, São Paulo, Brazil. Posted 9 months ago
The role
The Data Engineer Specialist will design, build, and maintain a scalable, secure data platform and end-to-end data pipelines. This role empowers Data Analysts and Data Scientists to deliver insights and drive strategic decision-making.
What you will do
- Build and maintain a high-performance data platform
- Create and edit data pipelines with business logic, aggregation, and cleaning
- Create data modeling and transformation workflows
- Manage the entire code development lifecycle including deployment, documentation, and security
- Investigate inconsistencies and perform data troubleshooting
- Enable teams to use data through self-service tools and well-modeled datasets
- Align with stakeholders to propose scalable and incremental solutions
- Conduct PoCs and benchmarks to determine tool selection
- Contribute to defining the strategic vision
- Advocate for data analytics and engineering and act as a technical reference
Required qualifications
- Specialist in Big Data technologies and solutions (Spark, Hadoop, Hive, MapReduce)
- Knowledge of multiple languages (YAML, Python)
- Experience with Airflow, Spark, AWS and Databricks
- Strong foundation in software engineering principles
- Experience with columnar storage solutions and/or data lakehouse concepts
- Proficiency in Python, or one of the main programming languages
- Strong knowledge in optimizing SQL query performance
- Experience in building multidimensional data models (Star and/or Snowflake schema)
- Understanding of the data lifecycle (lineage, governance, privacy, retention, anonymization)
- Knowledge in infrastructure areas (Kubernetes, ECS, CI/CD, Terraform, Prometheus, Grafana)
- Proficiency in English
- Excellent communication skills
Nice to have
- Participated in building large-scale data platforms for big data sets and teams using Spark, Trino, Hive, Atlas, Ranger, etc.
- Experience in building semantic layers
Benefits
- Competitive salary
- Profit sharing
- Meal allowance
- Health insurance
- Dental plan
- Life insurance
- Childcare subsidy and Atypical Parenthood subsidy
- Wellhub
- Home office allowance
- Employee assistance program (mental health, social, legal, and financial support)
- Extended parental leave
- Day off on birthday, Mother’s Day, and Father’s Day
Before you apply
- Complete the application step
- Watch for emails from the @quintoandar.com.br domain
About the company
Grupo QuintoAndar is the largest real estate ecosystem in Latin America. It has a diversified portfolio of brands and solutions across different countries in Latin America.