Quintoandar

Grupo QuintoAndar | Staff Data Engineer

São Paulo, São Paulo, Brazil. Posted 9 months ago

The role

The Data Engineer Specialist will design, build, and maintain a scalable, secure data platform and end-to-end data pipelines. This role empowers Data Analysts and Data Scientists to deliver insights and drive strategic decision-making.

What you will do

  • Build and maintain a high-performance data platform
  • Create and edit data pipelines with business logic, aggregation, and cleaning
  • Create data modeling and transformation workflows
  • Manage the entire code development lifecycle including deployment, documentation, and security
  • Investigate inconsistencies and perform data troubleshooting
  • Enable teams to use data through self-service tools and well-modeled datasets
  • Align with stakeholders to propose scalable and incremental solutions
  • Conduct PoCs and benchmarks to determine tool selection
  • Contribute to defining the strategic vision
  • Advocate for data analytics and engineering and act as a technical reference

Required qualifications

  • Specialist in Big Data technologies and solutions (Spark, Hadoop, Hive, MapReduce)
  • Knowledge of multiple languages (YAML, Python)
  • Experience with Airflow, Spark, AWS and Databricks
  • Strong foundation in software engineering principles
  • Experience with columnar storage solutions and/or data lakehouse concepts
  • Proficiency in Python, or one of the main programming languages
  • Strong knowledge in optimizing SQL query performance
  • Experience in building multidimensional data models (Star and/or Snowflake schema)
  • Understanding of the data lifecycle (lineage, governance, privacy, retention, anonymization)
  • Knowledge in infrastructure areas (Kubernetes, ECS, CI/CD, Terraform, Prometheus, Grafana)
  • Proficiency in English
  • Excellent communication skills

Nice to have

  • Participated in building large-scale data platforms for big data sets and teams using Spark, Trino, Hive, Atlas, Ranger, etc.
  • Experience in building semantic layers

Benefits

  • Competitive salary
  • Profit sharing
  • Meal allowance
  • Health insurance
  • Dental plan
  • Life insurance
  • Childcare subsidy and Atypical Parenthood subsidy
  • Wellhub
  • Home office allowance
  • Employee assistance program (mental health, social, legal, and financial support)
  • Extended parental leave
  • Day off on birthday, Mother’s Day, and Father’s Day

Before you apply

  • Complete the application step
  • Watch for emails from the @quintoandar.com.br domain

About the company

Grupo QuintoAndar is the largest real estate ecosystem in Latin America. It has a diversified portfolio of brands and solutions across different countries in Latin America.

Grupo QuintoAndar | Staff Data Engineer at Quintoandar | JobZoey