Cuesta Partners
Databricks Architect | Latam
LATAM | Colombia, Remote. Posted 3 months ago
The role
You will design and architect scalable Databricks-based solutions for enterprise clients. You will lead end-to-end cloud data platform implementations and provide technical leadership to data engineering teams.
What you will do
- Design and architect scalable Databricks-based solutions for enterprise clients
- Lead end-to-end cloud data platform implementations across AWS and/or Azure
- Design and build production pipelines using Databricks Workflows and Spark Declarative Pipelines
- Design scalable ETL/ELT pipelines using Spark, PySpark, and Databricks Workflows
- Partner directly with client stakeholders to understand business needs
- Provide technical leadership and guidance to data engineering teams
- Implement CI/CD pipelines and infrastructure-as-code for Databricks resources
- Drive collaborative development through Git workflows, pull requests, and code reviews
- Collaborate cross-functionally with analytics, engineering, and business teams
- Serve as the primary technical point of contact for clients, including C-level executives
Required qualifications
- 6+ years of experience in Data Engineering, Cloud Architecture, or related roles
- 3+ years of hands-on experience with Databricks
- Strong proficiency in PySpark, Spark SQL, Python, and SQL
- Deep experience with Delta Lake, Unity Catalog, Delta Live Tables, and Databricks Jobs
- Proven experience delivering Databricks projects in a consulting or professional services environment
- Strong understanding of data lake concepts and formats (Delta, Iceberg, Parquet, etc.)
- Experience designing and managing Unity Catalog for governance, access control, and lineage
- Familiarity with medallion architecture (bronze/silver/gold) patterns
- Hands-on experience with Git version control, pull requests, code reviews, and collaborative development workflows
- CI/CD and infrastructure-as-code for Databricks resources (Terraform, Asset Bundles, GitHub Actions)
- MLflow experience: experiment tracking, model registry, deployment, and observability
- Cloud platform experience
Nice to have
- Databricks certifications (Data Engineer Associate or Professional, Machine Learning Associate or Professional, Data Engineer Associate or Professional or ML Engineer Associate or Professional)
- Experience with agentic AI workflows, including agents, skills, and tools on the Databricks side (Agentbricks), as well as LangChain and Claude agentic workflows
Benefits
- Comprehensive Health Plan: Prepaid health coverage for you and your immediate family
- Team Engagement Activities: Fun and meaningful events to connect and grow together
- Annual Performance Bonus
- Growth Opportunities: Career development and advancement within the company
- Flexible Work: Hybrid model with mostly remote work and one day per week in the office
- Paid Time Off & Holidays
Before you apply
- You MUST BE located in Colombia (Bogotá, Medellin, Barranquilla or Cali)
About the company
Cuesta Partners is looking for a Databricks Architect to lead the delivery of data engineering solutions in a client-facing environment.