Data Platform Engineer – Inventory & Observability

The role

You will build and operate data foundations for infrastructure inventory and observability capabilities. This involves designing data models and integrating data from multiple systems to create a reliable view of the platform.

What you will do

• Design and build data models for infrastructure and operational data.
• Integrate inventory, configuration, security and observability data from multiple systems.
• Keep key counts and metrics consistent across different consumers.
• Design data structures that are fast to query and easy to reason about.
• Automate data processing, validation and delivery.
• Build tooling to detect data-quality, freshness and performance issues.
• Investigate and resolve data-quality, freshness and performance issues.
• Collaborate with infrastructure, security, engineering and observability teams.
• Take ownership of systems end-to-end.

Required qualifications

• Experience building and operating production-grade data platforms, analytical data models, or large-scale data-processing applications.
• Strong SQL and dimensional or analytical data modelling experience.
• Strong Python software engineering experience.
• Demonstrated rigour around data correctness.
• Solid working understanding of infrastructure and observability concepts.
• Experience operating business-critical pipelines and diagnosing data, performance and reliability issues in production.
• Familiarity with knowledge graphs, ontologies and taxonomies.
• A strong bias towards automating repetitive work.
• Excellent problem-solving and communication skills.

Nice to have

• A background in data science, statistics or applied machine learning.
• Experience with SQL-based analytical platforms, dbt, object storage and data catalogues.
• Experience with infrastructure inventory or CMDB data, ownership and capacity/utilisation modelling.
• Experience with metrics, logs and vulnerability data, and with observability tooling.
• Experience with Superset or comparable BI and data-exploration tools.
• Experience with Linux, containers and GitLab CI/CD.
• Experience with AWS services and cloud SDKs.

Benefits

• Initiatives and programs to enable employees achieve a healthy work-life balance.

About the company

Qube Research & Technologies (QRT) is a global quantitative and systematic investment manager. It is a technology and data driven group implementing a scientific approach to investing.