Senior Data Engineer

The role

The Senior Data Engineer will build data products and services alongside analysts, data scientists, and engineers. This role involves designing, developing, and maintaining scalable batch and real-time data pipelines and data infrastructure.

What you will do

• Work alongside a talented team of analysts, data scientists and engineers to build data products and services.
• Design, develop and maintain robust, scalable and observable batch and real-time data pipelines.
• Architect, build and maintain the data infrastructure at Payrails.
• Advocate for and implement data governance and security best practices.
• Contribute to tooling that improves data quality, CI/CD workflows, and data observability.
• Collaborate with cross-functional teams to understand requirements and design optimal solutions.

Required qualifications

• 5-7 years of extensive experience in data engineering roles building reliable, scalable and observable production-grade data pipelines and services.
• Strong proficiency in Python.
• Proficient in SQL, data modelling and operating common OLTP (e.g. PostgresSQL) and OLAP databases (e.g. Snowflake, Bigquery) at scale.
• Develop and maintain data pipelines using workflow management platforms such as Apache Airflow.
• Knowledgeable of containerization technologies such as Docker and container orchestration platforms like Kubernetes.
• Communicate effectively and are proficient in English.
• Work independently and collaboratively in a fast-paced environment.

Nice to have

• Experience with GoLang
• Experience with real-time streaming technologies (e.g. Kafka, Kinesis) and distributed stream processing technologies (e.g. Apache Flink, Apache Beam, Kafka Streams)
• Familiarity working with infrastructure as code (e.g. Terraform)
• FinTech or payments domain experience

Benefits

• High impact and high velocity environment
• Chance to shape the story of a company and a category from the ground up
• Real ownership
• Product used by the best brands around the world
• Hybrid working with an office in the heart of New Cairo
• Regular team events, activities and off-sites
• Competitive salary and equity package
• 27 days of annual paid vacation

About the company

Payrails is a global payment software company helping leading enterprises to take control of their payment operations and maximize performance. They are building a deeply integrated meta layer that spans the entire payment lifecycle with a modular architecture.