Data Platform Engineer

About RDC

Rich Data Co (RDC) delivers the future of credit today. We believe credit should be accessible, fair, inclusive, and sustainable. We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to make accurate decisions in a clear and explainable way. Global leading financial institutions use our AI decisioning platform to offer credit in line with customers' needs and expectations.

Purpose of Role

The Data Platform Engineer is responsible for building, operating, and supporting scalable and reliable data pipelines, dashboards, and reporting tools for data-driven decision-making across the organisation. This hybrid role combines core data engineering skills with operational responsibilities. You will work on cloud-based platforms, relational and NoSQL databases, and modern visualisation tools to ensure high data quality, availability, and performance.

Key Responsibilities

1. Design, develop, and maintain ETL pipelines using Apache Airflow to ensure efficient data processing.
2. Build and troubleshoot Python-based data processing scripts for transformation, ingestion, and automation.
3. Support the daily operation of data systems, including pipeline health monitoring, incident response, and root cause analysis.
4. Collaborate with internal teams to define data requirements, integrate multiple sources, and ensure end-to-end data accuracy.
5. Perform data validation, profiling, and QA checks across pipelines and environments.
6. Develop and maintain dashboards and reports using JavaScript, SQL, and BI tools such as Power BI or Tableau.
7. Document data workflows, standards, and pipeline logic for operational consistency.
8. Contribute to the continuous improvement of reliability, observability, and performance in data systems.

Requirements

Experience

Essential

1. A minimum of 5+ years of hands-on experience in data engineering, data operations, or data platform roles.
2. Proven experience with Apache Airflow for building, scheduling, and monitoring ETL pipelines.
3. Strong Python programming skills for data processing, automation, and pipeline support.
4. Experience supporting and debugging production-grade data pipelines in cloud environments.
5. Solid SQL skills with the ability to write and optimise complex queries for reporting and validation.
6. Familiarity with monitoring tools and logs.
7. Experience working with RDBMS and NoSQL databases.
8. Demonstrated ability to respond to operational issues, analyse data quality anomalies, and implement remediation.
9. Experience with agile project delivery and managing both sprint-based tasks and day-to-day support incidents.

Desirable

1. Experience in cloud environments such as AWS, GCP, or Azure.
2. Exposure to DevOps practices, including CI/CD pipelines for deploying data workflows.
3. Experience supporting dashboard reliability and data refresh monitoring.
4. Familiarity with data warehouse solutions and dimensional modelling concepts.
5. Background supporting data governance, audit logs, and regulatory compliance for operational data.

Knowledge and Skill

Essential

1. A deep understanding of ETL/ELT processes, including pipeline dependencies, failure points, and logging.
2. Strong proficiency in SQL and Python, including pandas and PySpark.
3. Familiarity with JavaScript and frontend dashboard development frameworks.
4. Understanding of data quality checks, schema evolution, and operational alerting.
5. Experience using BI/reporting tools for visualisation.
6. Comfortable working with APIs and integrating real-time or batch data feeds.
7. Ability to document data architecture, dependencies, and support runbooks clearly.
8. Excellent communication and collaboration skills.

Join Our Team

• Work at a fast-growing global AI company - grow your skills, capabilities, and gain AI and global experience.
• High performance team - work alongside some of the best product teams, data scientists, and credit experts in the industry.
• Vibrant team culture - join an innovative and agile team who celebrates wins and solves problems together.
• Work-life balance - highly flexible working arrangements - work how's right for you.
• Financial inclusion - be part of a company striving for global financial inclusion and driving the future of credit.