Data Engineer (Python/AWS)
Belfast - 3 Days Onsite - 2 Days Remote
12 Month Initial Contract
Inside IR35
We are seeking an experienced Data Engineer to join our client on a long-term assignment in Belfast. This role requires a skilled engineer with strong Python and AWS expertise who can build, optimise, and maintain high-quality data pipelines in a complex environment.
Key Responsibilities
- Design, develop, and maintain robust data pipelines and ETL processes.
- Build and optimise data workflows using Python.
- Manage workflow orchestration with Apache Airflow (MWAA).
- Perform data testing, validation, and produce data quality reports.
- Conduct data exploration and analysis to understand data structures prior to ETL development.
- Collaborate with system owners and stakeholders to gather requirements and deliver solutions.
- Monitor, troubleshoot, and ensure reliability and performance of data pipelines.
- Maintain clear documentation of data workflows, processes, and configurations.
Experience & Competencies
- 4+ years’ experience as a Data Engineer.
- Strong SQL/PLSQL skills across MS SQL and Oracle.
- Extensive hands-on experience coding in Python.
- Solid understanding of ETL concepts and data pipeline architecture.
- Knowledge of data lakes and associated architectures.
- Experience with Apache Airflow (MWAA).
- Familiarity with AWS Athena / PySpark (Glue).
If you would like immediate consideration, please send me an updated CV/contact details to jcaria@redglobal.com so we can discuss further or reach out to me through LinkedIn.