Data Engineer

No description

• Design, develop, and maintain scalable data integration and business intelligence solutions;
• Build and support ETL/ELT processes to extract, transform, and load data from multiple sources into enterprise data platforms;
• Collaborate with cross-functional stakeholders to gather requirements and deliver data solutions aligned with business objectives;
• Optimise and enhance existing data pipelines and workflows for performance, reliability, and scalability;
• Develop and maintain real-time and batch data processing pipelines using streaming technologies;
• Work closely with data architects to design and maintain data models, schemas, and database solutions;
• Ensure data quality, integrity, security, and governance standards are met across all data platforms;
• Monitor, troubleshoot, and resolve data engineering issues to minimise operational disruption;
• Stay up to date with industry best practices, emerging technologies, and modern data engineering approaches.

• Strong experience in Data Engineering, ETL/ELT development, and data integration;
• Proficiency in Python, SQL, Shell Scripting, and Scala;
• Experience with Spark, Airflow, and dbt;
• Knowledge of real-time data streaming platforms, ideally Kafka;
• Experience with AWS, Azure, and/or GCP;
• Strong understanding of PostgreSQL, MySQL, and Oracle;
• Familiarity with Docker;
• Excellent analytical, problem-solving, and stakeholder management skills.

• Contract employment.