Senior Data Engineer
London, Birmingham, Remote
Salary up to £65,000 per annum
An exciting opportunity has arisen to join a global organisation within the Assurance space. As the new Senior Data Engineer you will play a pivotal role within the Data team of the Digital and Information Function, assuming a leadership position in ensuring the availability, integrity, quality, and accuracy of data.
Key responsibilities include:
- Ownership and delivery of the design, development and maintenance of highly scalable and robust data pipelines and workflows utilising Azure Data Factory and Databricks.
- Lead data transformation and integration efforts to augment data from diverse sources, ensuring data governance and regulatory compliance throughout the process.
- Establish and enforce data quality standards through the implementation of rigorous data validation processes, ensuring the utmost accuracy, completeness, and consistency of the data ecosystem.
- Serve as a key liaison between cross-functional teams, including data scientists, analysts, and business stakeholders, to comprehensively understand data requirements, conduct User Acceptance Testing (UAT), and deliver tailored solutions that align with business objectives.
- Proactively monitor pipeline performance, swiftly identifying and resolving any potential issues to uphold seamless data processing operations and minimize downtime.
- Drive comprehensive documentation of data pipelines, workflows, and procedures to foster knowledge sharing and ensure ongoing system maintainability and scalability.
Skills required:
- Hands-on advanced experience in designing, developing, and managing data pipelines using Azure Data Factory.
- Strong working knowledge of Databricks for data processing, analytics and Machine learning.
- Advanced experience with data modelling techniques and data warehousing concepts.
- Advanced proficiency in SQL for data querying and manipulation and good knowledge of Python.
- Ability to work effectively in a fast-paced, dynamic environment and manage multiple priorities, following the Agile way of working
- Ability to lead and analyse complex data problems and propose effective solutions.
- Excellent communication skills with the ability to collaborate effectively with cross-functional teams.
This represents an excellent opportunity for a Data Engineer with strong hands on experience within the Azure stack, who also has some leadership/mentorship experience. There is plenty of progression available for the right person.
If you are interested, please apply for full details.
