Back to jobs
Data Engineer
Job description
Data Engineer - London - Hybrid - Up to £100,000
I am currently working with a Leading Lloyd's Syndicate who are looking for a Data Engineer to build and run the core components of an effective Azure Data, Integration and Analytics/AI Platform. This position is paying up to £100,000 and would be based in the office 2/3 days per week.
Duties and Responsibilities
- Leading and actively participating in hands-on design, development, and code review sessions, providing technical guidance to junior team members.
- Creating and maintaining documentation of data developments, best practices, and technical solutions.
- Designing, developing, and supporting core data engineering services such as data orchestration, data pipelines, ETL/ELT processes, data lakes, data warehouses, semantic models, and code deployment.
- Conducting impact assessments for changes to live systems and processes.
- Ensuring minimal technical debt and identifying opportunities for continuous improvement.
- Delivering high-quality work, including testing of data products, with a focus on automation where possible.
- Collaborating closely with the IT team and broader organization to govern and protect data, ensuring that all new developments align with best practices, technological standards, and agreed-upon designs.
- Keeping up-to-date with technological trends, state-of-the-art platforms, and industry advancements to provide input on the organization's strategic roadmap.
- Promoting innovation by rapidly building proofs of concept to validate new ideas and concepts.
Skills and Experience
- Strong Azure data engineering expertise, contributing to platform growth while building deep technical knowledge of systems over time.
- Proven experience with Microsoft Data and Analytics components.
- Extensive experience in designing and building data platforms, including data warehouses and lakes.
- Comprehensive experience with the full data development lifecycle, including coding, testing, and managing code repositories using standard branching strategies and automated deployment methods.
- Familiarity with deployment activities such as release management, environment controls, CICD orchestration, DevOps, and ML Ops pipelines.
- Advanced skills in Structured Query Language (SQL) and a solid understanding of database administration.
- A commitment to developing world-class, reliable data solutions for critical business processes.
- The ability to quickly assimilate new and complex data sources, technologies, and concepts.
- Experience in the insurance industry is an advantage.
If you would be interested in discussing this opportunity please apply now!!!