Data Engineer

Posted 28 November 2024
Salary 100000
LocationLondon
Job type Permanent
Discipline Insurance
Reference55697
Contact NameJames O'Brien

Job description

Data Engineer - London - Hybrid - Up to £100,000

 

I am currently working with a Leading Lloyd's Syndicate who are looking for a Data Engineer to build and run the core components of an effective Azure Data, Integration and Analytics/AI Platform. This position is paying up to £100,000 and would be based in the office 2/3 days per week.

 

Duties and Responsibilities

  • Leading and actively participating in hands-on design, development, and code review sessions, providing technical guidance to junior team members.
  • Creating and maintaining documentation of data developments, best practices, and technical solutions.
  • Designing, developing, and supporting core data engineering services such as data orchestration, data pipelines, ETL/ELT processes, data lakes, data warehouses, semantic models, and code deployment.
  • Conducting impact assessments for changes to live systems and processes.
  • Ensuring minimal technical debt and identifying opportunities for continuous improvement.
  • Delivering high-quality work, including testing of data products, with a focus on automation where possible.
  • Collaborating closely with the IT team and broader organization to govern and protect data, ensuring that all new developments align with best practices, technological standards, and agreed-upon designs.
  • Keeping up-to-date with technological trends, state-of-the-art platforms, and industry advancements to provide input on the organization's strategic roadmap.
  • Promoting innovation by rapidly building proofs of concept to validate new ideas and concepts.

 

Skills and Experience

  • Strong Azure data engineering expertise, contributing to platform growth while building deep technical knowledge of systems over time.
  • Proven experience with Microsoft Data and Analytics components.
  • Extensive experience in designing and building data platforms, including data warehouses and lakes.
  • Comprehensive experience with the full data development lifecycle, including coding, testing, and managing code repositories using standard branching strategies and automated deployment methods.
  • Familiarity with deployment activities such as release management, environment controls, CICD orchestration, DevOps, and ML Ops pipelines.
  • Advanced skills in Structured Query Language (SQL) and a solid understanding of database administration.
  • A commitment to developing world-class, reliable data solutions for critical business processes.
  • The ability to quickly assimilate new and complex data sources, technologies, and concepts.
  • Experience in the insurance industry is an advantage.

 

If you would be interested in discussing this opportunity please apply now!!!