Data Engineer-Data Flows
- Posted 13 March 2025
- LocationLondon
- Job type Permanent
- Reference69903
Job description
Job Title: Data Engineer (Data Flows)
Location: London- 2days/week
Duration: Permanent
Energy Sector Client Experience Required
Job Description
We are seeking a Data Engineer with a strong emphasis on energy industry expertise to join our dynamic team. This role is ideal for candidates who possess deep knowledge of energy sector operations, data flows, and business processes, while being adept at applying this industry insight to support data-driven decision-making. The successful candidate will bridge the gap between technical data management and energy sector strategy, enabling the organization to leverage data as a critical asset.
As a Data Engineer , you’ll be part of an Agile and skilled team of other engineers and analysts working on delivering best in class data solutions for our customers. Working with powerful data processing technologies, you will combine the power of your industry knowledge and industry data flows with the full capabilities of AWS, creating the ultimate data services platform.
Responsibilities
• Work as part of a cross-functional team to design, develop and deploy complex data solutions.
• Provide expert technical advice and recommend solutions to the development resources in the planning, strategizing, and the execution of high profile and complex data processing initiatives.
• Consistently develop with performance in mind to optimize end user experience.
• Work with architects and senior team members to identify new tools and technologies where applicable to expand customer offerings.
• Research and take advantage of new technology to improve and expand solutions.
• Participate in peer code reviews, troubleshoot and correct software defects.
• Work with the internal testing team to ensure appropriate testing is built into the development and ongoing delivery.
• Develop efficient queries to retrieve appropriate datasets from relational databases
• Design, implement and maintain performance of reliable data pipelines and integrations that feed various applications, using both structured and unstructured data
• Create, implement, and maintain data transformation processes
Skills & Knowledge you will need:
• Proven experience in the energy sector with a focus on data-driven projects
• Strong understanding of energy industry concepts, terminology, and key performance indicators.
• Energy Industry Knowledge, specifically around D-Flows their purpose and content.
• Familiarity with data analysis tools and visualization platforms (e.g., Power BI, Tableau) is a plus, but core technical programming skills are secondary to industry knowledge.
• SQL coding skills.
• Ability to translate complex energy data sets into actionable insights for non-technical stakeholders.
• Excellent communication and collaboration skills, with the ability to work effectively across multidisciplinary teams.
• Experience with cloud computing such as Azure or AWS
Nice to have:
• Experience in data modelling.
• Experience of working with large datasets.
• Experience with cloud computing such as Azure or AWS
• SDLC or Product Development experience
• Pentaho Experience
• Knowledge of BI tools such as Tableau
• Python in Data Engineering Experience
• Vertica Experience
• Experience with developing REST APIs and microservices
• Experienced in relational database design
Priyanka Sharma
Senior Delivery Consultant
Office: 02033759240
Email: [email protected]