SQL Data Engineer

Job purpose and background

CDP is looking for a capable sql data engineer who is passionate about the power of data to solve environmental issues. The sql data engineer will be shaping the delivery by collaborating with data architects and modellers to contribute to the acquisition of corporate data requirements, documenting them according to the required standards utilising the prescribed methods and Azure data tools, in order to build our centralised data platform.

Develop, construct, test and maintain architectures such as data pipelines and large-scale data processing warehouses. Leveraging industry best practice while delivering changes, such as agile backlogs, code repositories, automated builds, testing and releases. Ensure data scientists can pull relevant data sets for their analyses. Implement data pipelines to connect operational systems, data for analytics and BI systems. Re-engineer manual data flows to enable scaling and repeatable use.

Develop data set processes for data modelling, mining and production. Work closely with data architects (to determine what data management systems are appropriate) and data scientists (to determine which data are needed for analysis). Provide clean, usable data to the business through the data platform in accordance with governance.

Analyse, design, plan, execute and evaluate data requirements to support business activities and projects. This role is central in ensuring delivery of world-class digital products and changing the delivery culture in CDP.

About CDP's Data team:

The Data Team’s primary remit is to improve the usability of the climate change, water, forests and cities data disclosed to CDP through robust and transparent methods. The team will create sustainable data pipelines for data quality monitoring, data cleaning, reporting and data science modelling. Harmonised data collected from external sources will enrich the data assets’ value and enhance accessibility for CDP’s stakeholders. The team will produce value-adding insight delivering it through data products that help internal and external stakeholders to better understand the quantitative and qualitative results of their actions. This in turn helps stakeholders to make data-led decisions and optimise for all constraints. Through every stage the data assets are governed by the industry practice standards in a robust and transparent manner.

Key responsibilities include:

• Manage the investigation of corporate data requirements, documenting them according to the required standards utilising the prescribed methods and tools
• Implement data flows to connect operational systems, data for analytics and BI systems. Re-engineer manual data flows to enable scaling and repeatable use
• Work closely with data architects (to determine what data management systems are appropriate) and data scientists (to determine what data is needed for analysis).
• Tackle problems associated with database integration and unstructured data sets
• Ensure that those using the data structures and associated components have a good understanding and that any queries are dealt with promptly and efficiently
• In liaison with the information management or IT management functions, contribute to the development and maintenance of corporate data standards

Required skills and experience:

• Strong technical process understanding regardless of technology
• Wide range of strong technical skills (i.e. Azure Devops, Azure Data Factory, Data Bricks, SQL, python)
• Core SQL Competencies – SSMS, SSIS, T-SQL, Stored Procedures
• ADF Pipelines to build sql databases
• Efficient in building ETL processes for enterprise solutions
• Strong Software delivery methods and knowledge

Desired skills and experience (optional)

• Digital delivery – has a track record of working on DevOps delivery
• Exposure in Climate Change data legislation, practices and stakeholders
• Experience in Environmental related industries i.e Water, Energy, Forestry related
• Communication and presentation skills
• Understanding of architecting solutions taking into account wider considerations
• Structured problem solving techniques

This is a full-time, fixed-term contract role for up to 12 months. It is based at CDP’s London office reporting to the Enterprise Data Architect.

Salary and benefits: Level 5 role.30 days holiday plus bank holidays. Generous non-contributory pension provision, annual discretionary bonus (depending on company performance), Employee Assistance Program, life assurance, Training and development, Flexible working opportunities and others.

We will consider this role on a consultancy basis.

Interested applicants must be eligible to work legally in the United Kingdom.

Before you apply

We’ll only use the information you provide to process your application. For more details on how we use your information, see our applicants privacy notice. By emailing us your CV and covering letter, you are permitting CDP to use the information you have provided for recruitment purposes.

To apply please email your CV and a covering letter setting out how you meet the required skills and experience or key responsibilities, which should be no more than two pages, to [email protected] with ‘DI-2.3 SQL Data Engineer, Firstname Surname’ in the subject. The deadline is 6 PM GMT on April 9.