About the role
Data Engineer
London - Hybrid working
£65,000 - £75,000
A global leading HR staffing organisation based in London is currently looking to recruit a Data Engineer who will play a crucial role in designing, developing, and maintaining the data infrastructure that powers innovative solutions within the client. We require an engineer who has a passion for data and has a good background in Azure, synapse, Databricks, SQL, Python and DataOps. This is a fantastic opportunity for a Data Engineer to gain exposure to different business areas from Visualisation, Machine Learning/ AI and governance. Alongside this my client is going to be going through a cloud migration to Azure.
Responsibilities:
- Collaborate with cross-functional teams to understand data requirements and design efficient data pipelines.
- Develop and maintain scalable data models and databases.
- Design and implement data integration and ETL/ELT processes.
- Optimise and tune data storage and retrieval processes.
- Collaborate with the Data Science team to implement machine learning algorithms and AI models.
- Ensure data quality and integrity throughout the data lifecycle.
- Monitor and troubleshoot data pipelines to ensure optimal performance.
- Stay up-to-date with the latest trends and technologies in data engineering.
Requirements:
- Strong hands-on experience with Azure, Synapse, and Databricks
- Excellent programming skills in SQL and Python
- Proficiency in building and optimising data pipelines, architectures, and datasets
- Familiarity with Medallion architecture and data lakes.
- Experience with data integration and ETL/ELT processes.
- Knowledge of DataOps principles and experience with CI/CD tools
- Strong problem-solving and troubleshooting skills.
- Excellent communication and collaboration skills.
- Ideally we would be looking for 2-5 years' experience in a similar role of data engineer or analytics engineer.