– Design and develop robust, scalable, and efficient data pipelines to collect, process, and transform data from various sources.
– Implement and maintain data warehousing and data lake solutions to ensure reliable and secure storage of data.
– Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
– Optimise data processing workflows and implement strategies to improve performance and reliability.
– Develop and maintain documentation for data models, pipeline processes, and operational procedures.
– Monitor and troubleshoot data issues, identifying and resolving bottlenecks and data quality problems.
– Contribute to the continuous improvement of our data architecture and engineering practices.