We are looking for an Azure Data Engineering Technical Lead with Python and Spark skills to lead and mentor a team of data engineers in designing, developing, and implementing data solutions on the Microsoft Azure cloud platform.
You will be responsible for overseeing the creation and maintenance of data pipelines, data storage solutions, data processing, and data integration using various Azure data services and frameworks.
YOUR NEW KEY RESPONSIBILITIES:
Lead and mentor a team of data engineers in delivering high-quality data solutions using Python and Spark
Design and architect data solutions using Azure data services and frameworks, such as Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage, and more
Work with stakeholders and product owners to understand the data requirements and provide data solutions that enable data-driven decision-making inside the organization
Troubleshoot, test, and deploy data solutions in Azure environments
Provide support and training to users and junior data engineers
Stay updated with the latest Azure data technologies and best practices
Ensure that the data solutions are scalable, reliable, secure, and compliant with the organization’s standards and policies
ARE THESE YOUR SECRET INGREDIENTS?
University Bachelor’s or Master’s degree in IT, Engineering, or Economics.
Experience in leading and managing data engineering teams or projects
Proficient in Python and Spark for data engineering tasks
Expert knowledge of Azure data services and frameworks, such as Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage
Familiarity with data warehousing and business intelligence concepts and methodologies
