Senior Data Engineer - Azure
Location: | Johannesburg |
Remote work: | Only remote work |
Type: | Permanent |
Reference: | #NG59096 |
Company: | E-Merge IT Recruitment |
A technology and analytics-driven consulting company empowering clients by solving real-world business challenges that deliver tangible value, with core capabilities spanning data science, data engineering, and software engineering, is seeking a Senior Azure Data Engineer. This role will involve developing best practices and driving improvements in data engineering across various industries such as mining, telecoms, retail, and financial services.
Responsibilities:- Analyse and organise raw data
- Design data engineering solutions to meet business requirements
- Build scalable data pipelines that clean, transform, and aggregate data from different sources using appropriate tools and technologies
- Collaborate with data scientists to prepare datasets for analytical modelling
- Identify ways to enhance data quality and reliability
- Manage the technical delivery of projects
- Mentor junior data engineers
Qualifications and experience:- Graduate or postgraduate degree in computer science, information technology, statistics, engineering, or a related technical field
- Two to six years of experience with relational SQL databases
- Solid understanding of Apache Spark as a distributed data processing framework
- Experience in designing, implementing, and performance-tuning solutions in Apache Spark
- Experience in complex data warehouse and data lake design
- Experience in building, optimising, and managing data pipelines for large and complex datasets
- Experience with Azure Storage/Data Lake, Azure SQL Database, Azure Data Factory, Azure Databricks, and Azure Synapse Analytics to implement data pipelines and analytical solutions
- Experience in Python would be beneficial
Reference number for this position is NG59096. This is a permanent position in Johannesburg offering a salary of R900,000 to R1.1 million CTC, negotiable based on experience. For more details, e-mail Nokuthula at
nokuthulag@e-merge.co.za or call her at 011 463 3633 to discuss this and other opportunities.
Are you ready for a change of scenery? E-Merge IT Recruitment is a niche recruitment agency that offers candidates options to successfully place the right people with the right companies, in the right roles. Check out the E-Merge IT website at
www.e-merge.co.za for more great positions.
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!
Posted on 04 Oct 14:01, Closing date 3 Dec