Data Engineer - Azure
A technology and analytics driven consulting company empowering clients by solving real-world business challenges that deliver tangible value and count their core capabilities as spanning the disciplines of data science, data engineering and software engineering have an opening for an Azure Data Engineer to help develop best practices and drive improvements in data engineering across the business and across a wide range of industries such as mining, telco’s, retail and financial services.
Responsibilities:- Analyse and organise raw data
- Design data engineering solutions to meet business requirements
- Build scalable data pipelines that clean, transform and aggregate data from different sources using appropriate tools and technologies
- Collaborate with data scientists to prepare data sets for analytical modelling
- Identify ways to enhance data quality and reliability
- Manage technical delivery of projects
- Mentor junior data engineers
Qualifications and experience:- Graduate or postgraduate degree in computer science, information technology, statistics, engineering or related technical field.
- 2-6 years of relational SQL database
- Solid understanding of Apache Spark as a distributed data processing framework
- Experience in designing, implementing and performance tuning solutions in Apache Spark
- Experience in complex data warehouse and data lake design
- Experience in building, optimising and managing data pipelines for large and complex datasets
- Experience in Azure Storage / Data Lake, Azure SQL Database, Azure Data Factory, Azure Data bricks, Azure Synapse Analytics to implement data pipelines and analytical solutions
- Experience in Python would be beneficial
Reference number for this position is
NG59096 this is a
permanent position in
Johannesburg offering a salary of
R900,000 to R1.1m CTC salary negotiable based on experience. E-mail
Nokuthula on
az.oc.egrem-e@galuhtukon or call her for a chat on 011 463 3633 to discuss this and other opportunities.
Are you ready for a change of scenery? E-Merge IT recruitment is a niche recruitment agency. We offer our candidates options so that we can successfully place the right people with the right companies, in the right roles. Check out the E-Merge IT website
www.e-merge.co.za for more great positions.
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals
Posted on 15 Aug 14:14, Closing date 14 Oct
