Johannesburg, South Africa
1 day ago
Data Engineering Lead

Let's Write Africa's Story Together!

Old Mutual is a firm believer in the African opportunity and our diverse talent reflects this.

Job Description

ROLE OVERVIEW

Develop data products & data warehouse solutions in on-premises and cloud environments using cloud-based services, platforms and technologies. Dynamic and results-driven Lead Stream & Data Engineer with extensive experience in designing, developing, and deploying high-performance, re-usable streaming applications using Apache Kafka, Apache Flink and Java and batch processing pipelines using Python, Dbt and Apache Airflow.

Proven expertise in building scalable data pipelines and real-time processing systems that enhance operational efficiency and drive business insights. Strong background in microservices architecture, cloud technologies, and agile methodologies.

KEY RESULT AREAS

Operational Delivery

· Assist with clarification of technical requirements & implementation process with PO’s

· Assist data engineering team with product and architectural knowledge

· Drive good technical architecture

· Support and guidance of the tech team with resolution of PO tickets

· Support and implementation of technical strategy

· Ensuring data is available to businesses in a secure, actionable and reliable way;

· Raising the bar on data quality, data governance, reliability and engineering excellence

· Preparing the data sets that will ultimately deliver valuable insights to the business

· Enabling the discovery and exploration by analysts, BI, data science and business users

· Identifying opportunities for improvements and putting energy behind turning them into action

Technical Skills

Programming Languages: Proficient in Java (Java SE 8/11), with a solid understanding of object-oriented programming principles and Python 3

· Streaming Technologies: Extensive experience with Apache Kafka, including Kafka Streams API for real-time data processing, producer/consumer development, and stream management and expertise in Apache Flink.

· Desirable skills: Decodable and K8’s, Confluent.

· Frameworks: Deep knowledge of Spring Boot for building RESTful services and microservices architectures; adept at using Spring Cloud for distributed systems.

· Database Management: Skilled in integrating various databases (e.g., NoSQL ) with streaming applications to ensure efficient data storage and retrieval.

· Cloud Platforms: Hands-on experience deploying applications on AWS, utilizing services such as EC2, S3, RDS, and Lambda for serverless architectures.

Technical Leadership

· Participate in the engineering and other discipline’s community of practice

· Technical leadership and mentorship

· Developing and monitoring of data engineering standards and principles

· Lead technical delivery within teams and provide oversight of solutions

· Share AWS knowledge and practical experience with community

· Challenge and contribute to development of architectural principals and patterns

Delivery Management

· Follow and participate in defined ways of work including, but not limited to, sprint planning,

· backlog grooming, retrospectives, demos and PI planning

EXPERIENCE

Experience of developing solutions in the cloud

· At least 5+ years' experience with designing and developing Data Pipelines for Data Ingestion or Transformation using AWS technologies

· Experience in developing data warehouses and data marts

· Experience in Data Vault and Dimensional modelling techniques

· Experience working in a high availability DataOps environment

· Proficiency in AWS services related to data engineering, such as AWS Glue, Athena, and EMR. Strong programming skills in languages like Python and Java.

· Overseeing the implementation of CI/CD pipelines

· Github

· Designing and implementation of scalable streaming architectures using technologies such as Apache Kafka, Apache Flink, or AWS Kinesis to handle real-time data ingestion and processing.

· Orchestration with Apache Airflow

· Dbt core

QUALIFICATIONS

· Bachelor’s Degree in Computer Science or similar fields like Information Systems, Big Data, etc.

· AWS Data Engineer Certification would be advantageous

· Related Technical certifications

The appointment will be made from the designated group in line with the Employment Equity Plan of Old Mutual South Africa and the specific business unit.

Responsible for overseeing the data engineering practices. Guides technical design and the development and maintenance of data pipelines and other digital applications or services.

ResponsibilitiesOrganizational Capability Building

Evaluate the capabilities of staff within the department to identify gaps and prioritize development activities. Implement the organization's formal development frameworks within the area of responsibility. Coach and mentor others to support the development of the organization's talent pool.

Performance Management

Manage and report on performance within the department or area of responsibility; set appropriate performance objectives for direct reports and hold individuals accountable for achieving them; take appropriate corrective action where necessary to ensure the achievement of annual business objectives.

Leadership and Direction

Identify and communicate the actions needed to implement the function's strategy and business plan within the business area or department; explain the relationship to the broader organization's mission, vision, and values; motivate people to commit to these tenets and do extraordinary things to achieve local business goals.

Information Security

Define business impact of security incidents, and identify and drive recommendations for change to prevent similar incidents.

Analysis of "As Is" and "To Be"

Document the most complex "as is" and "to be" processes and describe the changes required to migrate to the "to be" capability to record accurately the change required.

Databases Installation

Ensure installation and testing of complex and interrelated databases and associated products to ensure they are suitable for use and meet customer requirements.

Technical Developments Recommendation

Lead the discussion and recommendation of more complex or innovative technical developments to improve the quality of the website/portal/application software and supporting infrastructure to better meet users’ needs.

Enterprise Infrastructure Modernization

Lead definition of architectural standards for all technology services and components (applications, data, integration, technology, security, business). Present business and IT leaders with signature-ready recommendations for adjusting policies and projects to achieve target business outcomes that capitalize on relevant digital disruptions.

Database Specifications

Approve complex database specifications, ensuring that all agreed standards and protocols are followed and data integrity is preserved. Suggest improvements for standards and protocols for database specifications.

Infrastructure and Network Development and Maintenance

Plan future and optimize current infrastructure and network resources, leading a large team in a global setting to deliver business-critical systems and networks.

Data Architecture

Translate data and analytics strategy and vision into data architecture, defining and implementing models, rules, and standards for design and governance.

Skills

Action Planning, Cloud Computing, Cloud Infrastructure Management, Computer Network Security, Current State Assessment, Database Queries, Data Classification, Data Compilation, Data Compression, Data Encoding, Data Modeling, IT Architecture, IT Network Security, Test Case Management, Wireless Network Management

Competencies

Balances Stakeholders

Business Insight

Courage

Cultivates Innovation

Drives Results

Ensures Accountability

Manages Complexity

Optimizes Work Processes

Education

NQF Level 9 – Masters

Closing Date

20 January 2025 , 23:59

The appointment will be made from the designated group in line with the Employment Equity Plan of Old Mutual South Africa and the specific business unit in question.

Old Mutual Limited is pro-vaccination and encourages its workforce to be fully vaccinated against Covid-19.

All prospective employees are required to disclose their vaccination status as part of the recruitment process.

Please refer to the Old Mutual’s Covid-19 vaccination policy for further detail. Kindly note that Old Mutual reserves the right to reinstate the requirement to vaccinate at any point if it is of the view that it is imperative to do so.

The Old Mutual Story!

Confirm your E-mail: Send Email