Information TechnologyFull-TimeJunior-level(1-2 yrs)
Job Description
Role Overview
Data Engineering at Absa Bank is responsible for the central data platform that receives and distributes data across the bank. This is a multi-platform environment leveraging a blend of custom, commercial, and open-source tools to manage and support thousands of critical data-related jobs. These jobs are supported and updated in line with changes across the landscape to avoid disruption to downstream data consumers.
Job Description
In this role, you will be part of the Data Operations team responsible for supporting all applications within the Hadoop ecosystem. This role expands into maintaining changes on datasets and optimization activities for all applications, including new development. The successful candidate must understand basic programming to manage Big Data and facilitate the transfer of all data to Hadoop.
Responsibilities
Support pipelines end-to-end.
Build enhancements and lead new developments.
Build and deploy new data pipelines.
Identify optimization opportunities.
Improve recovery times in case of production failures.
Test prototypes and oversee handover to the Data Operations teams.
Attend and contribute to regular team and user meetings.
Responsible for the actual coding or programming of Hadoop applications.
Facilitate high-speed querying.
Requirements and Qualifications
Bachelor's Degree in Information Technology or a related field.
2+ years of experience working in a Big Data environment.
Experience optimizing and building big data pipelines, architectures, and data sets using Java, Scala, Python, Hadoop, Apache Spark, and Kafka.
Familiarity with the Hadoop ecosystem and its components (HDFS, MapReduce).
Solid experience in Big Data development utilizing SQL or Python.
Experience in Big Data development using Spark.
Experience in database design, development, and data modeling.
Preferred Skills and Attributes
Good knowledge in back-end programming, specifically Java.
Experience with development in a Linux environment and its basic commands.
Ability to write reliable, manageable, and high-performance code.
Basic knowledge of SQL, database structures, principles, and theories.
Knowledge of workflow/schedulers.
Strong collaboration and communication skills.
Strong analytical and problem-solving skills.
How to Apply
Interested and qualified candidates should apply online through the Absa Bank career portal by visiting absa.wd3.myworkdayjobs.com.
