Data Engineer

Cape Town, SOUTH AFRICA Engineering Full-Time

ETL AWS Cloud Model Building Bash Python Scripting PySpark CI/CD NoSQL

At Orderin we are data and model driven. We get key insights from the analysis of data generated in our daily operations. The company's data footprint is growing and serving curated data and data based models to different business units becomes complex. The data engineer will ensure the link between data production and data consumption is smooth by creating and maintaining data pipelines. They will integrate new data sources into data lakes, data warehouse or data marts. In addition, they will work closely with data scientists in building data flows in machine learning models, and serving them to relevant stakeholders. They will be in charge of creating and/or maintaining data processing subsystems that manage and orchestrate large volumes of data streams at any required speed.

Data engineering responsibilities will include:

Implementing and maintaining data pipelines
Data modelling and ETL
Supporting data processing and transfer
Ensuring data quality and consistency (data validation)
Assisting with data storage strategies
Data provisioning
Documenting data and models (i.e. metadata, data provenance and lineage)
Creating data/features for analysis and model building

Requirements

Data modelling
Good software engineering skills
Knowledge of big data engineering technologies: data processing frameworks, data streaming technologies
Database management and data warehousing: Relational database, NoSQL, and in-memory databases.
Cloud technologies: AWS data services, Google Cloud (good to have)
Data ingestion and integration
ETL
CI/CD
PySpark
Scripting languages (Bash, Python, etc.)
At least 2 years of experience in the field of data engineering.

OrderIn

Who We Are Orderin is one of South Africa’s leading on-demand delivery services. We deliver our customers’ favourite meals, beverages and other goods right to their doorstep, all in a matter of minutes… and we do it with mad amounts of love. It's all about saving time and making everyone's lives a little easier and a lot more convenient. The on-demand delivery industry is rapidly transforming and Orderin has been at the forefront of this movement. Orderin operates in South Africa’s major metropoles and is continuously increasing its reach. We're constantly improving and developing our systems and marketing strategies to ensure we're ahead of the digital game. Why Orderin? We’re building the leading on-demand delivery service in SA, and this is your chance to make a massive impact on that mission. We’re expanding rapidly and growing our dedicated team to anticipate changes in trends and in the market, so that we continue to lead the way. This industry presents huge growth opportunities which makes it an exciting space to be in.

© LaunchAfrica 2024

Top Locations