Data Engineer

Posted on April 30th, 2021 | 45 days left to apply | 97 views

At Orderin we are data and model driven. We get key insights from the analysis of data generated in our daily operations. The company's data footprint is growing and serving curated data and data based models to different business units becomes complex. The data engineer will ensure the link between data production and data consumption is smooth by creating and maintaining data pipelines. They will integrate new data sources into data lakes, data warehouse or data marts. In addition, they will work closely with data scientists in building data flows in machine learning models, and serving them to relevant stakeholders. They will be in charge of creating and/or maintaining data processing subsystems that manage and orchestrate large volumes of data streams at any required speed.

Data engineering responsibilities will include:

  • Implementing and maintaining data pipelines
  • Data modelling and ETL
  • Supporting data processing and transfer
  • Ensuring data quality and consistency (data validation)
  • Assisting with data storage strategies
  • Data provisioning
  • Documenting data and models (i.e. metadata, data provenance and lineage)
  • Creating data/features for analysis and model building

Requirements

  • Data modelling
  • Good software engineering skills
  • Knowledge of big data engineering technologies: data processing frameworks, data streaming technologies
  • Database management and data warehousing: Relational database, NoSQL, and in-memory databases.
  • Cloud technologies: AWS data services, Google Cloud (good to have)
  • Data ingestion and integration
  • ETL
  • CI/CD 
  • PySpark
  • Scripting languages (Bash, Python, etc.)
  • At least 2 years of experience in the field of data engineering.
Who We Are Orderin is one of South Africa’s leading on-demand delivery services. We deliver our customers’ favourite meals, beverages and other goods right to their doorstep, all in a matter of minutes… and we do it with mad amounts of love. It's all about saving time and making everyone's lives a little easier and a lot more convenient. The on-demand delivery industry is rapidly transforming and Orderin has been at the forefront of this movement. Orderin operates in South Africa’s major metropoles and is continuously increasing its reach. We're constantly improving and developing our systems and marketing strategies to ensure we're ahead of the digital game. Why Orderin? We’re building the leading on-demand delivery service in SA, and this is your chance to make a massive impact on that mission. We’re expanding rapidly and growing our dedicated team to anticipate changes in trends and in the market, so that we continue to lead the way. This industry presents huge growth opportunities which makes it an exciting space to be in.
Share this job