Data Engineer

NoSQL SQL Python Java Data Warehousing Azure Spark Hadoop

Reports to: Head - Business Intelligence

Length of assignment: Full Time

Suggested start date: Immediately

Learn about Farmerline

Do you want to improve millions of lives and leave a lasting legacy at the same time? Do you want to use your talents and skills to make a difference and not just a living? Do you want to help feed the world now and in the future? Farmerline works to reinvent how the world thinks and invests in the lives of small-scale farmers. We are working to help farmers produce and sell food. We are bold and systemic thinkers but operate lean and nimble.

Since 2013, Farmerline has directly helped farmers to improve their productivity and profit in Ghana and also provided technical support to other organizations to do the same. Farmerline started its operations serving 800 farmers in the Ashanti Region of Ghana with information via mobile information services. We have supported many organizations with our tools and knowledge to improve the way they work with farmers. Over the past 7 years, Farmerline and its partnership network has profiled and served over 500,000 farmers and digitized over 1,000,000 acres of farmland across 16 countries in Africa.

Farmerline is a learning organization and you will have the chance to apply your ideas and creativity to solve problems every day. If you work well in a dynamic collaborative culture, set high standards, and meet challenges with determination and a sense of humour, you’ll thrive at Farmerline.

Role overview:

As part of business growth and expansion, Farmerline is looking for a Data Engineer to join our growing team of data experts. The hire will be responsible for expanding and optimizing our databases and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.

The Data Engineer will support our Software Developers, BI Analysts and Data Scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout the organization and its ongoing. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.

The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.

Responsibilities:

Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Mongo and Azure big data technologies.
Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.
Collaborates with Engineering and Business units to improve data models that feed business intelligence tools and our products increasing data accessibility for both our internal and external stakeholders and fostering data-driven decision making across the organization.
Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
Works closely with a team of frontend and backend engineers, product managers, and analysts.
Designs data integrations and data quality framework.
Designs and evaluates open source and vendor tools for data lineage.
Works closely with all business units and engineering teams to develop strategy for long term data platform architecture

Qualifications:

BS or MS degree in Computer Science or a related technical field
2+ years of Python & Java development experience
3+ years of SQL experience (No-SQL experience is a plus)
3+ years of experience with schema design and dimensional data modeling
Ability to manage and communicate data warehousing plans to internal stakeholders
Experience designing, building, and maintaining data processing systems
2+ years of experience working with Azure and other cloud technologies
Experience with Hadoop and Spark is a plus

Farmerline

We create access for all players in the agricultural value chain Farmerline is a company that develops solutions to increase access to farmers and simplify transactions throughout the agricultural value chain. Our focus on creating lasting profits for farmers everywhere has fueled our innovations from the very onset. We are the first organisation in Africa to give farmers access to information through voice messages in local languages, effectively bridging the knowledge gap among smallholder farmers. We are building the “Amazon” for farmers where they can access these timely services and other quality resources at affordable prices in their community. Since our inception in 2013, we have gone beyond serving farmers with information and resources that increase their yield. Now, we also provide global organisations with the tools they need to reach, engage and transform the agricultural last mile. Our belief in the power of technology to ensure sustainability across the agricultural value chain gave birth to Mergdata (www.mergdata.com); a mobile and web application for last-mile engagement. With this technology, we ensure that all last-mile engagements create access for all players, ensure transparency and efficiency, and ultimately, contribute to global food security. The software also offers real-time traceability, certification audit, farm mapping, farmer education, and analytics solutions to help organizations that work with farmers achieve their sustainability and food security goals efficiently. Mergdata uses big data and AI to give organisations insight into the work of farmers and to give farmers increased access to resourced and services; including financial services.

© LaunchAfrica 2024

Top Locations