AWS Data Engineer

Purpose Role:The Data Engineer role, part of the Advanced Analytics Centre of Excellence (CoE) will provide strategic technology input and be responsible to build, maintain and implement a world class data science platform and systems that will enable and empower the advanced analytics capability to deliver on its strategic mandate; delivering insights, models, and data products to the wider business to drive better business outcomes and customer engagement.
Responsibilities:Data Engineering:● Programmatically create infrastructure in AWS by designing, developing and scaling infrastructure-as-code. Ensure the systems are highly available and resilient.● Build scalable and secure data mart and pipelines, often performing complex calculations with massive volumes of data from various sources to summarise various entity dynamics.● Enable the delivery of new code and infrastructure changes through Continuous Integration and Deployment Pipelines.● Protect our customer data with continuous security practices and monitoring.● Working with business stakeholders, BI team members and other IT Teams to define and implement strategic objectives.● Guiding Business Intelligence architecture users on the journey towards Cloud-based solutions.● Detailed knowledge of delivery life cycle associated with AWS Cloud-based solutions including but not limited to the key phases, core milestones, critical success factors, testing, typical challenges and mitigation strategies.● Working with the architectural and solution delivery functions to establish detailed and achievable delivery plans within an Agile delivery framework.● Able to work on simultaneous assignments/complex projects.● Researching, evaluating and recommending new and better ways of doing things based on experience, technology and market trends.● Working with business, technical, analytics, data science and third-party communities to define, entrench and evolve Cloud-based solutions while forging better ways of working.● Supporting and sound boarding with team members.● Define and document BI Cloud solution architecture including technical designs and diagrams.● Document or update specifications for system developments and work with developers and data engineers on requirements.● Where needed, provide first and second line incident support to the Advanced Analytics CoE and business by analysing and clarifying the issue and resolving issues within the agreed operational and service level agreement (OLA/SLA) and communicating effectively to business users and colleagues.● Escalate issues timeously to the BI Support Team Lead and/or BI Technical Capability Lead for support when a solution is not forthcoming.● Where needed, actively monitor processes (e.g. daily batch jobs in the system).
Analytics: The role is instrumental in the delivery of data analytics products, initially focused on marketing and customer initiatives but ultimately to the entire organisation and its wider stakeholder and partner groups. Having an interest and understanding of how insights, analytics and data products deliver value to an organisation and having a passion for analytics in general will greatly increase efficacy of the data engineer. 
Minimum Qualifications & Experience:• Bachelor's degree or equivalent combination of education and experience.• 1-3 Years Python, Spark, PySpark• 3 to 5 years’ experience in software engineering with a focus on serverless applications.• Proven experience of core AWS services and features:• AWS Lambda ● Amazon Athena ● AWS Step Function ● DynamoDB ● Amazon Cognito ● S3 Buckets ● Amazon API Gateway ● CloudWatch ● Redshift ● Amazon RDS ● IAM ● KMS• ‘AWS DevOps Engineer – Professional’ or ‘AWS SysOps Administrator – Associate’ is advantageous.• Understanding of Retail is beneficial.• Understanding of Advanced Analytics/Data Science platforms beneficial• Knowledge of SAP and BW / Business Intelligence systems is helpful.