Senior Data Engineer

Job Description WHAT YOU’LL CHAMPION: As a Senior Data Engineer, your day-to-day duties will encompass the following areas: • Operational Excellence: Provide essential operational support, including system troubleshooting and implementing technical fixes. • Data Quality Assurance: Ensure absolute data integrity and data quality across environments. • Process Optimization: Continuously improve internal processes through automation, pipeline optimization, and infrastructure re-design. • Cross-Functional Collaboration: Support and collaborate closely with cross-functional and multidisciplinary teams in a fast-paced environment. • Data Impact: Leverage data visualization tools and techniques to maximize the business impact and intrinsic value of data. • Internal Stakeholder Management: Manage technical communication, alignment, and relationships with internal business units, product managers, and engineering teams to ensure data deliverables align with organizational goals. • Governance & Compliance: Contribute to improving data governance policies and maintaining data compliance standards. • Continuous Learning: Keep continuously current with the latest technical and industry developments. WHO YOU ARE: • BS/MS/PhD in IT, Mathematics, Science or Engineering discipline Up to 4+ yrs relevant experience beyond first degree • Experience with one of the following languages: Python, Spark • Experience with DAG, airflow, terraform • Familiar with data ETL from a wide variety of data sources. • Experience with SQL and NoSQL databases. • Experience with pipeline and workflow management tools. • Experience with various messaging and stream processing. • Experience with object-oriented/object function scripting languages. • Familiar with containerisation and orchestration tools. • Familiar with one of the following cloud-based services: GCP and its tools and services. • Ability to work under pressure and change, and balance among speed, reliability, and interpretability. • Good working knowledge of productivity tools such as G Suite, Git, Jira, Confluence. • Experience with code versioning, code review and documentation. • Proficient understanding of distributed computing principles. • Able to select and integrate big data tools and frameworks. • Familiar or prone to adopt design thinking methods. • Openness to experimenting with new techniques and new ways of working. ​ WHAT YOU’LL ENJOY: • Physical Wellbeing: Key medical and insurance benefits, maternity expenses, flexible work arrangement, and health and fitness amenities. • Emotional Wellbeing: Paid time off, wellness programmes, and childcare amenities. • Financial Wellbeing: Resources relating to financial, personal skills and career growth programmes. • Allstars Specials: Free flights, unlimited discounted flights, and exclusive discounts with partners. • A unique Allstar culture like no other OUR HIRING PROCESS: • Application received • Candidate screening • Interview(s) and assessment(s) • Background check and/or other assessments • Offer and negotiation