Databricks Engineer (Ref 25736)

Responsibilities Data Transformation • Query, clean, and transform datasets using SQL and Python on the Databricks platform. • Ensure data quality and consistency across systems in accordance with government Instruction Manual (IM8) standards. Analytics & Dashboard Development • Build, enhance, and maintain dashboards for data monitoring, performance reporting, and user behaviour analytics. • Partner with business stakeholders to understand data requirements and translate them into impactful visual insights. Documentation & Knowledge Management • Develop clear and comprehensive user guides for dashboards, charts, and data workflows in Databricks • Maintain technical documentation (e.g., on Confluence) for analytics processes, standards, and best practices. Additional Opportunities • Explore and prototype automation solutions to streamline repetitive or manual workflows. • Develop project management competencies, including: • Creating user stories and acceptance criteria • Managing JIRA tickets and sprint tasks • Writing and executing QA test cases Requirements • Bachelor's degree in Computer Science, Engineering, or related field • More than 8 years of relevant work experiences Required Skills • Proficiency in SQL and Python for data processing and automation. • Hands-on experience in dashboard tools such as Tableau, Power BI, or equivalent visualisation tools. • Familiarity with Databricks or similar big data/analytics platforms. • Ability to produce high-quality technical documentation. Additional Skills Preferred • Experience in system testing, SIT/UAT, or quality assurance processes. • Knowledge of Spark for distributed data processing. • Understanding of Git or other version control systems. Soft Skills • Strong analytical mindset and problem-solving abilities. • Good communication skills, especially in explaining technical concepts to non-technical users. • Ability to work independently as well as collaboratively in cross-functional teams. • Attention to detail and commitment to delivering high-quality work. Licence no: 12C6060