Senior Data Engineer

Responsibilities • Design, develop, test, deploy, and maintain robust and scalable ELT data pipelines using dbt (data build tool) for data transformation within Snowflake. • Orchestrate and schedule complex data workflows using Apache Airflow, ensuring timely and reliable data delivery. • Develop connectors and scripts (primarily in Python) to extract data from various source systems (APIs, databases, files, streaming platforms) and load it into Snowflake. • Implement data ingestion strategies (batch and streaming) using Snowflake's capabilities (e.g., Snowpipe, external stages). • Optimize Snowflake warehouse usage, query performance, and overall data platform efficiency. • Manage and monitor Snowflake resources, ensuring cost-effectiveness and scalability. • Implement and enforce data governance, security (e.g., RBAC, data masking), and privacy best practices within Snowflake. • Assist in schema design, table optimization (clustering, partitioning), and data loading strategies. • Solve key business problems through using an appropriate mix of strategic thinking and computational methods. • Develop and uphold best practices with respect to change management, documentation and data protocols. Requirements • Bachelor/Master degree in Analytics, Data Science, Mathematics, Computer Science, Information Systems, Computer Engineering, or related technical field. • Demonstrated mastery of complex SQL queries, analytical functions, stored procedures, and performance tuning. • 5+ years of hands-on experience with SQL or any Data warehouse/Data Lake, including data loading, transformations, performance optimization, and security features. • Proven experience in building and managing complex data transformation pipelines using dbt, including Jinja templating, macros, tests, and documentation. • Solid experience in designing, developing, and deploying production-grade data pipelines using Apache Airflow (DAGs, Operators, Sensors, XComs). • Strong Python scripting skills for data manipulation, API integrations, and Airflow DAG development. • Analytical and independent problem solver. Meticulous with high attention to detail. • Strong communicator with ability to switch hats between data/technical speak and business/layperson speak. • Solid understanding of data warehousing concepts, dimensional modeling (star/snowflake schemas), and data lake architectures. • Deep understanding of Extract, Load, Transform (ELT) or ETL principles and best practices. • Familiarity with data quality frameworks, data lineage, and data governance principles. • Experience working in a digital banking or financial services environment is highly advantageous, with an understanding of financial data concepts and regulatory requirements.