Data Engineer Senior Advisor

L3 Production Support & Technical Leadership

• Lead the L3 support team responsible for the production data platform and associated applications.
• Act as the technical escalation point for complex data, application, integration, and performance-related incidents.
• Troubleshoot and resolve critical production issues within agreed SLA timelines.
• Coordinate with L1/L2 support, engineering, infrastructure, cloud, security, and business teams during incident resolution.
• Lead Root Cause Analysis (RCA) for major incidents and ensure corrective and preventive actions are implemented.
• Identify recurring production issues and drive permanent fixes, automation, and platform improvements.
• Establish and maintain operational runbooks, troubleshooting guides, SOPs, and knowledge articles.
• Mentor team members and provide technical guidance on data engineering and Snowflake-related issues.
• Support incident, problem, change, and release management processes.
• Participate in or coordinate on-call and production support activities as required.

Snowflake & Data Engineering

• Provide hands-on engineering and production support for solutions built on Snowflake.
• Troubleshoot complex SQL, data pipeline, data quality, ingestion, transformation, and performance issues.
• Performance tuning and cost optimisation within Snowflake
• Work with dbt within the Snowflake ecosystem for data transformation, testing, deployment, and troubleshooting.
• Support and enhance applications developed using Streamlit, particularly Streamlit applications integrated with Snowflake.
• Understand, troubleshoot, and enhance solutions leveraging Snowflake Cortex / Cortex AI capabilities.
• Support real-time and near-real-time data ingestion using Kafka and Snowpipe Streaming.
• Analyze pipeline failures, data latency, schema changes, data quality issues, and downstream impacts.

Cloud, DevOps & Automation

• Strong working knowledge of GitHub and Git-based development practices, including branching, pull requests, code reviews, and CI/CD processes.
• Experience with relevant AWS services, particularly serverless and integration services such as AWS Lambda.
• Working understanding of equivalent services within Google Cloud Platform (GCP).
• Automate repetitive support and operational activities wherever possible.
• Work closely with engineering teams to improve deployment, monitoring, rollback, and recovery processes.

Monitoring & Reporting

• Develop and maintain dashboards and alerts for proactive monitoring of the data platform.
  • Build or enhance operational dashboards to provide visibility into pipeline health, failures, data latency, platform performance, SLA adherence, and Snowflake consumption/cost.