SENIOR TECHNICAL LEAD
Job Description
VERY Strong IN Python, and SQL, Spark / Pyspark (Must know PySpark OptimiZation)
Real time cloud experience - AWS
Must have experience in AWS EMR , Redshift, Databricks , airflow.
Roles & Responsibilities
We are looking for a self-starter to join our Data Engineering team. You will work in a fast-paced environment where you will get an opportunity to build and contribute to the full lifecycle development and maintenance of the data engineering platform. With the Data Engineering team you will get an opportunity to -
Design and implement data engineering solutions that is scalable, reliable and secure on the Cloud environment
Understand and translate business needs into data engineering solutions
Build large scale data pipelines that can handle big data sets using distributed data processing techniques that supports the efforts of the data science and data application teams
Partner with cross-functional stakeholder including Product managers, Architects, Data Quality engineers, Application and Quantitative Science end users to deliver engineering solutions
Contribute to defining data governance across the data platform