AI Led Data Engineer
Job Description
Designing and building data pipelines and integration workflows across cloud-based platforms
- Developing data transformation logic using PySpark to process structured and unstructured information
- Implementing AWS services, including Textract and Comprehend, to extract and classify content from source documents
- Creating data validation checks and quality controls to support accurate downstream reporting and analytics
- Supporting data lake and data warehouse structures that improve accessibility, consistency, and performance
- Collaborating on data modeling, schema design, and pipeline troubleshooting to address implementation issues
- Applying automation and orchestration tools such as Apache Airflow to schedule and monitor recurring data jobs
- Working across client engagements to gather requirements, document technical details, and support delivery of data engineering tasks