Data Engineer
Job Description
* Design, develop, and optimize scalable ETL/ELT processes to ingest, transform, and load data from various sources into system of record(SOR)
* Build and maintain data pipelines using a variety of technologies (e.g., Python, SQL, cloud-native services like AWS Glue, Step Functions,Lamda,Kafka etc).
* Collaborate with software enginners, data engineers, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.
* Implement data quality checks and monitoring to ensure accuracy, completeness, and reliability of data.
* Optimize database performance and ensure data security and compliance with relevant regulations.
* Troubleshoot and resolve data-related issues, ensuring data availability and integrity.
* Participate in the design and architecture of data platforms, including data warehousing, data lake, and streaming solutions.
* Document data models, data flows, and technical specifications.
* Stay up-to-date with emerging data engineering technologies and best practices.