• Design, develop, and maintain scalable data engineering solutions using AWS cloud services, Databricks, Python, PySpark, and SQL.
• Build, optimize, and manage robust ETL/ELT pipelines for data ingestion, transformation, processing, and integration.
• Develop and integrate secure, scalable REST APIs using AWS API Gateway, AWS Lambda, and other cloud-native services.
• Implement API security mechanisms, including OAuth 2.0, JWT, IAM policies, and appropriate access controls.
• Design and manage cloud infrastructure using AWS services such as S3, ECS/EKS, CloudFront, ALB/NLB, KMS, and IAM.
• Develop and maintain Infrastructure as Code using Terraform to automate infrastructure provisioning and configuration.
• Design cloud-native applications and data solutions, following software architecture principles, design patterns, scalability, and high availability best practices.
• Optimize data processing workloads, SQL queries, and PySpark jobs to improve performance, scalability, and cost efficiency.
• Implement secure data storage, encryption, access management, and other cloud security best practices.
• Collaborate with architects, developers, DevOps teams, and business stakeholders to translate requirements into technical solutions.
• Establish and maintain CI/CD pipelines for automated build, testing, deployment, and release management.
• Troubleshoot production issues, perform root cause analysis, and implement preventive measures to improve system reliability.
• Develop and maintain technical documentation, API specifications, architecture diagrams, and deployment procedures.