Sr. Software Engineer (5+)
yash
|
13 days ago
|
Pune
- Design, develop, and optimize scalable data pipelines using AWS and Databricks.
- Build and manage modern Lakehouse architectures leveraging Delta Lake, Iceberg and Unity Catalog.
- Implement data governance capabilities including data quality, data lineage, metadata management, and data security.
- Develop ETL/ELT solutions using Python, PySpark, and SQL.
- Design and deploy GenAI solutions, including RAG-based chatbots and AI agents.
- Implement Context Engineering and semantic search frameworks to improve AI outcomes.
- Collaborate with architects, data scientists, and business stakeholders to deliver enterprise data solutions.
- Ensure platform scalability, performance, reliability, and cost optimization.
Key Skills
- AWS Data Analytics: S3, Glue, Athena, Redshift, Lake Formation, Lambda, DataZone, DynamoDB
- Databricks: Delta Lake, Iceberg, Unity Catalog, Delta Live Tables (DLT), MLflow, Mosaic AI, Vector Search, Genie Agent, Genie One
- Programming: Python, PySpark, SQL
- Data Engineering: ETL/ELT, Data Modeling, Data Warehousing, Lakehouse Architecture, Medallion Architecture
- Data Governance: Data Quality, Data Lineage, Metadata Management, Data Cataloging, Data Observability, Data Security
- AI & GenAI: AWS Bedrock, SageMaker, RAG, Context Engineering, Semantic Search, AI Agents, LLM Orchestration
Contact US
Let's work
together
Any question or remark? just write us a message
Send a message
If you would like to discuss anything related to payment, account, licensing,
partnerships, or have pre-sales questions, you’re at the right place.