Data Engineer

EXL · India

About the Role

We are looking for a highly skilled AWS Data Engineer to design, build, and optimize scalable data solutions on AWS cloud. The ideal candidate should have strong expertise in data engineering, ETL/ELT development, cloud-native architectures, and modern data warehousing technologies.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines on AWS.
• Build and optimize ETL/ELT processes for structured and unstructured data.
• Develop data ingestion frameworks from multiple source systems.
• Implement and manage cloud-based data lakes and data warehouses.
• Ensure data quality, governance, security, and compliance standards.
• Optimize data processing performance and cost efficiency within AWS.
• Collaborate with Data Analysts, Data Scientists, and Business stakeholders to deliver data solutions.
• Troubleshoot production issues and provide timely resolutions.
• Implement CI/CD practices for data engineering workflows.
• Create technical documentation and best practices for data architecture.

Required Skills

AWS Services

• AWS Glue
• Amazon S3
• Amazon Redshift
• AWS Lambda
• AWS EMR
• AWS Athena
• AWS Step Functions
• AWS CloudWatch
• AWS IAM

Data Engineering

• Strong SQL and Python programming
• Data Modeling (Star Schema, Snowflake Schema)
• ETL/ELT Pipeline Development
• Data Warehousing Concepts
• Data Lake Architecture

Big Data Technologies

• Apache Spark (PySpark)
• Hadoop Ecosystem (Good to Have)
• Kafka/Kinesis (Preferred)

DevOps & Automation

• Git/GitHub/GitLab
• CI/CD Pipelines
• Terraform or CloudFormation
• Docker (Preferred)

Preferred Qualifications

• Experience with Snowflake, Databricks, or Microsoft Fabric is a plus.
• Knowledge of Data Governance and Data Quality frameworks.
• Experience working in Agile/Scrum environments.
• AWS Certification (AWS Certified Data Engineer, Solutions Architect, or Developer Associate) preferred.