AWS Data Engineer

Crescent Techservices · India

***Only Chennai locals will be preferred - F2F interview required***

Role: AWS Data Engineer

Experience : 5+ Years

Work Mode : Chennai - 4 Days (WFO)

Location : Chennai, Tamil Nadu

Job Description

• Design, develop, and optimize scalable data pipelines using Python / PySpark.
• Work extensively with Amazon Web Services (AWS) to build robust, scalable, and secure data solutions.
• Develop and manage data workflows using Apache Airflow / Amazon MWAA (Managed Workflows for Apache Airflow).
• Implement data ingestion and streaming solutions using Amazon Kinesis and Apache Kafka.
• Build and maintain ETL/ELT pipelines using AWS Glue, Amazon EMR, or Apache Spark.
• Write complex and optimized queries using Amazon Redshift, Amazon Athena, and advanced SQL.
• Design and implement scalable data storage solutions using Amazon S3 and AWS data services.
• Automate infrastructure provisioning and deployment using Terraform.
• Develop serverless data-processing solutions using AWS Lambda.
• Configure and manage AWS Glue Jobs, EventBridge schedules, monitoring dashboards, CloudWatch alerts, and notifications.
• Ensure data quality, reliability, scalability, security, and performance across data pipelines.
• Collaborate with cross-functional teams including Analytics, Product, DevOps, and Business teams.
• Implement and maintain CI/CD pipelines for data engineering workflows and infrastructure.
• Follow AWS best practices for IAM, security, cost optimization, high availability, and fault tolerance.