Aws spark data engineer
Tata Consultancy Services · Chennai g.p.o., India
FULL TIMEpermanent
Job Description
Exp- 5-8 yrs
Location - Chennai/Bangalore
Desired Competencies (Technical/Behavioral Competency)
Strong Expertise in AWS Data Engineering Hands-on expertise in Spark and Scala Extensive experience with AWS Cloud Services (S3, EMR, Glue, Redshift, Athena etc) Solid understanding of Distributed computing Proficiency in SQL Experience in Data Pipeline Orchestration tools (Airflow, Step Functions etc)Responsibility of / Expectations from the Role
Design Develop and maintain Scalable Data Pipelines using Apache Spark (Scala)
Build and Optimize ETL/ELT workflows on AWS
Work with large scale structured and unstructured Datasets
Develop Data Solutions using AWS services such as S3, EMR, Glue, Redshift, Athena, Lambda
Ensure Data Security, Governance and Compliance Best Practices
Details
| Company | Tata Consultancy Services |
| Location | Chennai g.p.o., India |
| Type | FULL TIME |
| Niche | tech |
| Experience | permanent |