Aws data engineer/ data bricks/pyspark

Tata Consultancy Services · Vasanthanagar, India

Role/Skill- AWS Data Engineer/ Data Bricks/Pyspark

Experience - 5 to 12 Years

Location- Bangalore

JD:

Experience on AWS clouds and Data bricks, Airflow.
Experience on Apache Kafka streaming processing and Python/Py Spark.
End to end understanding of Databricks architecture, design, development and implementation.
Hands-on experience in SQL, PL/SQL, Unix Shell Scripting, Autosys.
Experience with relational databases such as Oracle, Postgre SQL as well as No SQL databases
Data integration techniques and tools including APIs and data streaming
Strong analytical and problem solving skills, with the ability to identify and resolve issues in data pipelines and systems
Experience with Agile software development methodology and version control systems like Git Hub
Expertise in Data Modeling and DB design with the skills in performance tuning