Urgent opening for big data engineer for bangalore/chennai

About the Company

Hi, We have an urgent opening for Big Data Engineer for Bangalore/Chennai location.

Location- Bangalore/Chennai

About the Role

Experience- 6 to 10 Years

Responsibilities

Mandatory Skills

Core Big Data Platform Skills

Strong programming experience in Python Hands-on expertise with Apache Spark (Py Spark preferred) Strong SQL development and query optimization skills Apache Airflow for workflow orchestration and scheduling Kubernetes (AKS/SKE) for container orchestration and deployment. AKS/EKS/GKE also fine. Min IO / S3 Compatible Object Storage like AWS S3 or other S3-compatible object storage experience Apache Iceberg/Delta Lake / Apache Hudi

Technical Competencies

Data Pipeline Development ETL/ELT Processing Data Modelling Performance Tuning Version Control (Git) Agile/Scrum Delivery Model