Senior data engineer

Job Summary

We are looking for a skilled Data Engineer with a strong background in building scalable, high-performance data pipelines on Google Cloud Platform (GCP).

The ideal candidate will have hands-on experience with Big Query, Airflow, and cloud-based ETL workflows, along with solid programming expertise in Java or Python.

Experience: 8+ Years

Location: Chennai, Pune, Coimbatore and Bangalore

Primary Skills

Google Cloud Platform (GCP): Hands-on experience with Big Query, Cloud Storage, Dataflow, Pub/Sub, and Airflow (Composer). Big Query: Strong SQL skills with expertise in query optimization, partitioning, clustering, and cost management. Airflow (Composer): Proven ability to build, schedule, and monitor ETL/ELT pipelines using Apache Airflow. Programming: Proficiency in Python or Java for data processing, automation, and pipeline development. ETL & Data Integration: Designing and implementing end-to-end ETL/ELT workflows for structured and unstructured data. Database Management: Strong command of SQL; working knowledge of No SQL databases like Mongo DB or Firestore. Version Control & Dev Ops: Experience with Git, CI/CD practices; familiarity with Docker/Kubernetes is a plus.

Key Responsibilities

Design, develop, and maintain scalable data pipelines and data lake solutions on GCP. Build and automate data ingestion and transformation workflows using Airflow and Big Query. Ensure data quality, performance, and security across all cloud environments. Collaborate with cross-functional teams to translate business needs into efficient data models. Optimize queries, manage schema evolution, and maintain high data availability. Implement data governance, version control, and CI/CD best practices. Monitor and troubleshoot data pipelines for continuous reliability and efficiency improvements.

Why Join KANINI?

Join KANINI's award-winning Data Engineering Team, recognized as the "Outstanding Data Engineering Team" at DES 2025 Work on real-world problemsat the intersection of data, AI, and product development Be part of a collaborative, innovative, and growth-driven environment. Access to cutting-edge tools, leadership support, and continuous learning opportunities.