Senior Data Engineer

Calsoft · India

Job Description – Data Engineer

Position: Data Engineer

Experience: 5+ Years

Location: Pune/ Indore/Kolkata/ Bangalore

Notice Period: Immediate Joiner

Employment Type: Full-Time

Role Overview

We are looking for an experienced Data Engineer with 5+ years of hands-on experience in designing, developing, and maintaining scalable data pipelines and ETL solutions. The ideal candidate should have strong expertise in AWS or Azure, ETL, SQL, and Python , along with working knowledge of GCP .

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines .
• Develop data integration solutions using AWS or Azure cloud services.
• Write complex and optimized SQL queries for data extraction, transformation, and analysis.
• Develop and maintain data processing solutions using Python .
• Work with structured and semi-structured data from multiple sources.
• Perform data transformation, cleansing, validation, and quality checks.
• Monitor and troubleshoot data pipelines and resolve production issues.
• Collaborate with Data Architects, Developers, Analysts, and other stakeholders.
• Ensure data pipelines are scalable, reliable, secure, and optimized for performance.
• Support cloud-based data platform development and migration initiatives.

Required Skills

• 5+ years of experience in Data Engineering.
• Strong hands-on experience with ETL/ELT processes.
• Strong SQL skills, including query optimization.
• Good hands-on experience with Python for data engineering.
• Strong experience with GCP, AWS or Azure .
• Understanding of Data Warehousing and Data Modeling concepts.
• Experience working with large-scale data and production data pipelines.

Good to Have

• Experience with AWS Glue / S3 / Lambda / Redshift .
• Experience with Azure Data Factory / Azure Data Lake / Synapse .
• Knowledge of GCP BigQuery / Cloud Storage / Dataflow .
• Experience with Apache Spark / PySpark .
• Knowledge of Airflow or other workflow orchestration tools.
• Exposure to Git, CI/CD, Docker , or cloud-native technologies.

Candidate Profile

• Strong problem-solving and analytical skills.
• Good communication and stakeholder management skills.
• Ability to work independently and as part of a technical team.
• Experience working in enterprise production environments.