Pyspark Developer (5 locations)

Tata Consultancy Services · Bangalore, India

TCS Hiring for Pyspark Developer

Experience Range: - 05 To 10 Years (Mandatory)

(Note: Candidates below 5 years of IT experience shall not be considered)

Job Locations : Bengaluru, Chennai, Hyderabad, Pune, Kolkata

JOB DESCRIPTION

Job Requirements:

• Experience with strong proficiency in Python and PySpark.
• Experience working on Spark SQL, RDD, and DataFrame APIs.
• Good understanding of Hadoop ecosystem (Hive, HDFS, YARN).
• Knowledge of data formats like Parquet, Avro, JSON, etc.
• Experience with SQL and writing efficient queries.
• Familiarity with job orchestration tools (Airflow, Oozie, or similar).
• Version control systems like Git.
• Exposure to cloud platforms (AWS/GCP/Azure) is a plus.

Key responsibilities:

• Design, develop, and maintain robust ETL/ELT pipelines using PySpark and other big data technologies. Optimize Spark jobs for performance and scalability.
• Implement data transformations, aggregations, and joins over large datasets. Perform batch and real-time data processing tasks.
• Collaborate with data scientists, analysts, and other engineers to understand requirements and deliver quality solutions. Integrate PySpark solutions with data warehouses (like Hive, Redshift, Snowflake) and other data stores.
• Write clean, maintainable, and well-documented code. Follow version control and CI/CD practices using tools like Git, Jenkins, or Azure DevOps.
• Troubleshoot data quality and performance issues. Monitor pipeline health and ensure SLAs are met.
• Work with tools and platforms like Hadoop, Hive, HDFS, AWS EMR, Databricks, or Azure Synapse as required.

Minimum Qualification:

15 years of Full Time Education

Interested candidates kindly share your updated resume to along with filling the following details to maximize your chances of getting calls from TCS. The details are as follows:

Section 1: Basic Details:

• Candidate Name:
• Email ID:
• Phone Number:
• Current Location (City):
• Preferred Location (City):

Section 2: Educational Details:

• Highest Regular Full‑Time Qualification
• (Diploma / Graduation / Post Graduation / Others)
• 10th Completion Year
• 12th / Intermediate Completion Year
• Graduation Completion Year
• Post‑Graduation Completion Year (if applicable)

Section 3: Work Experience:

• Current Company Name
• Total Experience (in years)
• Number of Companies Worked
• Employment Timeline
• (Example: Company A – 2021 to Present, Company B – 2019 to 2021)

Section 4: Compensation Details:

• Current CTC (in LPA)
• Expected CTC (in LPA)
• Notice Period
• (Immediate / 15 Days / 30 Days / 60+ Days)

Section 5: Documentation & Compliance (Yes / No):

• Valid ID Proof Available (Aadhar & Pan Card): (Yes/No)
• Educational Documents Available: (Yes/No)
• Employment Documents Available: (Yes/No)
• UAN Number Available: (Yes/No)