Data Engineer
Lorven Technologies Inc. · Tamil nadu, India
FULL TIME
Job Description
Job Description – Azure Data Engineer
Job Title: Azure Data Engineer
Experience: 6+ Years
Location: Chennai
Employment Type: Full-Time / FTE
Job Summary
We are looking for an experienced Azure Data Engineer with 6+ years of hands-on experience in designing, developing, and maintaining scalable data engineering solutions using Python, Apache Spark, Azure Databricks, and Snowflake . The ideal candidate should have strong expertise in data processing, ETL/ELT pipelines, data transformation, and cloud-based data platforms.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows on Azure.
- Develop data processing and transformation solutions using Python and Apache Spark .
- Build and optimize data engineering workloads using Azure Databricks .
- Develop PySpark applications for large-scale data processing and transformation.
- Design and implement data ingestion pipelines from multiple structured and unstructured sources.
- Work with Snowflake for data loading, transformation, data modeling, and performance optimization.
- Implement data integration between Azure Databricks and Snowflake .
- Perform data cleansing, validation, transformation, and quality checks.
- Optimize Spark jobs, Databricks notebooks, SQL queries, and data pipelines for performance and scalability.
- Develop reusable frameworks and components for data processing and ingestion.
- Troubleshoot data pipeline failures, performance issues, and data quality problems.
- Collaborate with Data Architects, Analysts, Developers, and business stakeholders to understand data requirements.
- Follow best practices for data security, governance, monitoring, and operational support.
- Participate in code reviews, technical documentation, testing, and deployment activities.
Mandatory Skills
- 6+ years of experience in Data Engineering
- Python – Strong
- Apache Spark / PySpark – Strong
- Azure Databricks – Strong
- Snowflake – Strong
- Strong experience in ETL/ELT and data pipeline development
- Strong SQL and data transformation skills
- Experience working with large-scale datasets and distributed data processing
- Good understanding of Azure cloud data engineering concepts
Details
| Company | Lorven Technologies Inc. |
| Location | Tamil nadu, India |
| Type | FULL TIME |
| Niche | tech |