Data Engineer – Azure Databricks SME

Job Role: Data Engineer – Azure Databricks SME Experience: 7–8 Years Work Location: Bangalore Job Type: Full-time Required Skills: Hands on experience in Data Engineering. Strong hands-on experience with Azure Databricks. Good knowledge of PySpark, Python, SQL, and Scala. Experience in building ETL/ELT data pipelines. Strong understanding of Delta Lake and Medallion Architecture. Experience with Azure Data Lake Storage (ADLS Gen2). Knowledge of Azure Data Factory (ADF) for data pipeline orchestration. Experience with Databricks Jobs, Workflows, DLT, and Structured Streaming. Good understanding of Unity Catalog, data governance, and security. Experience with Azure DevOps and CI/CD pipelines. Knowledge of Bicep / Infrastructure as Code is preferred. Experience with Kafka or Azure Event Hubs is a plus. Strong experience in performance tuning and cost optimization in Databricks. Good understanding of data quality, validation, and data modeling. Experience working with large-scale data / big data environments. Good communication and stakeholder management skills. Ability to mentor junior data engineers. Azure certification such as AZ-900 or higher is preferred. Exposure to Power BI, Azure ML, or Microsoft Purview is an advantage.