Senior Data Engineer

Must Have skills:PySpark, Azure Databricks, SQL, Python Responsible for monitoring batch pipelines, validating dashboards, and performing anomaly detection with root cause analysis. Requires strong SQL, working knowledge of PySpark/Python, and experience with data pipelines, Azure Data Factory, Databricks, and basic ML workflows. Involves stakeholder communication, CI/CD monitoring, and continuous improvement through debugging, pattern identification, and data-driven insights Monitor workflows in Azure Data Factory (ADF) and Databricks Contribute to CI/CD validation and release monitoring Maintain documentation for issues, RCA findings, and fixes.