Senior Data Engineer (Databricks / PySpark)

Skills Required Primary Skills Databricks and PySpark; Advanced SQLmedallion/lakehouse; Data vault 2.0 Job Description Work Location: Remote (India) Candidates should be flexible to work from an EXL office whenever business requires. While the role is primarily remote, it is not a permanent work-from-home position . Key Responsibilities Design, build, and productionise batch and incremental ETL/ELT pipelines using Databricks (notebooks, Jobs/Workflows, DLT), PySpark, and Spark SQL across bronze/silver/gold Delta Lake layers. Implement the medallion architecture with Delta Lake features - ACID merges/upserts (SCD1/SCD2), schema evolution/enforcement, time travel, OPTIMIZE/Z-ORDER, vacuuming - and manage data with Unity Catalog. Orchestrate workloads via Databricks Workflows and/or Azure Dat