Data Engineer Advisor

Job Duties: ETL Engineering & Data Pipeline Development Design, build, and maintain Azure‑based ETL pipelines (e.g., Data Factory, Databricks, Data Lake) to ingest, clean, transform, and aggregate compensation‑related datasets across multiple regions. Engineer upstream processes to produce 9–10 monthly aggregated output files (customer, revenue, product, sales rep, etc.), delivered 3× per month. Ensure repeatability, monitoring, orchestration, and error‑handling for all ingestion and transformation workflows.Contribute to the creation of a master stitched data file to replace Varicent’s current data‑assembly functions. Business Rules Engine Development Build, configure, and maintain a rules engine (ODM, Drools, or similar) to externalize business logic previously embedded in code. Translat