Data Engineer_AI

Job Description<br /><br /><ol><li><p>Job Description  </p> </li> </ol><ul><li><p>Develop and maintain ETL/ELT pipelines using Databricks.  </p> </li> </ul><ul><li><p>Write efficient Pyspark &amp; Python Scripts for large-scale data processing.  </p> </li> </ul><ul><li><p>Implement data models, transformations and CI/CD pipelines for automation.  </p> </li> </ul><ul><li><p>Develop reusable data engineering frameworks, libraries and templates for ingestion, transformation, validation and publishing.  </p> </li> </ul><ul><li><p>Ensure Data Quality, Reliability, and Performance across pipelines and shared frameworks.  </p> </li> </ul><ul><li><p>Design, develop, test and deploy Power BI scripts and generate visually appearing and insightful reports.  </p> </li> </ul><ul><li><p>Integrate Power BI reports into Applications to provide enhanced business capabilities.  </p> </li> </ul><ul><li><p>Build data models and develop dashboards using Power BI desktop.  </p> </li> </ul><ul><li><p>Work with Reliability Engineers to design and develop Power BI data Visualizations.  </p> </li> </ul><ul><li><p>Proficient in using DAX expressions and Power Queries for developing and optimizing Power BI dashboards and reports.  </p> </li> </ul><ul><li><p>Knowledge of Azure Cloud Data Engineering Tools.  </p> </li> </ul><ul><li><p>Analysis of Validation Test Results.  </p> </li> </ul><ul><li><p>Development of Interfaces for Measurement and Simulation.  </p> </li> </ul><ul><li><p>Development and Maintenance of Test Automation system related Tools.  </p> </li> </ul><ul><li><p>Support Downstream consumers such as analytics, reporting, testing and Reliability teams.   </p> </li> </ul><ol><li><p>Desired Skills  </p> </li> </ol><ul><li><p>Good knowledge of data engineering concepts, ETL/ELT pipelines, and data lifecycle management.  </p> </li> </ul><ul><li><p>Excellent understanding of data modeling, data transformation, and dashboarding concepts for analytics and reporting.  </p> </li> </ul><ul><li><p>Proficiency in programming languages including Python and PySpark, with experience in large-scale data processing.  </p> </li> </ul><ul><li><p>Strong knowledge of data visualization and reporting using Microsoft Power BI including DAX expressions and Power Query.  </p> </li> </ul><ul><li><p>Familiarity with cloud-based data engineering tools, preferably Microsoft Azure services.  </p> </li> </ul><ul><li><p>Basic knowledge of electronics and industrial/validation systems is an added advantage.  </p> </li> </ul><ol><li><p>Education &amp; Experience  </p> </li> </ol><ul><li><p>Bachelor’s or Master’s degree in Electronics or Electrical Engineering or Computer Science Engineering with 2 to 5 years of experience.  </p> </li> </ul><ul><li><p>Hands-on experience in building and maintaining data pipeline solutions using Databricks.  </p> </li> </ul><ul><li><p>Exposure to data engineering concepts including ETL/ELT workflows, data processing, and automation.  </p> </li> </ul><ol><li><p>Soft Skills  </p> </li> </ol><ul><li><p>Team player with a proactive mind set  </p> </li> </ul><ul><li><p>Good communication skills  </p> </li> </ul><ul><li><p>Willing to work in an international team with diverse cultures  </p> </li> </ul><ul><li><p>Openness for technical discussions, assessments and reviews  </p> </li> </ul> <br />Qualifications<br /><br /><p>Btech/Mtech </p><br /><br />Additional Information<br /><br /><p>3-6 Years  </p>