Senior Software Engineer-Azure Data Engineer

<p></p><p><b>Position Description: </b> </p> <p></p> <p>At CGI, we’re a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72, professionals located in 40 countries. Founded in , CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources, expertise, stability and dedicated professionals needed to achieve results for our clients - and for our members. Come grow with us. Learn more at is a great opportunity to join a winning team. CGI offers a competitive compensation package with opportunities for growth and professional development. Benefits for full-time, permanent members start on the first day of employment and include a paid time-off program and profit participation and stock purchase plans. We wish to thank all applicants for their interest and effort in applying for this position, however, only candidates selected for interviews will be contacted. No unsolicited agency referrals please.<br />Position: SSE-Azure Data Engineer <br />Experience: 5+ years <br />Location: Bangalore/Chennai <br />Employment Type: Full-Time <br />Mode-5 Days WFO- ODC<br />Shift Time- 1.00 PM-10.00 PM<br />Job Summary:<br /> We are seeking a highly experienced Senior Azure Data Engineer to join our growing data team. In this role, you will be responsible for designing, developing, and operationalizing large scale data processing systems on the Azure cloud platform. The ideal candidate will have a deep understanding of modern data architecture, a passion for building efficient and reliable data pipelines, and extensive hands on experience with Azure Databricks, Azure Data Lake, PySpark, and Python. </p> <p></p><p><b>Your future duties and responsibilities: </b> </p> <p></p> <p>· Design, build, and maintain scalable and robust data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data.<br /> · Develop and optimize high performance Spark jobs using PySpark and Spark SQL within Azure Databricks.<br /> · Implement data storage solutions using Azure Data Lake Storage (Gen2) following medallion architecture (Bronze, Silver, Gold layers) and best practices for data organization.<br /> · Collaborate with data architects, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.<br /> · Implement data security and compliance measures, including access controls, encryption, and data masking within the Azure ecosystem.<br /> · Perform data modeling to create efficient, scalable schemas for both batch and real time analytics.<br /> · Monitor, troubleshoot, and tune data pipelines and Databricks jobs for performance and cost effectiveness.<br /> · Automate deployment and management of data solutions using CI/CD pipelines (Azure DevOps/GitHub Actions) and Infrastructure as Code (IaC) tools like Terraform or Bicep.<br /> · Establish and enforce data quality checks and data governance standards across the data platform.<br /> · Mentor junior data engineers and promote best practices in software development and data engineering. </p> <p></p><p><b>Required qualifications to be successful in this role: </b> </p> <p></p> <p>· 5+ years of professional experience in data engineering, with a proven track record of building enterprise grade data solutions.<br /> · 3+ years of hands on experience with Microsoft Azure data services, specifically:<br /> · Azure Databricks: Expert level proficiency in developing, tuning, and debugging Spark clusters and notebooks.<br /> · Azure Data Lake Storage (Gen2): Deep experience in managing data lakes, including directory structure, security (RBAC &amp; ACLs), and performance optimization.<br /> · Medallion Architecture<br /> · Expert programming skills in Python for data engineering tasks (e.g., Pandas, API interactions, unit testing).<br /> · Expert level proficiency in PySpark for large scale data processing, including DataFrame API, Spark SQL, and understanding of Catalyst Optimizer.<br /> · Strong experience in writing and optimizing complex SQL.<br /> · Solid understanding of data modeling concepts (e.g., star schema, snowflake schema, data vault).<br /> · Experience with data pipeline orchestration tools such as Azure Data Factory or Apache Airflow.<br /> · Experience with version control systems (Git) and collaborative development practices.Preferred Qualifications:<br /> · Microsoft Azure Data Engineer Associate (DP ) certification or similar.<br /> · Experience with Delta Lake (format and features like ACID transactions, time travel, schema enforcement).<br /> · Experience with real time data processing using Azure Stream Analytics or Spark Streaming.<br /> · Knowledge of other Azure services (Synapse Analytics, Event Hubs, Azure SQL DB, Cosmos DB, Purview).<br /> · Experience with DevOps/DataOps principles and tools (CI/CD, Terraform, Azure DevOps).<br /> · Familiarity with data visualization tools like Power BI.Personal Attributes:<br /> · Excellent problem solving and analytical skills.<br /> · Strong communication and collaboration skills, with the ability to explain complex technical concepts to non technical stakeholders.<br /> · A proactive, self motivated attitude with a strong sense of ownership and accountability.<br /> · A continuous learner who stays updated with the latest trends in cloud data technologies.<br /> #LI-AD11 </p> <p></p><p><b>Skills: </b> </p> <p></p> <li>Azure </li><li>Azure Data Lake </li><li>Communication </li><li>Microsoft SQL Server </li><li>Python </li>