Data Lead – Snowflake

iSystems Ltd · , punjab, pakistan, Pakistan

We are seeking an experienced Data Engineer with strong Snowflake expertise and hands-on experience developing AI-powered data solutions using Snowflake Cortex. The ideal candidate will design scalable data pipelines, optimize data models, and integrate LLM capabilities, retrieval-augmented generation (RAG), and AI-driven analytics directly within the Snowflake ecosystem.

Responsibilities

• Design, develop, and optimize scalable ETL/ELT data pipelines using SQL, Python, Snowpark, Snowpipe, Streams, Tasks, and Dynamic Tables.
• Build and maintain data models, including dimensional and medallion architectures, to support analytics and AI workloads.
• Develop AI-powered solutions using Snowflake Cortex LLM functions, Cortex Search for retrieval-augmented generation (RAG), and Cortex Analyst for natural language-to-SQL applications.
• Process structured and unstructured data, including PDFs and images, for analytics and AI applications.
• Develop interactive data applications and AI-powered interfaces using Streamlit in Snowflake.
• Optimize query performance, warehouse utilization, and processing costs while monitoring AI and token usage.
• Implement role-based access control (RBAC), data masking, security policies, and data governance practices.
• Establish CI/CD pipelines and version control workflows using Git and tools such as dbt and Terraform.
• Implement data quality checks, pipeline monitoring, and orchestration to ensure data accuracy, reliability, and availability.
• Collaborate with cross-functional teams to translate business requirements into scalable data and AI solutions.
• Mentor junior engineers and contribute to engineering best practices, code reviews, and technical documentation.

Requirements

• 6+ years of experience in data engineering, including at least 3 years of hands-on experience with Snowflake.
• Advanced proficiency in SQL and Python for data transformation, pipeline development, and performance optimization.
• Strong hands-on experience with Snowpark, Snowpipe, Streams, Tasks, and Dynamic Tables.
• Practical experience with Snowflake Cortex capabilities, including LLM functions, Cortex Search, or Cortex Analyst.
• Understanding of large language models (LLMs), embeddings, vector search, and retrieval-augmented generation (RAG).
• Experience in data modeling, ETL/ELT development, and workflow orchestration using Airflow or similar tools.
• Familiarity with at least one cloud platform: AWS, Microsoft Azure, or Google Cloud Platform (GCP).
• Experience with Git, CI/CD practices, and automated deployment workflows.
• Knowledge of data security, access management, governance, and data quality frameworks.
• Strong analytical, problem-solving, communication, and collaboration skills.