Data engineer

Hiring data engineers with big 4 firm in Bangalore location.
Experience - 5-7 years
Data Engineer
Job Summary
We are seeking a highly skilled Data Engineer with 6+ years of experience in designing, developing, and optimizing scalable data solutions. The ideal candidate will have strong expertise in Python, SQL, Snowflake, and modern data engineering practices, along with hands-on experience in data transformation, data warehousing, and cloud-based data platforms.
The role involves building and maintaining robust data pipelines, enabling efficient data processing and analytics, and supporting enterprise-wide data initiatives.
Key Responsibilities
Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
Develop efficient data transformation and processing workflows using Python and SQL.
Work with large datasets across multiple relational database systems and cloud-based platforms.
Optimize data models, database performance, and query execution for analytics and reporting requirements.
Collaborate with business stakeholders, analysts, and engineering teams to understand data requirements and deliver high-quality solutions.
Implement data quality checks, monitoring frameworks, and governance standards.
Support data warehousing initiatives, including dimensional modeling and data lake architecture.
Ensure data integrity, security, and compliance across the data ecosystem.
Participate in code reviews, documentation, and best practice adoption.
Mandatory Skills & Experience
6+ years of experience in Data Engineering or a related field.
Strong programming expertise in Python, including:
Pandas
Num Py
Dask
Hands-on experience with SQL and relational databases.
Strong experience with Snowflake.
Expertise in data manipulation, transformation, and analysis.
Ability to write and optimize complex SQL queries.
Technical Skills
Databases
Experience working with one or more of the following:
Snowflake
Postgre SQL
SQL Server
Sybase
DB2
Data Engineering
Data processing and transformation
ETL/ELT development
Data pipeline design and optimization
Performance tuning and troubleshooting
Preferred Skills
Data Warehousing & Modeling
Dimensional Modeling
Star Schema
Data Vault
Kimball Methodology
Inmon Methodology
Data Lake Architecture
Big Data & Modern Data Platforms
Apache Spark
Apache Airflow
Databricks
Cloud Technologies
Experience with cloud platforms, preferably Microsoft Azure
Additional Technologies
Kafka or other messaging/streaming platforms
Git and version control practices
Jupyter Notebooks
Nice to Have
Exposure to Cloud Engineering and Dev Ops practices.
Experience with BI and visualization tools such as Tableau or Power BI.
Understanding of Trade Lifecycle and Financial Markets.
Basic knowledge of Java.
Qualifications
Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
Strong analytical and problem-solving skills.
Excellent communication and stakeholder management abilities.
Ability to work effectively in a fast-paced, collaborative environment.