Senior data engineer

Job Description: GCP Data Engineer
Experience: 4–10 Years
Roles & Responsibilities
Design, develop, and implement scalable data processing solutions using Big Data technologies and distributed system s
Strong hands-on experience with Python and Py Spar k for developing efficient data pipelines and applications
Develop and optimize complex SQL querie s, data models, and database solutions
Analyze and improve performance of Apache Spark workload s through optimization techniques such as partitioning, caching, tuning, and resource optimization
Design and implement various data processing pattern s including Batch Processing, Near Real-Time (NRT), and Real-Time data pipelines
Understand business requirements and translate them into scalable data architecture and technical solution s
Work with cloud-based data platforms and services, preferably Google Cloud Platform (GCP )
Hands-on experience with GCP managed services such as: Google Cloud Storage, Dataproc, Dataflow, Pub/Sub, Cloud Functions, Cloud Composer, Big Query, Big Table
.
Required Skills
4–10 years of experience i n Data Engineering / Big Data Engineering
Strong programming experience i n Python, Py Spark, SQL
Hands-on experience wit h Spark, Hadoop ecosystem, and distributed computing
Experience designing scalable data pipelines and cloud-based solution
Strong exposure t o GCP data services and cloud architecture
Good understanding of data modeling, ETL/ELT, and data integration pattern
Experience with performance tuning and optimization of large-scale data processing workloads
Good to Have
GCP certification(s)
Experience in enterprise cloud migration projects
Knowledge of Dev Ops practices and CI/CD automation
Experience working in Agile development environments