AWS Data Engineer

Persistent Systems · India

About Position:

We are seeking an experienced AWS Data Engineer with 8-12 years of experience in designing, developing, and supporting cloud-native data platforms and ETL solutions on AWS. The ideal candidate will be responsible for building scalable data pipelines, implementing event-driven architectures, automating infrastructure, and enabling reliable data integration across enterprise applications. This role requires strong expertise in AWS Glue, AWS Lambda, Step Functions, S3, Terraform, CI/CD, and Data Engineering best practices. The candidate will work closely with business analysts, data analysts, and engineering teams to build secure, resilient, and high-performing data solutions that support business-critical analytics and operational workloads.

• Role: AWS Data Engineer
• Location: Pune
• Experience: 8 to 12 Years
• Job Type: Full Time Employment

What You'll Do:

• Design, develop, and maintain robust ETL/ELT pipelines using AWS Glue.
• Define data extraction, transformation, validation, and loading processes across multiple structured and semi-structured data sources.
• Build scalable and reusable data ingestion frameworks for enterprise applications.
• Develop data transformation and enrichment workflows to support analytics and reporting requirements.
• Implement data quality checks and validation processes within data pipelines.
• Ensure data accuracy, consistency, and reliability across enterprise data platforms.
• Design and implement AWS Lambda-based solutions for data integration and application support.
• Develop serverless architectures to process and transform enterprise data efficiently.
• Build scalable event-driven applications leveraging native AWS services.
• Support application modernization initiatives through cloud-native technologies.
• Optimize cloud-based data processing for performance and cost efficiency.
• Orchestrate complex workflows using AWS Step Functions and AWS Lambda.
• Design and implement event-driven data pipelines triggered by file arrivals in Amazon S3.
• Build automated processing frameworks for batch and near real-time data workloads.
• Enable seamless integration between data sources, applications, and analytics platforms.
• Ensure fault tolerance, error handling, and operational resilience in workflow executions.
• Build and maintain CI/CD pipelines using GitHub Actions, Jenkins.
• Implement Infrastructure as Code (IaC) solutions using Terraform, AWS CloudFormation.
• Automate deployment, configuration, and operational processes.
• Support environment provisioning and infrastructure lifecycle management.
• Promote DevOps best practices for continuous integration and delivery.
• Monitor data pipelines, workflows, and cloud resources using Amazon CloudWatch, AWS CloudTrail.
• Troubleshoot system failures, bottlenecks, and performance issues.
• Implement alerting, logging, and observability best practices.
• Drive continuous improvements in platform reliability, scalability, and security.
• Support production environments and critical issue resolution.
• Work closely with Business Analysts and Data Analysts to gather requirements and define technical solutions.
• Translate business requirements into scalable data engineering designs.
• Participate in architecture discussions, solution design reviews, and project planning activities.
• Collaborate with cross-functional teams to deliver end-to-end data solutions.
• Leverage AI-assisted development tools responsibly to improve productivity and accelerate delivery.

Expertise You'll Bring:

• 8-12 years of experience in Data Engineering and Cloud-based Data Platforms.
• Strong hands-on expertise in AWS Glue
• AWS Lambda
• AWS Step Functions
• Amazon S3
• Python
• SQL
• Experience designing and implementing ETL/ELT pipelines.
• Strong understanding of data integration, transformation, and processing frameworks.
• Experience building event-driven architectures on AWS.
• Knowledge of serverless computing and cloud-native application development.
• Strong understanding of data modeling and enterprise data management practices.
• Deep understanding of AWS cloud services and architecture patterns.
• Experience with AWS Lambda
• AWS Step Functions
• Amazon S3
• CloudWatch
• CloudTrail
• IAM
• Experience implementing scalable and secure cloud-native solutions.
• Knowledge of AWS security, monitoring, and operational best practices.
• Experience with GitHub Actions, Jenkins, CI/CD Pipelines, Infrastructure Automation.
• Hands-on experience using Terraform, AWS CloudFormation.
• Knowledge of deployment automation and release management practices.
• Experience with production support and troubleshooting.
• Knowledge of logging, monitoring, and alerting frameworks.
• Expertise in identifying and resolving performance bottlenecks.
• Strong operational and system reliability mindset.
• Experience with event-driven data architectures.
• Knowledge of modern data lake and analytics platforms.
• Exposure to Agile development methodologies.
• Familiarity with AI-assisted software development tools.
• Understanding of security, governance, and compliance requirements within cloud environments.
• Strong analytical and problem-solving abilities.
• Ability to work independently with minimal supervision.
• Strong ownership, accountability, and proactive mindset.
• Excellent communication and stakeholder management skills.
• Ability to thrive in fast-paced and high-pressure environments.
• Strong collaboration skills with business and technical teams.
• Continuous learning mindset and passion for technology innovation.
• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalisation for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment.

Let's unleash your full potential at Persistent - persistent.com/careers

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."