Lead Data Engineer

Technogen India Pvt. Ltd. · India

Job Description

We are seeking an experienced Data Engineer/Lead Data Engineer/Data Engineering Specialist for Oracle + GCP to design, build, and optimize scalable, high-performance data platforms. The ideal candidate will have strong expertise in ETL/ELT frameworks, OIC, and Google Cloud Platform (GCP), and will work closely with business and technical teams to deliver reliable, secure, and analytics-ready data solutions.

A typical day for a Data Engineer involves a mix of technical and collaborative tasks.

The main responsibilities include:

• Integration Development: Designing and building integrations using OIC's visual interface. This involves configuring connections, defining data mappings, and orchestrating complex business processes.
• API Management: Creating, managing, and optimizing APIs (Application Programming Interfaces) to facilitate secure and reliable data exchange.
• Troubleshooting and Support: Monitoring integration performance, identifying and resolving technical issues, and providing ongoing support for deployed integrations to ensure data integrity.
• Collaboration: Working with business analysts and architects to gather requirements, translating them into technical specifications, and collaborating with cross-functional teams to deliver effective solutions.
• Documentation: Maintaining comprehensive documentation of all integration designs, processes, and workflows for future reference and maintenance.
• Best Practices: Adhering to industry standards and best practices for integration development and security.
• Implement data validation, data cleansing, and data quality controls to ensure accurate and reliable datasets.

Qualifications

Technical Skills:

• Proven experience with OIC: Hands-on experience developing integrations is essential.
• Strong Data Modeling skills (conceptual, logical, physical)
• Proficiency in SQL and Python
• Experience with Google BigQuery (GBQ) or Oracle 23ai
• Experience with Apache Airflow / GCP Cloud Composer / OCP Scheduler
• Database skills: Familiarity with SQL and PL/SQL.
• Deployment and testing: Experience with the full software development lifecycle, including testing and deployment processes.

Qualifications and Soft Skills:

• 10-13 years of experience is required.
• Proficiency in Oracle Database (SQL, PL/SQL) and related tools (e.g., SQL Developer).
• Strong knowledge of at least one of the Oracle ERP module, i.e. Financials, Procurement, Inventory, Order Management.
• Knowledge of cloud technologies and Oracle Cloud Infrastructure (OCI) or Oracle Goldengate is a plus.
• Strong analytical and problem-solving skills to address complex business and technical challenges.
• Excellent communication and interpersonal skills to collaborate with cross-functional teams and stakeholders.
• Ability to work independently and manage multiple priorities in a fast-paced environment.
• Detail-oriented with a focus on delivering high-quality, error-free solutions.
• Problem-Solving: Strong analytical and problem-solving abilities, with a proactive approach to addressing challenges.
• Cultural Awareness: Ability to work effectively in a multicultural environment and manage teams across different time zones.

Preferred Qualifications:

• Oracle certifications, i.e. Oracle Certified Professional (OCP)
• Knowledge of DevOps practices, including version control (e.g., Git), CI/CD pipelines, and automated testing.
• Familiarity with Agile or Scrum project management methodologies.
• Familiarity with OpenAI prompt engineering and Machine Learning / LLM concepts
• Knowledge of DBT