Cloudera Administrator

Protonlogics IT Solutions · Uttar pradesh, India

Big Data Platform / Cloudera Administrator

Location: Noida (Hybrid)

Fulltime Permanent Role

Job Summary:

We are seeking a skilled and proactive Hadoop / Cloudera Administrator with 7+ years of hands-on experience to manage, optimize, and secure our enterprise big data infrastructure. In this role, you will be responsible for administering Cloudera Data Platform (CDP), managing query engines like Trino, orchestrating data workflows via Apache Airflow, maintaining OS-level stability on Linux servers, and assisting with SQL query performance tuning.

Key Responsibilities

1. Hadoop & CDP Platform Administration Install, configure, monitor, and maintain Cloudera Data Platform (CDP) clusters (Private/Public Cloud).

Manage core cluster services: HDFS, YARN, Spark, Hive, Ranger.

Handle cluster provisioning, node scaling, service upgrades, patching, and capacity planning.

Enforce security protocols using Kerberos, Ranger policies across cluster services.

2. Trino & Query Engine ManagementDeploy, configure, and maintain Trino cluster nodes (Coordinators & Workers).

Configure connectors to underlying data sources (HDFS, Hive Metastore, Iceberg, RDBMS).

Monitor Trino query queues, resource utilization, and tune query memory limits to prevent out-of-memory (OOM) failures.

3. Workflow Orchestration (Apache Airflow)Administer and manage Apache Airflow environments used for pipeline orchestration.

Monitor DAG executions, troubleshoot failed jobs, handle scheduler/worker scaling, and optimize resource usage.

Assist data engineering teams with Airflow connection setups, secrets management, and custom provider integrations.

4. Linux Systems & Infrastructure MaintenancePerform day-to-day Linux (RHEL/Ubuntu/CentOS) system administration, performance monitoring, and kernel/disk space troubleshooting.

Automate operational, maintenance, and backup tasks using Shell/Bash or Python scripts.

Manage user permissions, system mounts, network routing, and host-level security configurations.

5. SQL & Query Performance TuningAnalyze, debug, and optimize complex SQL queries running on Hive, and Trino.Assist data engineers and business intelligence analysts with partition strategies, file formatting (Parquet, ORC), and execution plan evaluation (EXPLAIN).