IDFC FIRST BankEmployer profile
Platform Admin
Location not specified · 3–7 yrs
Experience
- 3–7 yrs
Salary
- Not disclosed
Location
- Location not specified
Work mode
- Not specified
Job type
- Full-time
Apply by
- Closing date not listed
Posted
- 13 May 24
About this role
Role/ Job Title: Platform AdminBusiness: New Age
Function/ Department: Data and Analytics
Place of Work: Mumbai/Bangalore
Experience range: 3-7 years
Job Purpose
'Hadoop admin, responsible for capacity planning and estimating the requirements for lowering or increasing the capacity of the hadoop cluster. Hadoop admin is also responsible for deciding the size of the hadoop cluster based on the data to be stored in HDFS. maintain quality of the deliverables. It also need to supervise activities between internal and external resources, and facilitate smooth workflow for service delivery and cluster management.
Roles & Responsibilities
'Should be able to deploy Hadoop Cluster (Preferably CDH/CDP), add and remove nodes,
Keep track of jobs, monitor critical parts of cluster, configure name-node HA, schedule and configure backups.
General operational expertise such as good troubleshooting skills, understanding system’s capacity, bottlenecks, basics of memory, CPU, OS, storage and networks.
Hadoop stacks like HIVE, Impala, Hbase, Nifi, etc
Good Knowledge of Linux as Hadoop runs on Linux.
Familiarity with open source configuration and deployment tools such as Jenkins, Puppet/Chef and Linux scripting.
Responsible for implementation and ongoing administration of Hadoop Infrastructure.
Aligning with different Engineering teams to propose and deploy hardware and software environments required for Hadoop and to expand existing environments.
Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing the services for new users.
Cluster maintenance using Cloudera Manager.
Performance tuning for Hadoop clusters and Hadoop map reduce routines.
Monitor Hadoop cluster connectivity and security.
Log and storage management.
Diligently teaming with infrastructure, network, database, application and BI teams to guarantee high data availability.
Secondary Responsibilities
'Software installation and configuration.
Database backup and recovery.
Database connectivity and security.
Performance monitoring and tuning.
Disk space management.
Key Success Metrics
'Successfully deliver projects on committed time.