Lead – Hadoop Admin

5 - 9 Years
Hyderabad

Job Description

Job Description:
Hands on experience in deploying Big Data clusters involving Hadoop (HDFS/Yarn/Hive), Cassandra/Mongo DB/HBase, RabbitMQ/Kafka, Storm, Solr, Spark, Zookeeper

- Hands on experience with Cloudera Manager

- Hands on experience with Cloudera/HDP/Apache distributions

- Hands on experience of running tools like Sqoop/Flume/Oozie

- Good understanding of Hadoop benchmarks and other performance benchmarks for optimal configuration

- Good understanding of OS parameters, network topologies, storage options for optimal Hadoop cluster set up

- Hands on experience in any one RDBMS - MySQL/PostgreSQL
- Ability to install any of these databases as meta store database, create schema, populate data, import/export, create users/roles etc.

- Hands on experience with configuring cluster security using Kerberos, ACL

- Hands on experience with data security using encryption, Sentry, ranger etc.

- Good understanding of high availability, fault tolerance, data replication

- Hands on experience on configuring HA in cluster

- Fluent in at least one scripting language (Shell/Perl/Python etc.)

- General operational expertise such as good troubleshooting skills, understanding of system's capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks.

- Good knowledge of Linux as Hadoop runs on Linux.

- Familiarity with open source configuration management and deployment tools such as Puppet or Chef and Linux scripting.

- Knowledge of Troubleshooting Core Java Applications is a plus.

- Sound UNIX abilities involving user management, security & permissions

- Exposure to cloud technologies like EC2/Azure/VM ware will be added advantage

- Hands on experience on monitoring tools like Nagios, Ganglia etc. Ability to deploy, create plug-ins for custom monitoring stats

- Strong verbal and written communication skills are mandatory

- Excellent analytical and problem solving skills are mandatory

- Solid troubleshooting abilities and able to work with a team to fix large production issues

Perks and BenefitsĀ 

Best in the Industry

Keyskills

Desired Candidate Profile

Please refer to the Job description above

Education-

UG:B.Tech/B.E. - Any Specialization

Company Profile

National Payments Corporation of India

National Payments Corporation of India (NPCI) is the newly established company promoted by banks of India with an objective to build robust and state of the art national level retail electronic payment system infrastructure in the country
View Contact Details+

Recruiter Name:HRD

Contact Company:National Payments Corporation of India

Salary

Not Disclosed by Recruiter

Role Category

Analytics & BI

Role

Data Analyst

Employment Type

Full Time, Permanent