Senior Associate – Data Engineer

3 - 8 Years

Job Description

1) Work closely with other data and analytics team members to optimize the company's data systems and pipeline architecture
2) Design and build the infrastructure for data extraction, preparation, and loading of data from a variety of sources using technology such as Sql, Sqoop, Java, Spark
3) Build data and analytics tools that will offer deeper insight into the pipeline, allowing for critical discoveries surrounding key performance indicators and customer activity
4) To be proficient in designing efficient and robust ETL workflows for real time and batch processing
5) To be able to tune Hadoop solutions to improve performance and end-user experience;
6) Design, construct, install, test and maintain highly scalable data management systems
7) Build high-performance algorithms, prototypes, predictive models and POC
8) Develop data set processes for data modeling, mining and production

Required Candidate profile

1) Mandatory Experience in Building data processing systems with Apache spark and Hbase using Java or Scala
2) Proficiency with Hadoop v2, MapReduce, HDFS
3) Experience with building stream-processing systems, using solutions such as Spark-Streaming
4) Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
5) Experience with integration of data from multiple data sources
6) Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
7) Knowledge of various ETL techniques and frameworks, such as Flume, SQOOP
8) Experience with various messaging systems, such as Kafka or RabbitMQ
9) Experience with Big Data ML toolkits, such as Mahout, SparkML
10) Good understanding of Lambda Architecture, along with its advantages and drawbacks
11) Experience with Hortonworks framework


Desired Candidate Profile

Please refer to the Job description above


UG:BCA - Computers, B.Tech/B.E. - Any Specialization

Company Profile

National Payments Corporation of India

National Payments Corporation of India (NPCI), an umbrella organisation for operating retail payments and settlement systems in India, is an initiative of Reserve Bank of India (RBI) and Indian Banks’ Association (IBA) under the provisions of the Payment and Settlement Systems Act, 2007, for creating a robust Payment & Settlement Infrastructure in India.

The Company is focused on bringing innovations in the retail payment systems through the use of technology for achieving greater efficiency in operations and widening the reach of payment systems.
NPCI, has products like RuPay- debit, credit and prepaid cards, UPI(Unified Payments Interface), BHIM(Bharat Interface Money), AEPS(Aadhaar Enabled Payment Services), CTS(Cheque Truncation System), IMPS(Immediate Payment Services), NFS(National Financial Switch), NACH(National Automated Clearing House),NETC , Bharat Bill Pay, *99#.

For more detailed information on the Vision, Mission, Objectives and Products & Services. You can log on to
View Contact Details+

Contact Company:National Payments Corporation of India


Not Disclosed by Recruiter

Role Category

Analytics & BI


Data Analyst

Employment Type

Full Time, Permanent