Thiruvananthapuram
31°C
Trivandrum
31°C
Job Search
Home > Job Search

Big Data Developer

Closing on:

12/10/2017

Contact email

roshna.s@iinerds.com

Brief description :

We are looking for a Big Data Engineer that will work on the collecting, storing, processing, and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company.

Responsibilities

  • Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
  • Implementing ETL process 
  • Monitoring performance and advising any necessary infrastructure changes
  • Defining data retention policies
  • Proficient understanding of distributed computing principles
  • Management of Hadoop cluster
  • Ability to solve any ongoing issues with operating the cluster
  • Experience with building stream-processing systems, using solutions such  Spark-Streaming 
  • Experience with Spark
  • Experience in Java, Scala, Python
  • Experience with integration of data from multiple data sources
  • Experience with NoSQL databases
  • Knowledge of various ETL techniques and frameworks, such as Flume
  • Experience with various messaging systems, such as Kafka or RabbitMQ
  • Good understanding of Lambda Architecture
  • Experience- 1 to 3 years