Hadoop Developer Full Time

2Coms Consulting Pvt Ltd.

4-9yrs

60 days ago

Hyderabad

Primary Skills : Java, Cloudera, Big Data, Node.Js, Aws Glue, HBase, NoSQL, SCALA.

Secondary Skills : Javascript, PHP, hadoop, Athena, Python.

No. of Positions : 10

Salary Range : 6-14 lac

Job Description

• Responsible for real-time aggregation of large amounts of data from various sources that includes streaming and batch data into a data lake.
• Define data integration flows (ETL, ELT, stream processing, events/event processors, etc.)
• Work alongside development team to build data management platforms using Amazon Redshift, Amazon Elastic Map Reduce (EMR), Amazon Athena, AWS Glue, AWS Lake Formation, Data pipeline, Glue and other related services.
• Designing, implementing and supporting a platform that can provide ad-hoc access to large datasets
• Strong Experience with data bases, including relational and non-relational.
• Strong Experience with AWS Big data processing tools
• Strong experience with scripting / programming languages such as: JavaScript, Java/Scala, .NET, PHP, Python and Node.JS).
• Good to have DevOps experience with CI/CD pipelines, Configuration Management tools, Scripting
• Must have exposure to search tools implementations(Elastic Search stack or similar)
• Nice to have Cloudera, Hadoop development and admin experience
• Good understanding of Windows, Unix/Linux operating systems and networking.
• Collaborate with developers and operations teams to build and deploy custom solutions in AWS. Roles and Responsibilities

 

Desired Candidate Profile

 

Perks and Benefits

 

Job Description

• Responsible for real-time aggregation of large amounts of data from various sources that includes streaming and batch data into a data lake.
• Define data integration flows (ETL, ELT, stream processing, events/event processors, etc.)
• Work alongside development team to build data management platforms using Amazon Redshift, Amazon Elastic Map Reduce (EMR), Amazon Athena, AWS Glue, AWS Lake Formation, Data pipeline, Glue and other related services.
• Designing, implementing and supporting a platform that can provide ad-hoc access to large datasets
• Strong Experience with data bases, including relational and non-relational.
• Strong Experience with AWS Big data processing tools
• Strong experience with scripting / programming languages such as: JavaScript, Java/Scala, .NET, PHP, Python and Node.JS).
• Good to have DevOps experience with CI/CD pipelines, Configuration Management tools, Scripting
• Must have exposure to search tools implementations(Elastic Search stack or similar)
• Nice to have Cloudera, Hadoop development and admin experience
• Good understanding of Windows, Unix/Linux operating systems and networking.
• Collaborate with developers and operations teams to build and deploy custom solutions in AWS. Roles and Responsibilities

 

Desired Candidate Profile

 

Perks and Benefits

 

Relevant Skill Jobs

Virtual Engineering Services (P) LTD

Delhi NCR

PI Techniques Private Limited

Mumbai

Connecting2Work HR Solutions

Bengaluru

UniteSAGA

Navi Mumbai

Corporate Stalwarts

Chennai

HyrEzy Talent Solutions

Hyderabad

Latest Hadoop Developer Jobs