Job Description

• Good knowledge of database structures, theories, principles, and practices
• Experience in Java and Knowledge in Hadoop (HDFS / KAFKA / SPARKSQL and SPARK STREAMING ) concepts and ability to write Spark/Scala Dataset, Dataframe, Spark Streaming & SQL jobs.
• Proven understanding with Hadoop, Spark, Hive and ability to write Shell scripting.
• Familiarity with data loading tools like Sqoop, Flume, Kafka and Confluent.
• Knowledge of workflow/schedulers like Autosys.
• Good aptitude in multi-threading and concurrency concept.
• Loading data from disparate data source sets.
• Certifications like Cloudera Developer (CCA175)/ Hortonworks Developer (Spark & Hive) /Administrator Certifications added advantage.
• Hands on experience with at least two NO SQL databases.
• Ability to analyze, identify issues with existing cluster, suggest architectural design changes.
• Ability/Knowledge to implement Data Governance in Hadoop clusters.

Responsibilities

• Strong experience in Apache Spark development
• Well versed in Linux Environment
• Extensive experience in application development
• Excellent analytical and process based skills i.e. process flow diagrams, functional diagrams & etc
• History of delivering against agreed objectives
• Demonstrated problem solving skills
• Ability to pick up new concepts and apply to knowledge
• Ability to coordinate competing priorities and drive team work
• Ability to work in diverse team environments that are local and remote
• Strong Communication skills (Verbal and Written)
• Work with minimal supervision
• Collaborate with business analysts and line of business as needed

Requirements Education

• B. Tech, M. Tech, MCA or any master degree from Reputed Educational Institutes
• Certifications If Any

Experience Range

• 10+ year of Industry experience

Foundational Skills

• GraphDB & Hadoop Eco System:
• Java
• Python
• Spark/Scala,
• Spark/DataSet/DataFrame
• Spark-SQL
• Py-Spark
• Tiger Graph or Neo4J or any NoSQL DB
• HIVE
• Impala
• Scala
• Autosys
• Shell Scripting

Desired Skills

• NodeJS/ React JS/ Angular JS
• Restful Services
• Machine Learning/Predictive analytical