Job Location: Kolkata
Roles and Responsibilities
Bigdata Hadoop Developer JD:
Must Have: Python/Scala, Hadoop, Hive. Spark, SQL, Sqoop, No-SQL DB
Good to have: Airflow, NiFi, Kafka, AWS, Cloudera Data Engineer(bigdata) Certification
Description:
- Good to have an understanding on Data Modelling, Data Preparation, Data Validation, Data Pipeline concepts
- Having basic knowledge of NIFI and HVR-CDC would be an added advantage.
- Should be a good team player and flexible to work in shift timings.
- Hands on experience in object oriented or functional programming such as Java or Scala
- Good experience of writing and optimizing Hive/Spark SQL Queries
- Experience in developing optimum data ingestion pipelines using Hive/Spark
- Hands on experience in NiFi pipeline creation
- Familiarity with containerization technology, docker and kubernetes.
- Good to have experience in cloud data integration technology stacks AWS (Glue, Kinesis, Lambda etc) or Azure (ADLSGen2, Functions, ADF etc)
- Good to have workflow scheduling tools experience Oozie/Airflow
- Good to have enterprise messaging Kafka experience
- Must have Strong communications skills and experience leading/interacting with technical experts, client management and offshore coordination.
Desired Candidate Profile
Perks and Benefits
Submit CV To All Data Science Job Consultants Across India For Free
