Job Location: Hyderabad/Secunderabad, Pune, Chennai, Bangalore/Bengaluru

Job description:

–

• Primary Skills : Google Cloud Dataflow, Big Data, Hadoop Ecosystem

• Secondary Skills : SQL

• Degree : B.E-Bachelor Of Engineering, MCA – Master Of Computer Application, MS-Master Of Science

• Requiements:
1. GCP Big Query
2. GCP Data Proc
3. Python, SQL
4. Airflow

Skill:

1. Candidate should be very strong in GCP having worked on streaming services. If not GCP, It can be compromised with someone equally strong in Hadoop.

2. Should be able to write code in scala/python

3. Should have expertise in Oozie, NiFi or AirFlow

Job Description:

• Bachelor’s degree in computer science, or any engineering discipline
• Build and maintain data management workflows. Build and maintain Data ingestion pipelines for batch, micro-batch and real time streaming on big query with Google Cloud
• GCP Certified developer on Biq Query and Data Proc
• Experience in building Data ingestion pipelines for batch, micro-batch and real time streaming on big data/Hadoop platforms
• Hands on experience on Hadoop big data tools HDFS, Hive, Presto, Apache Nifi, Sqoop, Spark, Log Stash, Elastic Search, Kafka & Pulsar
• Experience in collecting data from Kafka/Pulsar message bus and transporting the data to public/private cloud platform using NiFi, Data Highway and log stash technologies
• Experience in building CI/CD pipeline & Dev Ops is preferred
• Development experience with Agile Scrum/Safe methodology

Interested candidate forward your updated profile to anitha.rajamani@cielhr.com

Immediate joinees are highly preferrable..

Apply Here

Submit CV To All Data Science Job Consultants Across Bharat For Free