Job Location: Gurgaon/Gurugram
Roles and Responsibilities
Job Description:
The Data Hub Team is looking for a Senior Big Data who will be responsible for the following:
- Coordinate with Solution Architect to arrive at a technical solution for the problem statement.
- Proactively keep the Project Managers and Client stakeholders updated
- Should prepare Low Level Design Document
- Should participate in preparing High Level Design Document
- Manage CI/CD Pipelines
- Periodic Code Review and Code merge
- Assist in documenting requirements and resolving technical clarification with client
- Track and help the client/vendor to complete the UAT
Technical Key skills:
- Should have minimum 4 years in Big Data; which includes knowledge on Apache Spark, Hive, Oozie/Airflow, Scala/Java and AWS CLI commands
- Experience on AWS and AWS CLI commands
- Experience in reading data from various sources like RDS, SQL Server, files etc. and transform it according to end user needs
- Experience in writing complex Hive queries to ensure data integrity and validating business rules
- Knowledge in Creating Apache Oozie workflows to visualize batch and real – time data pipelines running in production
- Experience on developing complex data processing pipelines
- Experience on performance tuning of Spark Jobs
- Experience on CI/CD Deployments
- Good knowledge of UNIX and Bash commands
- Knowledge of BFSI domain is plus.
Desired Candidate Profile
Perks and Benefits
Submit CV To All Data Science Job Consultants Across India For Free
