Job Location: Delhi / NCR
Position – Big Data Developer/ Senior Big Data Developer
JD for Big Data
- Converting clients functional requirements into technical architecture & front end all discussion with the Client on Project Specifics
- Should be able to design, visualize & implement – Analytics Data Pipelines (Ingestion, Transformation & Visualization) end2end.
- Hands-on expertise in extracting and processing large volumes of data using Big Data technologies like Hadoop, Spark, Hive etc.
- Strong coding skills in Python/Java/Scala with Spark.
- Proficient in writing Spark RDD/DataFrames/SQL to power data for extraction, transformation, and aggregation from multiple file formats including JSON, CSV & other compressed file formats.
- Should have worked on Real Time Data Ingestion using Kafka/Spark Streaming.
- Must be good in writing complex SQL queries and aggregations.
- Strong understanding of OLAP/data warehousing concepts , dimensional models like star schemas, snowflake schemas.
- Should be able to create or POC automated data pipelines for both batch and real-time data stream processing.
- Should have hands-on expertise on designing and developing reliable and robust ETL pipelines.
Preferred Skills:
- Scheduling and orchestration of data work flows using AWS Step Functions, Oozie, Airflow etc.
- Preferably should have worked on implementing CI/CD processes for deployments.
- Should have worked on NoSQL Databases like Mongo, HBase etc.
Good to have skills:
- Working knowledge of AWS technologies like Redshift, Kinesis, Lambda, RDS , S3, Glue, Athena , Dynamo DB would be an added advantage
- Knowledge of BI tools like Power BI, Tableau etc
Submit CV To All Data Science Job Consultants Across Bharat For Free
