Job Location: Noida
Responsibilities:
Role: Engineer
Qualification: B.Tech(CS-IT) / MCA
Desired Skills:
In-depth architectural knowledge of Spark and Hadoop
Expert in building ETL pipelines using Spark (Pyspark)
Experience using Spark with HDFS,
Experienced writing data pipelines using functional programming (Python – must, Java, or
Scala)
Advanced ANSI SQL experience
Firm understanding of Big Data and traditional data processing, understanding the differences
in-depth to make informed design decisions
Firm understanding of data Modelling OLAP vs. OLTP vs. Hybrid models
AWS, Azure, or Google Cloud knowledge (at least one cloud)
Good to have Technical Skills:
Experience using Spark with Cloud Storage and Hiveserver2 LLAP (HWC)
Proven track record of developing DAGs using Apache Airflow
Exposure to Ranger and Atlas
Core Responsibility Areas:
Working with data modeling of complex data?
Exposure to retail 3pl and international preferred
Setting up scaling tuning, no sql, db, postgresql, cassandra mongo db ms sql
Helping team make the right choice of db based on nfr
Generating er diagrams db scripts
Working with data generation tools
Working on data cleansing
handling of cache (elastic or redis) and master and transaction data for complex large volume
multinational organization with high volume and low response time
learn and implement new db and cloud and technologies
Cloud knowledge and working on aws, azure, or google cloud.
Submit CV To All Data Science Job Consultants Across India For Free
