Hands on experience working on (Mandatory)

• Spark Core, Spark SQL
• SQL/Hive/Impala
• Git/SVN/Any other VCS and Data warehousing

Primary Skills:

• Hadoop Ecosystem(HDP/Cloudera/MapR/EMR etc)
• Azure data factory/Airflow/control-M/Luigi
• PL/SQL
• Exposure to NOSQL(Hbase/Cassandra/GraphDB(Neo4J)/MongoDB)
• File formats (Parquet/ORC/AVRO/Delta/Hudi etc.)
• Kafka/Kinesis/Eventhub

Good to have experience working on

• Spark Streaming
• Cloud exposure (Azure/AWS/GCP)
• Azure data offeringsADF, ADLS2, Azure Databricks, Azure Synapse, Eventhubs, CosmosDB etc.
• Presto/Athena
• Azure DevOps
• Jenkins/ Bamboo/Any similar build tools
• Power BI
• Prior experience in building or working in team building reusable frameworks,
• Data modelling.
• Data Architecture and design principles. (Delta/Kappa/Lambda architecture)
• Exposure to CI/CD
• Code QualityStatic and Dynamic code scans
• Agile SDLC