Job Location: Pune

Role & Responsibilities

• Good working experience in the latest cloud ETL tools such as ADF/Glue/Dataflow
• Understand and execute in-memory distributed computing frameworks like Spark and/or DataBricks.
• Build and maintain data pipelines to support large scale data management projects
• Understand and translate data, analytic requirements, and functional needs into technical requirements.
• Expertise in data structures, distributed computing, manipulating, and analyzing complex high-volume data from a variety of internal and external sources
• Solid hands-on working experience in SQL and scripting.
• Knowledge of Python,
• Experience in any orchestration/workflow tools for scheduling pipelines

Desired Skills:

• Must have skills: Azure data factory, Azure data bricks, Pyspark
• 5 to 14+ years of professional experience with database technologies and ETL tools (SSIS and 3+ years of Azure ADF and Azure Data factory).
• 3-5+ years of hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure data bricks, Python, Pyspark, etc.
• Good knowledge of AZURE Cloud platform services stack – Azure Data Factory, Azure Synapse, Azure SQL Database, AZURE Data Warehouse, Azure data bricks, Azure Blob Storage, Azure Data Lake Storage, HD Insight, Cosmos DB, etc.
• Hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure data bricks, Python, Pyspark, etc.

Apply Here

Submit CV To All Data Science Job Consultants Across India For Free