Job Location: Bangalore/Bengaluru
Will be responsible for building ETL Pipelines for data ingestion from Data Lake or an external staging
into Snowflake staging. Building data pipelines for data transformation, processing and storage in
Snowflake. Building tables,materialized views, tasks, streams and stored procedures in Snowflake as
part of the data flow architecture.Understanding of Data modelling fundamentals and design
principles.Create and maintain workflow/technical documents for all the development activities. Gather
business requirements from business stakeholders and deliver a solution. Participate in weekly status
meetings to provide updates to stakeholders and provide a strategic plan for upcoming tasks.
Eligibility
Specific skills required are:
Must have
• Strong experience with data analysis, data modelling (Kimball) and governance, with excellent
analytical and problem solving abilities
• Good understanding of Snowflake features – Time travel, Micro partitions, MPP etc. Working
experience on Snowflake utilities such as Snowpipe, Tasks and Streams.
• Experience with use cases of integrating data from multiple heterogenous source systems and
handling of semi structured file formats.
• Good knowledge of Cloud based environments – AWS, Azure or GCP.
• Knowledge of batch and streaming data architectures.
• Strong knowledge of SQL (MSSQL or MySQL or PostgreSQL or Presto).
• Demonstrated strength in data modelling, ETL development, and data warehousing
• Hands-on experience in using Python for data engineering tasks.
• Good knowledge of data lake optimization and partitioning.
• Good knowledge of file formats like parquet, CSV and Hadoop file systems.
• Good knowledge of cronjob scheduling and debugging.
Good to have
• Experience in working on a BI reporting/Visualization platform.
• Experience in working in Linux environments.
• Experience using big data technologies (Hadoop, Hive, HBase, Spark etc.)
• Experience in working in Retail or FMCG.
• Basic understanding of Ambari and Sqoop
General Requirements
Bachelors or Master’s Degree from a reputed college
4 to 7 Years of experience in the Data Engineering domain
1 + Years of expereince in Snowflake
Experience in all stages of DE project work (requirements and logical design, physical design,
implementation, testing and deployment)
Excellent communication and interpersonal skills
Experience communicating with senior management as well as with colleagues from engineering,
analytics, and business backgrounds
Capable of performing under minimal supervision, multi-tasking, meeting deadlines as an
individual contributor, and coaching a team.
Submit CV To All Data Science Job Consultants Across India For Free
