Job Location: Gurgaon/Gurugram

Data Engineer

Experience

• Bachelors degree from Tier I/II colleges (Post Graduation – Good to have, not mandatory)
• 2-4 years of experience in Data Engineering

Responsibilities

• Requirements gathering, system analysis, design, development/configuration of new data sets/marts.
• Build ETL pipelines in Spark / Python / Scala and standardize data fields across various data sources
• Create data dictionaries, setup/monitor data validation alerts and execute periodic jobs 
• Define and build technical/data documentation and experience with code version control systems (e.g. git). Ensure data accuracy, integrity and consistency

Necessary knowledge

• Proficiency in:
• Programming languages: Python, SQL
• Apache Spark, Apache Airflow
• Docker, Bash
• Cloud: Either of below:
• Azure Data Factory
• Google Cloud Dataflow / Data Fusion
• AWS Data Pipeline / Glue
• Stitch / Snowflake
• Data Streaming: Kafka/Kinesis 
• Good to have: Tableau/PowerBI Other Visualization tools
• Strong experience in creating large scale data engineering pipelines, data marts and warehouses
• Experience with SQL for extracting, aggregating and processing big data Pipelines using Python 
• Good working knowledge of using and developing Data APIs
• Experience with complex, high volume, multi-dimensional data based on unstructured, structured, and streaming datasets

Other Desirable competencies

• Excellent interpersonal skills and the ability to successfully interact with stakeholders from senior management to junior staff
• Proactively solves problems and seeks to own the resolution of issues throughout the lifecycle
• Takes critical feedback in stride, and adjusts approaches accordingly
• Digitally savvy, able to navigate easily in a virtual world
• Team player and not afraid to challenge the status quo
• Good Logical Thinking and Problem-Solving Skills

Note: Preferred immediate joiners or 15-30 days notice

Apply Here

Submit CV To All Data Science Job Consultants Across India For Free