INTEGRATED PERSONNEL SERVICES LIMITED | Jobs | Data Engineer | BigDataKB.com | 31-01-22

    0

    Job Location: Pune

    Roles and Responsibilities

    • Collaborate with Product Management to understand business requirements and design

    appropriate solutions

    • Implementation and enhancement of Data pipelines
    • Designs, codes, tests, supports and documents all new BI systems, applications,

    reports and visualizations .

    • Works with cross functional teams to ensure the necessary data and analysis

    environments are available

    • Develops the overall data transformation workflows and build appropriate frameworks

    for continued new product integrations

    • Responsible for executing technical user stories for sprint.
    • Enforce and follow technical standards for deliverables of projects.
    • Have very good understanding of Continued integration to drive the DevOps

    implementation on respective projects using tools – Github, Jenkins

    Desired Candidate Profile

    3+ years professional experience in Big Data Pipelines using Airflow or similar tools

    • Proficiency in programming languages like PySpark, Python
    • High level of Proficiency in SQL (Advanced) and experience with Semi-structured data
    • ETL/Data Processing Technology for Data warehouse/ Data Lakes:  Apache Spark,

    Talend, any other Open source ETL tool.(at least 2 years of experience in any of these

    tools),

    • Knowledge of Real-time Data streaming  like Apache Kafka , AWS Kinesis, Spark

    Streaming

    • Must have a high degree of initiative to implement solutions in a fast-paced, dynamic

    environment.

    • Must be able to understand business requirements and translate them into technical

    deliveries.

    • Experience in Large dataset integration with variety of different sources, each with

    varying degrees of data quality and cleanliness

    • Knowledge and experience of datastores such as SQL server, PostgreSQL and Cloud

    datastores like  Snowflake Datawarehouse/ Big data datastores

    • Desirable: Dimensional modeling methodologies and development for data warehouses
    • Nice to have: Knowledge on Predictive Analytics, ML, Data Mining models
    • Nice to have: Knowledge on Data Catalogging
    • • Requires strong analytical, conceptual and problem-solving abilities
    • • Familiarity with Agile concepts, and experience practicing SCRUM.
    • • Experience working with remote teams.
    • • Must have excellent communication skills.

    Perks and Benefits

    Apply Here

    Submit CV To All Data Science Job Consultants Across India For Free

    LEAVE A REPLY

    Please enter your comment!
    Please enter your name here