Job Location: Bengaluru
– The role requires experience in Azure core technologies – IOT Hub/ Event hub, Stream analytics, IOT Central, Azure Data Lake Storage, Azure Cosmos, Azure Data Factory, Azure SQL Database, Azure HDInsight / Databricks, SQL data warehouse.
You Have :
– 3 – 5 years of software development experience
– Minimum 2 year of experience in IOT/streaming data pipelines solution development
– Bachelor’s and/or Master’s degree in computer science
– Strong Consulting skills in data management including data governance, data quality, security, data integration, processing and provisioning
– Delivered data management projects with real time/near real time data insights delivery on Azure / AWS Cloud
– Translated complex analytical requirements into technical design including data models, ELTs and Dashboards / Reports
– Experience deploying dashboards and self-service analytics solutions on both relational and non-relational databases
– Experience with different computing paradigms in databases such as In-Memory, Distributed, Massively Parallel Processing
– Successfully delivered large scale IOT data management initiatives covering Plan, Design, Build and Deploy phases leveraging different delivery methodologies including Agile
– Experience on handling telemetry data with Spark streaming, kafka, flink, Scala, pyspark, Spark sql,
– Hands on experience on containers and Dockers
– Exposure to streaming protocols like MQTT and AMQP
– Knowledge of OT network protocols like OPC UA, CAN Bus and similar protocols
– Strong knowledge of continuous integration, static code analysis and test-driven development
– Experience in delivering projects in a highly collaborative delivery model with teams at onsite and offshore
– Must have Excellent analytical and problem-solving skills
– Delivered change management initiatives focused on driving data platforms adoption across the enterprise
– Strong verbal and written communications skills are a must, as well as the ability to work effectively across internal and external organizations
Roles & Responsibilities :
You Will :
– Translate functional requirements into technical design
– Interact with clients and internal stakeholders to understand the data and platform requirements in detail and determine core Azure/AWS services needed to fulfill the technical design
– Design, Develop and Deliver IOT data integration interfaces in ADF and Azure Data Bricks with PySpark based data pipelines
– Design, Develop and Deliver data provisioning interfaces to fulfill consumption needs Data Engineer IOT- JD
– Deliver data models on Azure platform, it could be on Azure Cosmos, Delta lake, SQL DW / Synapse or SQL
– Advise clients on ML Engineering and deploying ML Ops at Scale on AKS
– Automate core activities to minimize the delivery lead times and improve the overall quality
– Optimize platform cost by selecting right platform services and architecting the solution in a cost effective manner
– Deploy Azure DevOps and CI CD processes
– Deploy logging and monitoring across the different integration points for critical alerts
Mandatory Skills : PySpark or Scala, Kafka, SparkSQL, Cloud exposure (Azure/ AWS), ML on Python.
Submit CV To All Data Science Job Consultants Across India For Free
