Job Location: Bangalore/Bengaluru
Position Responsibilities:
- The Current position is expected to implement Data Orchestration -Data Transformation and Data integration using MS Azure services.
- Data Extraction, Transformation, Loading are main responsibilities considering enterprise data management for data lakes and data warehouses.
- MS Azure Data Engineer (MS Certified) is mandatory
- Experience in working with AGILE model
Responsibilities
- Understand the product requirements and work on robust data platform on Azure cloud technologies.
- Create reusable and scalable data pipelines
- Develop and deployment of new data platforms
- Use Azure data services for development of Big Data Platforms
- Creation of reusable components for rapid development of data platform
- Implement Azure Cloud data warehouses, Azure and No-SQL databases and hybrid data scenarios
- Manage Azure DevOps pipelines
- Develop batch processing, streaming and integration solutions
- Automate Azure Data Factory pipelines
- Manage source data access security
- Configure authentication and authorization
- Manage and enforce data policies and standards
- Monitor databases and data processing for a specified scenario
- Implement big data real-time processing and integration solutions
Basic Qualifications (Required Skills/Experience )
Education: B.E./M.Sc./M.E./M. Tech in Computer science / Information science
Experience: 5 – 10 years in Core Data Engineering.
Minimum 3 Years in Azure Data Engineering
Knowledge & Skills
- Very strong at SQL-PL SQL-Spark SQL.
- Interaction with No SQL Databases.
- Interaction with Event Hub, IoT Hub Databases
- Files Processing XML, CSV, Excel, Jason, etc. Formats
- Structured and Non-Structured Data processing
Data ETL Capabilities. - Knowledge of Distributed Big Data Processing
- Data Warehouse and Data Lake Implementation experience in past.
- Interaction with REST APIs , Web Services
- Azure Databricks / Apache Spark Analytics Platform
- Azure Datafactory
- Kafka
- PowerBI / Tableau Analytics and create visualization.
- RDBMS – PostgreSQL
- NoSQL – Azure Cosmos DB
- Airline Operational data analysis experience
Submit CV To All Data Science Job Consultants Across India For Free

