Job Location: Bangalore/Bengaluru
JOB TITLE: Lead Data Engineer
JOB TYPE: Permanent
LOCATION: Bangalore, INDIA
Exp : Less than 6-7 years of experience
Notice period: Only Immediate joiners preferred , Candidates with notice period 15 days or lesser than apply.
Must have skills: ADF, ADLS, Synapse Analytics, PySpark / Python
- Expertise using data integration pipelines in ADF using various Activities like Get Metadata, Lookup, For Each, Wait, Execute Pipeline, Set Variable, Filter, Triggers, etc.
- Extensively worked on Data source types SQL server, Oracle, API, flat-files, JSON, CSV and Excel
- Create various Notebooks in Azure Databricks using python, Pyspark and integrated with ADF
- . Designed Azure Logic app to send pipeline success/failure alert emails, files unavailability Experience on Azure DevOps deploying pipelines into Test and Prod Server
- Experience with Snowflake cloud data warehouse and AWS S3 bucket
- Experience in Unstructured data processing like JSON, XML files into Snowflake Using Flatten
- Extensively worked on Informatica PowerCenter – Designer Components Source Analyzer, Target Designer, Transformation Developer and Mapping Designer for Relational and Flat File sources
- Implemented SCD Type 1, Type2 mappings as per the business requirements
- Experience with Unix, Python scripting and working in Agile Methodology
- Expertise in writing and debugging SQL Queries and Stored Procedures
- Possess excellent interpersonal, communication and analytical skills with demonstrated abilities in customer relationship management
Submit CV To All Data Science Job Consultants Across India For Free
