Job Location: New Jersey, United States
Role – Data Pipeline Lead Engineer
Location: Weehawken NJ (Hybrid 3 days from office )
Job description
At least 5 years of experience in implementing operational data store (ODS) for the retail banking space, which captures the multiple cross system transactions, providing high throughput and low latency solution using RDBMS or NoSQL Technologies.
Should have experience implementing real time data streaming using Spark and Confluent Kafka. Should have prior experience in implementing the event based real time/near real time updates.
Should have configuration-based coding experience. Write once configure many data pipelines.
Should have hands on experience implementing solutions using ADLS Gen2, Azure Blob storage, Azure Databricks, Azure SQL Server and Azure REDIS Cache.
Should have experience in modelling the Party Data model for the retail banking space.
Well versed in Azure platform engineering using PowerShell, ARM Templates, Cloud Automation Frameworks, Azure DevOps and GitLab.
Familiarity with the technology stack available in the industry for metadata management: Data Governance, Data Quality, MDM, Lineage, Data Catalog etc.
Submit CV To All Data Science Job Consultants Across United States For Free
