INDSAFRI INDIA PRIVATE LIMITED | Jobs | Data Engineer | BigDataKB.com | 31-03-22

05/04/2022

Job Location: India

Initial contract 12 months extended based on performance

Type: Full Time (Kindly ignore if you are looking for a permanent, part-time, or freelancer role)

Roles and Responsibilities

A data pipeline is a series of automated, programmatic steps. These data pipelines gather data from numerous, potentially disparate data sources and bring everything together into a central place (data lake & warehouse) where it is made readily available for downstream consumption.

Duties:

1. Develop & maintain data pipelines in support of downstream data delivery.

2. Perform analysis of organizational data & create reports to communicate the results.

Other potential duties include, but are not limited to:

Communicate and advocate for a data-driven mindset in the larger organizational community, especially the IT department.
Investigate and evaluate emerging technologies like robotic process automation (RPA), new AWS services, new data management approaches, machine learning advancements, etc.
Liaise with individuals in the organization in support of all the above duties.

Desired Candidate Profile

Good programming skills in both Python and SQL.
Good database design skills and an understanding of data warehousing techniques and approaches.
An understanding of and ability to access data from sources such as:
Microsoft SQL Server
Oracle, MongoDB, Amazon S3, Windows, and Linux file systems
HTTP APIs, SFTP sites
An ability to engineer cloud-first solutions in the Amazon Web Services cloud.
An interest in machine learning and advanced analytics, and the development of data pipelines in support thereof.
An understanding of the software development process, with proficiency in Git for version control and build & deployment pipelines in GitLab.
An ability to create reports and BI dashboards to communicate data & analysis results, using a variety of technologies, which might include: o Microsoft SQL Server Reporting Services, Microsoft PowerBI, Microsoft Excel

Perks and Benefits