Job Location: Permanent Remote
Job Detail:
We are looking for an experienced Data Engineer to join our team. The successful candidate will be responsible for designing, implementing, and maintaining our company s data architecture, including data pipelines, data storage, and data processing systems. As a Data Engineer, you will work closely with our data scientists, software developers, and other stakeholders to ensure that our data is accurate, reliable, and accessible.
Primary Skill Set:
The candidate must have hands-on experience with programming skills in languages such as Python, Java, or Scala, data processing frameworks such as Hadoop, Spark, or Flink, cloud-based data processing and storage solutions such as AWS, GCP, or Azure, data modeling
Responsibilities:
- Design, implement, and maintain our client s data architecture, including data pipelines, data storage, and data processing systems
- Develop and maintain scalable data pipelines that can handle large volumes of data
- Ensure that data is collected, processed, and stored in a secure and reliable manner
- Collaborate with data scientists and software developers to implement machine learning models and other data-driven solutions
- Create and maintain documentation of our data infrastructure, including data dictionaries, schema definitions, and other technical specifications
- Monitor and troubleshoot data quality issues, and work to resolve them in a timely manner
- Evaluate and recommend new tools and technologies to improve our data infrastructure and processes
Education:
- Bachelor s or Master s degree in Computer Science, Information Systems, or a related field
- 4-8 years of experience in a data engineering role
- Strong programming skills in languages such as Python, Java, or Scala
- Experience with SQL and relational databases, as well as NoSQL databases
- Experience with data processing frameworks such as Hadoop, Spark, or Flink
- Experience with cloud-based data processing and storage solutions such as AWS, GCP, or Azure
- Familiarity with data modeling and schema design principles
- Excellent problem-solving skills and ability to troubleshoot complex data issues
- Strong communication and collaboration skills, with the ability to work effectively in a team environment.
Submit CV To All Data Science Job Consultants Across Bharat For Free
