Job Location: Hyderabad/Secunderabad
We are open to hiring for this role in either Hyderabad / Bengaluru
We are seeking a Developer with a minimum of 3 years of hands-on experience in Big Data systems. In this role, you shall design, implement and maintain data pipelines in Huge Data Lake systems. You are required to have expert-level knowledge of using Python, PyHive, PySpark, etc. You are expected to be proficient in wiring complex SQL Queries and procedural scripts.
No of Positions
1
Skills Required
- Hands-on experience with Python Scripting
- Experience in Hive connecting to Cloudera or Hortonworks Hadoop Data Platforms
- Experience in Integrations with EDW and building ETL pipelines
- Experience in Spark, MapReduce, and associated Big Data platforms
- Experience in Data Lake implementation
- Experience in RDBMS (Oracle, MYSQL)
- Experience in HA, DR
- Experience in working with AWS Essentials and Big Data services such as Amazon S3, Amazon EMR, Kinesis, Redshift, and Quick Sight, etc.
- Machine Learning Techniques, NLP
- Experience in NoSQL (MongoDB, MEMSQL, Mark Logic, etc.)
- Visualization and business analytics (Tableau, ClickView, and others)
Roles & Responsibilities
- Interface with onsite/offshore team to gather, understand, and translate requirements related to Data Pipelines and Big Data Processing into the delivery process.
- Work closely with other Engineers to provide technical requirements and implementation details.
- Develop Python scripts for loading data into Data Lake systems
- Deploy, Run, and Debug the scripts developed by the team
- Configure and Manage Big Data systems
- Ensure continuous improvement in data engineering excellence by implementing best practices for coding, testing, and deploying.
Submit CV To All Data Science Job Consultants Across India For Free
