Job Location: Hyderabad/Secunderabad
Mandatory skills* : Data Engineer with AWS using Glue and Spark, Apache Airflow, NiFi, S3,Lambda, MySQL + Scrum master as nice to have
Design and Implement end-to-end ETL solutions on AWS using Glue and Spark for data preparation and feature engineering of data science projects
Be comfortable to convert SQL, Pandas code that data scientists use in experiment notebooks to proper pyspark applications
Develop and maintain data orchestration pipelines using Apache Airflow and data ingestion using NiFi
Improve on existing software, enhance code quality and organize code structure
Implementation of unit and integration tests – Test Driven Development
Submit CV To All Data Science Job Consultants Across India For Free
