Must – Have :

• Expertise in at least one popular Python framework (like Django, Flask or Pyramid)

• Data Engineering and Analytics, Building Data Pipelines, Implementing algorithms in a distributed environment.

• Write Python scripts to parse data and invoke APIs / Scripts and to parse data from Databases.

• Develop Airflow jobs after gathering and translating end user requirements.

• NoSQL experience, especially Elasticsearch.

• Implement CI/CD for Airflow DAG deployment.

• Familiarity with front-end technologies (like JavaScript and HTML5).

• Python-based automated ETL pipelines for a wide variety of data sources

• Work on Agile/Lean development methods using Scrum/Kanban

• Work directly with engineering teams for design and build their development requirements.

• Hosting an application on Cloud using Docker and Kubernetes

Technical Skills :

• Python, Python Libraries like Django/Flask, REST API/Microservices

• NoSQL or SQL Data base like MongoDB, PostgreSQL, SQLite,Elasticsearch

• CI/CD platform like Jenkins, Docker Kubernetes.

• Strong in OOPS and Design Patterns concepts.

• Data Structures and able to write all logical programming.

• GIT, Jira (Agile)

• Unit Test case like PyTest etc.

• Good to know AWS (Lambda, ECS, EC2, S3, SQS, Elastic Transcoder).

• Nice to have experience in custom ETL workflow experience.

• Python libraries like Numpy, Pandas etc.

• Be responsible for the performance and usability of the system

• Bring forward ideas to experiment and work in teams to transform ideas to reality

• Strong problem solving, deductive reasoning, and decision making skills.

• Should possess very good communication with strong business analyst skills.

• Maintain high standards of software quality by establishing good practices and habits within the Development team while delivering solutions on time and on budget.

• Demonstrated ability to quickly learn new tools and paradigms to deploy cutting edge solutions.

Nice to have :

• Familiar with AWS services, especially S3, big data services and DevOps tools

• B.E. or in Computer Science, Engineering, or other relevant technical field.

• Must have 7+ years of relevant industry experience.

• Superset / Kyligence/ Snowflake/ Redshift nice to have.