Job Location: Bangalore/Bengaluru
Greetings! We are looking for Data Engineer with experience in Python, PYSPARK, SQL, Hadoop for Bangalore location. Please find the below JD:
Required knowledge, Skills and qualifications:
- Knowledge of Python and Pyspark is an absolute must.
- Knowledge of Azure, Hadoop 2.0 ecosystems, HDFS, MapReduce, Hive, Pig, Sqoop, Mahout, Spark is important for this role.
- Experience with Web Scraping frameworks (Scrapy or Beautiful Soup or similar).
- Extensive experience working with Data APIs (Working with REST endpoints and/or SOAP).
- Significant programming experience (with above technologies as well as Java, R and Python on Linux).
- Knowledge of any commercial distribution application such as Horton Works, Cloudera, MapR etc.
- Excellent working knowledge of relational databases, MySQL, Oracle etc.
- Experience with Complex Data Parsing (Big Data Parser) a must. Should have worked on XML, JSON and other custom Complex Data Parsing formats.
- Natural Language Processing (NLP) skills with experience in Apache Solr, Python a plus.
- Knowledge of High-Speed Data Ingestion, Real-Time Data Collection and Streaming is a plus.
- Bachelors in computer science or related educational background.
- 3-5 years of solid experience in Big Data technologies a must.
- Microsoft Azure certifications a huge plus.
- Data visualization tool experience a plus.
Submit CV To All Data Science Job Consultants Across India For Free
