Job Description:

Job Responsibilities:

Senior Data engineer with 8+ years of hands-on experience working on Big Data Platforms.

• Experience building and optimizing data pipelines and data sets ranging from Data ingestion to Processing to Data Visualization.
• Expert in software dev (Scala, Java, Python, Pyspark, Docker contain., Linux)
• Good Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and streaming data processing

– Good experience in any one programming language -Scala/Python , Python preferred.

• Experience in writing and optimizing complex Hive and SQL queries to process huge data. good with UDFs, tables, joins, Views etc
• At least 2 years of experience in the IT industry in analytic application/solution development
• Exp. in network technologies and distr. systems appreciated
• Strong customer focus, assertiveness and precise method of operation
• Experienced in working in agile software development teams