Job Location: Hyderabad/Secunderabad
What Will You Do
- Build data platforms and streaming engines that are real time in nature
- Optimizing existing data platforms and infrastructure while exploring other technologies
- Provide technical leadership to the data engineering team on how data should be stored and processed more efficiently and quickly at scale
- Build and scale stream batch processing platforms using the latest open-source technologies
- Work with data engineering teams and help with reference implementation for different use cases
- Improve existing tools to deliver value to the users of the platform
- Work with data engineers to create services that can ingest and supply data to and from external sources and ensure data quality and timeliness
What Are We Looking For
- 8+ years of software development experience with at least 3+ years of experience on open-source big data technologies
- Knowledge of common design patterns used in Complex Event Processing
- Proficiency in Streaming technologies: Apache Kafka, Kafka Streams, KSQL, Spark, Spark Streaming
- Proficiency in Java, Scala
- Strong hands on experience in SQL, Hive, Spark SQL, Data Modeling, Schema design.
- Experience and deep understanding of traditional, NoSQL and columnar databases
- Experience of building scalable infrastructure to support stream, batch and micro-batch data processing
- Bonus points
- You ve worked with Amazon Web Services.
Submit CV To All Data Science Job Consultants Across India For Free
