Job Location: Hyderabad/Secunderabad

Roles and Responsibilities

As a Data Engineer, you will build a variety of big data analytics solutions, including big data lakes. More specifically, you will:

• Design and build scalable data ingestion pipelines to handle real-time streams, CDC events, and batch data.
• Execute high-performance data processing for structured and unstructured data and data harmonization.
• Schedule, orchestrate and validate pipelines.
• Design exception handling and log monitoring for debugging.
• Make tech stack and tools-related decisions.
• Collaborate with business consultants, data scientists, and application developers to develop analytics solutions.

Required Skills

• Hands-on experience with Hadoop ecosystem – HDFS, Hive, Sqoop, Kafka, ELK Stack, etc Spark, Scala, Python and core/advance Java NoSQL databases e.g. Hbase, Cassandra, MongoDB.
• Relevant AWS or GCP components required to build big data solutions Good to know: Databricks, Snowflake.
• Ability to develop and manage scalable Hadoop cluster environments.
• Good understanding of data warehousing concepts, distributed systems, data pipelines, ETL.
• 4+ years of tech experience with at least 2 years in big data engineering Designation will be commensurate with expertise/experience. Compensation packages are among the best in the industry

Apply Here

Submit CV To All Data Science Job Consultants Across India For Free