Job Location: Alpharetta, GA
Job Detail:
Title: Data Engineer
Location: GA; Alpharetta (Hybrid)
Duration: 12+ Months
Job Description:
Hybrid 3 days a week onsite
Databricks Operations is part of the Hadoop Support team. This team is responsible for managing the Databricks plant across ***. Working within an Agile delivery (Scrum/Kanban/Scrumban)/ DevOps methodology. Support the application development teams and help them in debugging and fixing an issue.
Responsibilities and activities of these team include, but not limited to
– Build, Upgrade and maintain Hadoop clusters with several nodes.
– Monitoring and troubleshooting of services running on Hadoop clusters.
– Performance tuning.
– Setup of backup and recovery.
– Troubleshooting User issues which include User on boarding, job failures.
– Installing and integrating of a new services onto the Hadoop cluster.
– Working with Vendor to discuss/apply issue bugs, patches and issues.
– Deploy and automate the implementations/fixes using Ansible scripts.
– Hands-on experience on the administration side of DataBricks preferably on Azure.
– Prior experience in a support role on admin side of Databricks on one of Azure/AWS/GCP cloud
– Excellent knowledge of git and Jenkins. Understanding of distributed systems and databases, cloud computing environments – Azure/Linux(mandatory skills)
– General familiarity with Docker and Kubernetes concepts
– Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory, Azure Databricks)
– Good understanding of other Azure services like Azure Data Lake Analytics & U-SQL, Azure SQL DW
– Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment.
– Working within an Agile delivery (Scrum/Kanban/Scrumban)/ DevOps methodology.
– Deploy Azure Databricks workspaces using IaC (terraform + azure devops)
Qualification:
– Experience in Cloudera Hadoop distribution CDH 6.x and CDP 7 is preferred.
– Experience with Cluster maintenance tasks like adding and removing nodes, enabling High availability, installing services, applying patches.
– Hands-on experience on the administration side of DataBricks preferably on Azure.
– Unix Shell, perl or python scripting.
– Some development experience in Databricks on Azure/AWS/GCP is desired
– Some developer skills in Python is desired
– Some experience with Terraform for IaaC
Job Type: Contract
Pay: $45.00 – $50.00 per hour
Benefits:
- Dental insurance
- Health insurance
- Vision insurance
Experience level:
- 4 years
Schedule:
- 8 hour shift
Ability to commute/relocate:
- Alpharetta, GA 30005: Reliably commute or planning to relocate before starting work (Required)
Experience:
- HDFS: 1 year (Required)
- Azure Data Lake: 3 years (Required)
- Jenkins: 1 year (Preferred)
Work Location: One location
Submit CV To All Data Science Job Consultants Across United States For Free
