Job Location: Bengaluru, Karnataka, India
Responsibilities
- Develop, construct, test and maintain existing and new data-driven architectures
- Align architecture with business requirements and provide solutions which fits best to solve the business problems
- Build the infrastructure required for optimal ETL pipelines from a wide variety of data sources using SQL and AWS – big data- technologies
- Use programming language(preferably python) and tools efficiently to collate the data
- Identify ways to improve data reliability, efficiency, and quality
- Use data to discover tasks that can be automated
- Set up practices on data reporting and continuous monitoring
Requirements
- Experience in developing and optimizing ETL pipelines, bigdata data pipelines, and data-driven architectures
- Strong knowledge in programming using Python preferably.
- Strong analytical skills related to working with different types of datasets
- Build processes supporting data transformation, data structures, metadata, dependency and workload management
- Experience supporting and working with cross-functional teams in a dynamic environment
- Strong knowledge of working with different OS Linux, Windows, etc
- Additional brownie points for having good
- Experience with big data tools: Hadoop, Spark, Hive, etc
- Experience with relational SQL and NoSQL databases, including Postgres, Amazon Redshift and MongoDB.
- Experience with AWS/GCP/Azure cloud services: S3 EMR, Glue, RDS, Redshift
- Experience with object-oriented/object function scripting languages: Python
Submit CV To All Data Science Job Consultants Across Bharat For Free
