Big Data Engineer Wanted for our New Project
We are looking for a skilled Big Data Engineer to join our team at Vodafone Group. As part of our VOIS Spain legal entity, we are launching a new technological HUB dedicated to research and development of technical solutions.
The ideal candidate will have experience in designing, building, and managing applications to process large amounts of data in Google Cloud Platform. You will work closely with the team and stakeholders to build and deliver solutions for a next-generation Big Data analytics platform.
Responsibilities:
* Design, build, and manage big data applications on Google Cloud Platform
* Provide expert guidance on integrating structured and unstructured data into a data lake
* Work with the team and stakeholders to build and deliver solutions for a next-generation Big Data analytics platform
* Focus on data streaming, data management, data quality, and data security
* Collaborate with Data Scientists to drive company strategy and marketing campaigns
Requirements:
* Expertise in public cloud PaaS, CaaS, and IaaS tools and environments, particularly with Google Cloud Platform (GCP)
* High experience with cloud services related to DWH and Big Data development on GCP
* Expert-level experience with the Hadoop ecosystem (Spark, Hive/Impala, HBase, Yarn)
* Spanish and an advanced level of English (International team)
* Strong software development experience in Java, Scala, or Python
* Experience with Unix-based systems and distributed technologies
* Good exposure to Docker/Kubernetes and Infrastructure-as-code (IaC)
* Experience orchestrating pipelines using Airflow and working on EDW or Data Warehouse solutions
* Demonstrable knowledge and expertise in Jenkins, GitLab/GitHub, Nexus, or equivalent CI/CD tools
* At least 2 years of experience working with the requested technologies
Nice to Have:
* Experience working with Terraform, Ansible, and scripting languages like Bash, Python, or Ruby
* Experience building systems for real-time data processing using Kafka or similar technologies
* Qualification/Education: Master's degree in computer science, engineering, or other STEM degrees