Big Data Engineer - Data Lake
Big Data Engineer - Data Lake (ODS)
Country Spain
Open Digital Services is the software development company of Santander Group powering the next generation of banks by creating innovative banking products and implementing them in collaboration with Santander Group Affiliates.
Santander Group is one of the worlds largest financial institutions and the Eurozones leader were committed to being the best Digital Bank with Branches in the industry.
Our mission at ODS is to design and support an advanced digital and omnichannel platform ensuring the best customer experience using cutting-edge technology. Openbank our flagship partner is where we develop our most advanced concepts first. Be part of our Best-in-Class team and help us create unique value for our customers!
Join us to tackle exciting tech challenges in an agile environment benefiting from learning growth and local and international career opportunities in a modern diverse setting.
Currently we are looking for Big Data Developers to make the team even stronger.
Responsibilities
* Design and implement production big data environments using modern technologies.
* Build validate and optimize large-scale big data solutions in heterogeneous data environments.
* Develop and manage ETLs in batch (Spark and Scala) and streaming (Apache Flink).
To be successful in the role you must have
* 3+ years of experience working with Scala Spark software design patterns and TDD.
* Experience working with big data - Spark is a must - Hadoop Hive and/or Kafka would be a plus.
* Experience with different database structures including SQL (Postgres MySQL) and NOSQL (DynamoDB DocumentDB Redis Elasticsearch).
* Experience and expertise across data integration and data management with high data volumes.
* Experience with Cloud ecosystems AWS ecosystem (EMR EC2 IAM GLUE ATHENA S3 CloudFormation LakeFormation Redshift DynamoDB RDS ECS ECR) would be a great plus!
* Experience working in agile continuous integration/DevOps paradigm and tool set (Git Jenkins Sonar Nexus Jira and Splunk).
* Bachelors Degree in Computer Science Information Systems Mathematics or other STEM and related fields or equivalent work experience.
* Professional working proficiency in English.
Nice to have
- Experience with data warehousing apache iceberg and visualisation tools.
- Experience with NRT applications Apache Flink spark streaming.
What do we offer?
* Joining a dynamic and agile environment with plenty of opportunities to grow and have impact!
* Working in a start-up mode with the support of Santander Group in a growing and expansion project.
* Competitive remuneration and attractive benefits package.
* Collaboration in international projects with peers from all around the globe.
* Excellent work environment social clubs and frequent events.
Would you like to grow with us? Join our team!
Our culture sets us apart from the rest social and diversity clubs are part of our essence and day-to-day culture.
ODS is an equal opportunity employer. All applicants will be considered as equal without paying attention to gender identity sexual orientation ethnicity religion age political orientation union membership nor disability status.
We make recruiting decisions based on your experience and skills. We value your passion to discover invent simplify and build.
Scala, Spark, ETL, SQL