At Kantox we are looking for a Data Engineer to join our Data team to design, improve and enhance our current data architecture. Kantox is a growing organisation with growing data needs, therefore scalable, reliable and efficient data architecture and orchestration of data pipelines are fundamental for our business.
This is an exciting full-time job with great challenges, as you will help build and automate our streaming data architecture and help us grow our Data team. You will be joining a vibrant and passionate group of software engineers that hail from all parts of the world.
The Kantox Engineering Manifesto
Kantox is a team sport. Our engineering culture is devoid of egos yet we take great pride in our work. We believe in constructively challenging each other pushing our knowledge, code, processes to the absolute limit.
Our processes are based around continual self-improvement, continuous code integration and deployment.
About the team
You will collaborate closely with data science, business intelligence, and cloud engineering teams to develop and manage data products across multiple domains. Your efforts will ensure the delivery of data that supports internal decision-making and provides clients with scalable and reliable visibility.
Your future role at Kantox
As a Data Engineer, you will play a pivotal role in enhancing and optimising our data systems to support our Data Lake/Data Mesh infrastructure and meet our data processing requirements. Your work will enable the creation of high-performance, scalable data products company-wide, while ensuring proper data governance. You will also leverage and improve our existing AWS-based data platform, utilising a tech stack that includes Dagster for managing data assets, Deltalake for data storage, Kafka/RabbitMQ for streaming, dbt/DuckDB for transformations, and Terraform, Kubernetes, and ArgoCD for infrastructure management.
What you will do
* Collaborate with a talented and diverse team to develop and enhance our data platform, enabling efficient data collection, processing, accessibility, usability, and monitoring.
* Automate the self-service platform and create tools for generating data products.
* Build highly scalable and reliable data assets using Python, Scala, and Spark/PySpark.
* Integrate new and existing data sources into our ETL and reverse ETL pipelines.
* Design a data strategy that leverages the appropriate tools for data governance, cataloguing, and discovery, while ensuring secure access.
* Ensure data quality and reliability by implementing standardised monitoring, CI/CD, and testing practices.
* Continuously explore and adopt new technologies and best practices to enhance our data infrastructure.
* Work within the Tech Team, adhering to agile methodologies.
* Gain a deep understanding of the business to identify the data needs of various internal and external stakeholders, applying this insight to design optimal solutions.
Who you are
* Over 4 years of professional experience as a Data Engineer, with proven expertise in delivering efficient data solutions in production environments.
* Experience building data systems with real-time data streams, preferably using Kafka, and batch processing systems with Apache Spark/PySpark.
* Skilled in ingesting data from various sources, including relational databases, NoSQL databases, unstructured data, and data streams.
* Proficient in Python programming (knowledge of Scala is a plus).
* Experience with orchestration tools such as Dagster, Airflow, and Prefect.
* Familiar with AWS services like S3 and Redshift.
* Knowledgeable in infrastructure tools such as Terraform, Kubernetes, and ArgoCD.
* Experience with data quality tools like Great Expectations, Soda, or data contracts.
* Solid understanding of software engineering practices, including version control, CI/CD, testing, and documentation.
* Familiarity with Data Lifecycle Management, including development, storage, and access.
* Experience with agile methodologies and collaboration tools like Jira and Confluence.
* Strong team player with the ability to communicate effectively across multiple teams and stakeholders, both internal and external.
* Adaptable to dynamic environments, committed to continual improvement, and quick to embrace change and adopt new technologies.
* Fluent in English.
* Permission to work within the EU is a plus.
Our culture
* An environment of innovation, accountability, and constructive feedback
* A diverse and multicultural team of over 40 different nationalities
* Grow your role and build your career with our learning and development opportunities.
* A collaborative and inclusive culture of sharing and teamwork. Build connections for life.
* Hybrid working and flexible hours so you can work when and where you feel best
What we offer:
* Competitive salary
* Sponsored learning budget
* Free private health insurance
* Free Spanish, English, French and Catalan lessons
* Relocation package if needed
* Flexible working hours + short Fridays
* Hybrid work model
* 29 days of annual vacations
* Gym discounts and free sports activities
* Restaurant Ticket with monthly credit and regular cross-team lunches
* Fresh fruit and unlimited coffee
* Pizza Fridays
* Beautiful office with incredible 360-degree views of Barcelona
About Kantox
Kantox is a leading fintech company developing sophisticated Currency Management Automation software solutions that help companies to automate their foreign exchange processes and leverage currencies for growth.
We are a 200-person strong team, split between London and Barcelona. So far, we’ve raised over €30 million and became profitable in 2018. Thanks to our clients, we continue to grow at a fast pace. Clients in 75 countries have already exchanged more than USD $18 billion with us!
In October 2022, BNP Paribas signed an agreement for the acquisition of Kantox. Kantox will continue to operate as an independent company, now with the experience and market power of BNP Paribas behind it. The acquisition is subject to regulatory approvals and is expected to be completed in the coming months.
Our Commitment to Diversity, Equity & Inclusion
Kantox is deeply committed to diversity, equity and inclusion both in our hiring practices and in our experiences as a Kantox employee.
We’re proud to be an equal opportunity employer, and encourage all applicants regardless of race, religion, or belief (if any), colour, nationality, ethnic or national origin, gender, gender identity, pregnancy and maternity, sexual orientation, age, marital and civil partnership status, or disability status.
#J-18808-Ljbffr