We are looking for a Sr. Data Engineer to join our data team. If you accept this challenge you will be part of a group of passionate people investigating the potential of generative AI and multimodal models to detect fake news. You will work alongside data scientists, ML ops, engineers and fact-checkers in the design of a new generation of intelligent systems capable of verifying information automatically.
Your mission will be to help build the data pipelines, microservices and information architecture that support the intelligent agents we are developing to fight fake news.
Are you decisive and dynamic? Do you like to solve unsolved problems? Do you want to do something to improve society? This is your place.
Requirements
* At least 5 years experience building production-quality software.
* Bachelors or Masters degree and/or equivalent professional experience
* Experience building end-to-end systems as a Platform Engineer, ML DevOps Engineer, or Data Engineer (or equivalent)
* Development of API endpoints for data applications, with Python (FastAPI) or Typescript (Nest.js)
* Design, deploy and maintain SQL (MariaDB) and NoSQL (MongoDB) databases, including schema and table definition
* Knowledge of stream event data architecture (Apache Kafka, RabbitMQ, NATS, etc)
* Development of CI/CD pipelines
* Design, development, testing, deployment and maintenance of ETL/ELT pipelines
* Experience deploying and managing cloud services on AWS, GCP or Azure
* Design and implementation of vector databases (Pinecone, ElasticSearch, FAISS)
* Knowledge of techniques of data quality and governance
Bonus points
* Experience developing and maintaining ML systems built with open source tools
* Hands-on knowledge implementing main data architecture patterns (data mesh, medallion architecture, etc)
* Familiarity with one or more data-oriented workflow orchestration frameworks (KubeFlow, Prefect, Airflow, Argo, etc.)
* Exposure to deep learning approaches and modeling frameworks (PyTorch, Tensorflow, Keras, etc.)
What we offer?
* Competitive salary: 50-80K € based on your expertise in required technologies.
* Fully remote work
* Other perks: career path, off-sites in different cities, cobee card...