Our team is accelerating the application of advanced analytics and modeling in the Intelligence Transportation System sector. Our team is seeking a Senior Data Engineer to help us develop and maintain our data platform and data pipelines .
Key responsibilities of the role include:
1. Design, build, and optimize our data platform and infrastructure to support both batch processing and real-time ingestion, ensuring we monitor operational quality and process raw data for modeling and analytics.
2. Design, build, and maintain efficient data pipelines to integrate data from multiple sources into data warehouses and data lakes.
3. Design, build, and maintain big-data solutions to process large amounts of data. Deploy these solutions both on-premise as well as cloud.
4. Optimize database schemas and queries to ensure performance and scalability.
5. Collaborate closely with Data Analysts, Data Scientists, and Software Engineers to ensure data quality, availability, and democratization.
6. Keep detailed data governance, security, and scalability documentation up to date.
WHAT DO WE NEED IN OUR TEAM?
For these reasons, we are seeking experts with the following qualifications :
7. Demonstrated experience with Data Warehouse concepts, database schema design, and performance optimization, with proficiency in at least one popular SQL engine such as Microsoft SQL Server or PostgreSQL.
8. Proficiency in at least one programming language or framework, such as Python, C#/.NET, or PySpark, to build efficient ETL processes.
9. Familiarity with the Python data stack (Pandas, Numpy, Scikit-learn, Pytorch, etc.)
10. Hands-on experience with modern data orchestration frameworks, such as Airflow, Prefect, or Luigi
11. Expertise in containerization and container management with Docker and Kubernetes is highly valued.
12. Experience with big data and observability frameworks, such as Spark, Hive, Hadoop, and Elasticsearch.
13. Experience with at least one cloud provider (AWS, Azure, or GCP) is a plus.
WHAT DO WE OFFER?
Hybridworking model and 8 weeks per year of teleworking outside your usual geographical area.
Flexible start and finish times, and intensive working hours Fridays and insummer.
Personalizedcareer plan development, training and language learning support.
National and international mobility. Do you come from another country?We can offer you a relocation package .
Competitivecompensation with ongoing reviews, flexible compensation anddiscount on brands.
Wellbeingprogram: Health, dental and accident insurance; free fruit and coffee ,physical, mental and financial health training, and much more!
️