Data Engineer
ABOUT US
At BASF Digital Hub Madrid we develop innovative digital solutions for BASF create new exciting customer experiences and business growth and drive efficiencies in processes helping to strengthen BASFs position as the digital leader in the chemical industry. We believe the right path is through creativity trial and error and great people working and learning together. Become part of our team and develop the future with us - in a global team that embraces diversity and equal opportunities.
RESPONSIBILITIES
* Design develop and maintain data models that support analytical needs across various business domains
* Create domain entities to ensure data is organized and accessible for analysis reporting and business intelligence with normalized data model
* Collaborate with data analysts data scientists and other stakeholders to understand data requirements and translate them into effective data solutions
* Implement data integration processes using Azure Data Factory Azure Databricks and other ETL tools
* Utilize Python for data manipulation transformation and analysis within Azure Databricks
* Optimize data storage solutions in Azure ensuring efficient retrieval and performance
* Monitor and troubleshoot data ingestion and transformation pipelines and processes to ensure data quality and integrity
* Maintain documentation of data models architecture and processes for reference and compliance.
* Stay updated with the latest trends and technologies in data engineering and Azure services to continuously improve data solutions.
REQUIREMENTS
* Bachelors degree preferably in computer science Information Technology or a related field
* 5+ years of experience in data engineering or a related field preferably in an Azure environment.
* Proven experience as a Data Engineer preferably in an Azure environment
* Strong proficiency in Azure services including Azure SQL Database Azure Data Lake Azure Data Factory Azure Data Factory and Azure Synapse Analytics.
* Experience with data modelling techniques and methodologies.
* Proficiency in Python for data processing and analysis
* Familiarity with programming languages such as SQL and PySpark
* Knowledge of data warehousing concepts and best practices
* Excellent problem-solving skills
* Strong communication and collaboration skills to work effectively with cross functional teams and global teams
* Knowledge of data governance and compliance frameworks.
BENEFITS
* Responsibility from day one in a challenging work environment and on-the-job training as part of a committed team.
* Adequate compensation according to your qualifications and experience A secure work environment because your health safety and wellbeing is always our top priority.
* Flexible work schedule and Home-office options so that you can balance your working life and private life.
* Learning and development opportunities
* 23 holidays per year
* Another 5 days (readjustments days) and 2 days (cultural days)
* A collaborative trustful and innovative work environment
* Being part of an international team and work in global projects
* Relocation assistance to Madrid provided
At BASF the chemistry is right.
Because we are counting on innovative solutions on sustainable actions and on connected thinking. And on you. Become a part of our formula for success and develop the future with us - in a global team that embraces diversity and equal opportunities irrespective of gender age origin sexual orientation disability or belief.
Python, azure, SQL, PySpark