Data Engineer with Azure
Job Title Data Engineer Azure Data Lake Solutions
Location Porto mostly remote office presence required 2-4 days a month
Type 12 months B2B Contract with possibility of extension
Job Overview
We are seeking a skilled Data Engineer to design build and manage robust data lake solutions using Microsoft Azure technologies. The ideal candidate will have a passion for working with complex datasets enabling data-driven decisions and delivering scalable solutions that meet organizational goals.
Key Responsibilities
Data Lake Development Design implement and optimize data lake architectures to support data storage processing and analytics needs.
Azure Ecosystem Develop and manage solutions using Azure services such as Azure Data Lake Azure Data Factory Databricks and Synapse Analytics.
Data Integration Create ETL/ELT pipelines to extract transform and load data from various structured and unstructured sources.
Data Governance Implement and maintain data quality metadata management and security standards in the data lake.
Collaboration Work closely with data scientists analysts and other stakeholders to understand business needs and translate them into technical solutions.
Performance Optimization Monitor and fine-tune system performance for data processing workflows and ensure high availability.
Documentation Maintain comprehensive documentation of data architecture processes and workflows.
Qualifications
Education Bachelor s degree in Computer Science Information Technology or related field. Master s degree is a plus.
Experience
o Proven experience in data engineering roles with a focus on Azure-based solutions.
o Hands-on experience with Azure services such as Data Lake Storage Data Factory Synapse Analytics and Databricks.
o Strong understanding of data lake architectures and principles.
Technical Skills
o Proficiency in programming languages like Python Scala or Java.
o Expertise in SQL and database management.
o Familiarity with big data frameworks such as Hadoop or Spark.
o Experience with data modeling and building data pipelines.
o Knowledge of version control tools (e.g. Git) and CI/CD pipelines.
Soft Skills
o Strong problem-solving skills and attention to detail.
o Excellent communication and collaboration skills.
o Ability to work in a fast-paced dynamic environment.
Azure, Data Lake, Azure Data Factory, SQL