Job Title: Data Engineer
We are seeking a skilled Data Engineer to join our team at Luxe Vision Consulting, a Wisconsin-based consulting firm dedicated to connecting top global talent with leading U.S. companies.
The ideal candidate will have strong experience in designing, building, and maintaining scalable data pipelines and architectures, as well as expertise in big data technologies such as Apache Spark, Hadoop, or Kafka.
Responsibilities:
* Data Pipeline Development: Design, build, and maintain efficient data pipelines to process and transform large datasets.
* ETL & Data Integration: Develop and optimize ETL workflows for structured and unstructured data sources.
* Big Data Processing: Work with PySpark and Pandas to handle large-scale data processing tasks.
* Database Management: Design, implement, and manage relational and non-relational databases for data storage and retrieval.
* Cloud Technologies: Leverage cloud platforms such as AWS, GCP, or Azure to deploy and manage data infrastructure.
* Collaboration: Work closely with data scientists, analysts, and software engineers to support analytical and machine learning projects.
* Data Quality & Performance Optimization: Ensure data accuracy, consistency, and security while optimizing performance.
* Monitoring & Troubleshooting: Identify and resolve data pipeline performance bottlenecks and failures.
Ideal Profile:
* 2+ years of experience in data engineering or a related field.
* Proven experience developing ETL pipelines and data processing workflows.
* Hands-on experience with PySpark, Pandas, and SQL.
* Familiarity with cloud data solutions (AWS, GCP, or Azure).
What's on Offer?
* Work within a company with a solid track record of success.
* Attractive salary & benefits.
* Excellent career development opportunities.