Senior Data Engineer AWS
In NS Group, we are selecting a Data Engineer who will be responsible for implementing complex data pipelines and analytics solutions to support key decision-making business processes in our clients' domain.
Key responsibilities include:
1. Work closely with Product Owners and AWS Professional Service Architects to understand requirements, formulate solutions, and implement them.
2. Implement scalable data transformation pipelines as per design.
3. Implement Data model and Data Architecture as per laid out design.
4. Evaluate new capabilities of AWS analytics services, develop prototypes, and assist in drawing POVs; participate in design discussions.
Requirements:
1. Minimum 3 years experience implementing transformation and loading of data from a wide variety of traditional and non-traditional sources such as structured, unstructured, and semi-structured using SQL, NoSQL, and data pipelines for real-time streaming, batch, and on-demand workloads.
2. At least 2 years implementing solutions using AWS services such as Lambda, Step Functions, Glue, S3, Redshift, Kinesis, DynamoDB, and Apache Spark.
3. Experience working with data warehousing, data lakes, or Lakehouse concepts on AWS.
4. Experience implementing batch processing using AWS Glue/Lake formation Data Pipeline.
5. Experience or exposure to AWS DynamoDB will be a plus.
6. Develop object-oriented code using Python, besides PySpark and SQL.
7. Experience on streaming technologies both On-Prem/Cloud such as consuming and producing from Kafka and Kinesis would be a plus.
8. Experience building pipelines and orchestration of workflows in an enterprise environment using Apache Airflow/Control M.
9. Experience implementing Redshift on AWS or any one of Databricks on AWS or Snowflake on AWS.
10. Good understanding of Dimensional Data Modelling will be a plus.
Additional Skills:
1. Ability to multi-task and prioritize deadlines as needed to deliver results.
2. Ability to work independently or as part of a team.
3. Excellent verbal and written communication skills with great attention to detail and accuracy.
4. Experience working in an Agile/Scrum environment.
NS is a company that values both the professional technological profile of its employees and the interest and aptitude they show when it comes to developing new projects. For this reason, we require constant people with a desire to evolve and learn.
Keywords: SQL, AWS, Apache Spark, NoSQL, Redshift
#J-18808-Ljbffr