Doorsturen
Geplaatst
  • 8 augustus 2019
Sluitingsdatum
  • 22 augustus 2019
Vestiging
  • Vopak Europe/Africa
Plaats
  • Rotterdam
Ervaring
  • 5 tot 7 jaar
Niveau
  • Medior
  • Senior
Beroep
  • Engineer
Branche
  • Overslag
Citytalent contact
Volg ons via:
The Data Engineer works with the data architects, data analytics team, data scientists, and data warehouse engineers in order to understand and aid in the implementation of database requirements, analyze performance, and troubleshoot any existent issues. The position of the Data Engineer also plays a key role in the development and deployment of innovative big data platforms for advanced analytics and data processing. The Data Engineer will report to the Manager Agile Services.

Job description

The Data Engineer works with the data architects, data analytics team, data scientists, and data warehouse engineers in order to understand and aid in the implementation of database requirements, analyze performance, and troubleshoot any existent issues. The position of the Data Engineer also plays a key role in the development and deployment of innovative big data platforms for advanced analytics and data processing. The Data Engineer will report to the Manager Agile Services.

Your three main missions

  • ‘You will be responsible for the maintenance, improvement, cleaning, and manipulation of data in the operational and analytics databases’.
  • ‘You will be the expert in SQL development further providing support to the Data and Analytics in database design, data flow and analysis activities'.
  •  "You will be responsible for defining and building the data pipelines that will enable faster, better, data-informed decision-making within the business’.

Your job in bullet points

  • Participate in proof of concepts for determining fit for purpose solutions;

  • Work with a variety of databases;

  • Build and optimize ‘big data’ data pipelines, architectures and data sets;

  • Perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement;

  • Work with unstructured data sets;

  • Build processes supporting data transformation, data structures, metadata, dependency and workload management;

  • Manipulate, process and extract value from large disconnected data sets;

  • Setup message queuing, stream processing, and highly scalable ‘big data’ data stores;

  • Work with cross-functional teams in a dynamic environment;

  • Perform thorough testing and validation in order to support the accuracy of data transformations and data verification used in machine learning models;

  • Enable and run data migrations across different databases and different servers;

  • Analyze complex data elements and systems, data flow, dependencies, and relationships in order to contribute to conceptual physical and logical data models;

  • Develop and implement scripts for database maintenance, monitoring, and performance tuning to be applied across the business.

Job requirements

  • With 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field;

  • That believes in an agile way of working / scrum and has a pragmatic approach to problem solving;

  • That will help look in the company for new data sources that can be connected and utilized;

  • That could help improve the governance of data and would help data owners how they can publish and manage their data;

  • Advanced working SQL knowledge and experience working with relational databases;

  • Experience with AWS cloud services like S3, Athena, Glue, Redshift;

  • Experience with big data tools like Hadoop, Spark, Kafka;

  • Experience with relational SQL and NoSQL databases;

  • Experience with Data Vault;

  • Experience with data pipeline and workflow management tools;

  • Experience with extract, transform, load tools like Informatica Powercenter;

  • Experience with stream-processing systems: Storm, Spark-Streaming;

  • Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala;

  • Strong written and verbal communication;

  • Demonstrated strong teamwork, interpersonal and communications skills;

  • Demonstrated intensity in completion of work assignments;

  • Demonstrated strong analytical and problem solving skills.

Application information

Are you the Data Engineer we are looking for?

Then start your journey at Vopak and apply via the ‘apply’ button below.

Acquisitie naar aanleiding van deze vacature wordt niet op prijs gesteld.

Onze overige vacatures

Vopak Nederland
Human Resources