Luxembourg – €72k Permanent
Data Engineer (h/f) Luxembourg A major player in the telecoms sector and the national operator of postal and postal financial services, this is a key pillar of Luxembourg’s economy. In order to develop its “Big Data” expertise and services, we are currently seeking for our IT Department a (e)
Power and evolve the Data Lake (Big Data platform, source of Data Scientists analysis) by implementing ETL solutions to integrate and combine multiple and heterogeneous data sources, in batch and in real time
Work closely with the Data Scientists team
Look for new internal and external data sources to integrate into the Big Data platform
Be a major player in the data governance, implementing data quality management rules, retention rules, archiving and anonymization rules.
Being a proposition force in terms of data architecture.
Establish and transcribe the needs of management (Data Governance), Data Scientists, Data Architects and Jurists
Participate in the on-call cycle to ensure 24/7 support
You hold a master’s degree in Computer Science/Information Security and/or Statistics/Mathematics
You have 3 to 7 years of experience in a similar position
You have a very good knowledge of the following technologies/tools:
NoSQL technologies (eg MongoDB, HBase)
SQL-based technologies (eg MySQL, Oracle, DB2, SQL Server )
ETL Tool: Talend (Knowledge of any other ETL, such as Datastage, is an advantage)
Real-time data feeds: Apache Kafka and Storm
Hadoop (HDFS, Hive, Falcon, Atlas, Spark) et la suite Hortonworks Data Platform
Data Architecture: Datawarehouse, Data Vault, Data Lake
A good command of Python is an asset
Autonomous and flexible, you are oriented to customers and solutions
You are recognized for your critical thinking, analysis and synthesis
You have excellent writing and communication skills in French and English
To apply for this job please visit www.jobserve.com.