Data Engineer – Python & SQL (m/f/d) (Ref. G26000694)

About the role

The Judicial Administration is looking for a data engineer to join its statistics and data management service (SSJ), within the Directorate for Information and Digitalisation, in Luxembourg City, on a full-time civil servant contract. In this role you will design, build and maintain the applications, scripts, pipelines and data treatments that turn justice data into reliable, usable information. You will develop ETL processes, automate data quality control, validation and monitoring, and set up orchestration workflows that keep data flowing dependably. You will optimise SQL queries, help design new data architectures and platforms, and apply software development best practices, including automated tests, logging and error management, to improve the performance, reliability and security of the service's data tools. Working closely with the IT teams and the business teams, you will make sure the data products you build genuinely answer the needs of the justice system.

Responsibilities

- Design, develop and maintain applications, scripts, pipelines and data processing in Python and SQL. - Develop ETL processes and automate data quality control, validation and monitoring. - Set up and maintain orchestration workflows for data treatments. - Optimise SQL queries and improve the performance, reliability and security of data tools. - Contribute to new data architectures and platforms for the justice service's data. - Apply software development best practices: automated tests, logging and error management. - Collaborate with IT and business teams to deliver data products that meet their needs.

Requirements

Applicants must be Luxembourg nationals, hold a master's degree (at least level 7), and have a good command of French, German and Luxembourgish. You need very good knowledge of Python and SQL, relational databases, Git/GitLab, software development principles, and data integration, transformation and automation, as well as software testing, error management and technical documentation. Strong analytical and synthesis skills, technical problem-solving ability, autonomy, team spirit, rigour, organisation, code quality, curiosity, initiative and clear technical communication are required.

Preferred qualifications

Experience with Apache Airflow or other orchestration tools; Great Expectations; development and maintenance of data pipelines; API data integration; Docker; CI/CD; CSV and Parquet formats; Data Warehouse, Data Lake or Data Lakehouse architectures; SAP data solutions; PostgreSQL or DB2.

Skills