Big Data Engineer

Description:
Expert in developing complex data pipelines, optimizing, and managing large volumes of batch and streaming data in distributed environments.

Key skills:

Experience with orchestration tools like Apache Airflow, Google Cloud Composer, Google Dataform
Streaming with Apache Kafka, Pub/Sub
ETL/ELT on BigQuery, Cloud Dataflow, Dataproc
Preferred: Knowledge of Google Datastream, Data Fusion
Relational databases: MariaDB, MySQL, SQL Server
Languages: Python, SQL (Java is a plus for complex streaming flows)
Data modeling and datamart creation

Apply now

All jobs

Information Security Manager

Permanent
Remote

Information Security Manager (f/m/d) Remote (with travel to Frankfurt once a month) Full-time, Permanent A leading international logistics organisation is seeking an experienced Information Security Manager to join its global security team. In this role, you will report to the…
Apply
Data Integration Engineer

Contract
Remote

Data Integration Engineer Description: Specialist in integrating heterogeneous data sources, real-time/batch synchronization, and ensuring data quality and consistency. Key skills: Experience with ingestion tools like Datastream, Data Fusion, Kafka Connect Database integration: MariaDB, MySQL, SQL Server Workflow orchestration with Airflow,…
Apply
Senior Architect – 12 Month Contract

Contract
Remote

Senior Architect Description: A strategic role responsible for designing and overseeing the entire data and application architecture. Key skills: Strong experience with Google Cloud Platform (GCP), including advanced services like Datastream, Data Fusion, Cloud Functions, BigQuery, Cloud Run, Pub/Sub, Cloud Composer…
Apply