Data Integration Engineer
Description:
Specialist in integrating heterogeneous data sources, real-time/batch synchronization, and ensuring data quality and consistency.
Key skills:
-
Experience with ingestion tools like Datastream, Data Fusion, Kafka Connect
-
Database integration: MariaDB, MySQL, SQL Server
-
Workflow orchestration with Airflow, Cloud Composer
-
Data formats management: Avro, Parquet, JSON, CSV
-
Data modeling and datamart creation
-
Languages: Python, SQL
Nice to have:
Strong understanding of CDC (Change Data Capture) architectures. Experience with data validation, automated pipeline testing, and quality monitoring.
