17/01/2024
We are currently seeking a highly motivated and experienced Big Data Platform Engineer for our partner.
Responsibilities:
- Play a pivotal role in the complete design of a Big Data platform.
- Design the movement of massive datasets.
- Monitor performance and propose infrastructural changes.
- Collaborate with Data Warehouse (DWH) and Reporting teams.
- Emphasis on expertise in Kafka.
Professional Requirements:
- High-level knowledge of distributed systems.
- Advanced understanding of streaming architectures (Kafka, Pub/Sub, Event Hubs).
- Experience in building streaming pipelines (Kafka Connect, KsqlDb, Flink).
- Knowledge of version control systems (GIT – Gitlab/Bitbucket).
Preferred Skills:
- Familiarity with container-based systems (Docker, Kubernetes).
- Understanding of cloud-based environments (Gcp, Aws).
- Experience in CDC-based streaming (Debezium).
- Hadoop cluster management.
- Building data pipelines using open-source technologies (Airflow, Spark, Iceberg).
- Knowledge of Big Data query tools (Hive, Impala).
- Experience in data integration from multiple sources.
- Familiarity with NoSQL databases (HBase, MongoDB, Neo4j).
- Knowledge of Big Data ML toolkits (SparkML).
- Additional Big Data components (NiFi, Ambari, Kudu).
Preferred Personality:
- Systematic thinking.
- Ability to work independently in a team.
- Creative and innovative mindset.
- Strong analytical and organizational skills.
How to Apply:
If you meet the above qualifications and are ready to contribute to the development of cutting-edge Big Data platforms, please send your resume to [email protected] with the subject line: "Big Data Platform Engineer Application"