Description:
HYVE operates production data platforms for enterprise clients across the Gulf and Egypt. We're hiring a Data Management Tech Lead to run one of these platforms end-to-end, embedded with our client in the UAE.
This is a senior delivery role on an IBM-stack engagement. You lead a HYVE pod operating a modern lakehouse built on IBM watsonx.data and IBM DataStage, powering analytics and AI workloads across the client's business. The platform is live. Your job is to keep it healthy, evolve it, and grow what it can do via introduction of new use cases and data sources.
What you'll own
- The platform. DataStage ingestion jobs, watsonx.data lakehouse (Iceberg tables, Presto/Spark engines, object storage), downstream consumption patterns for BI and AI workloads. If it breaks, you know first. If it needs to scale, you've already planned for it.
- The team. A pod of HYVE engineers (data engineers, BI, platform). You set technical direction, run the delivery cadence, review designs and code, and develop the engineers under you.
- The client relationship at the technical layer. You're the senior technical voice in the room with the client's data and engineering leadership. You translate their priorities into a roadmap, push back when something is the wrong call, and report progress against SLAs and OKRs.
- Quality and reliability. Data SLAs, observability, lineage, incident response. Production data is correct and on time, or there's a postmortem and a fix.
- Architectural evolution. New domains onboarded onto the lakehouse. Job optimization in DataStage. Query and storage tuning in watsonx.data. Governance, cost, and migration of legacy workloads where they exist.
What we're looking for
- 7+ years in data engineering, with at least 2 years operating a production lakehouse or large-scale warehouse — not just building one and walking away.
- Deep DataStage experience. You've designed, optimized, and operated DataStage jobs at scale. You know the difference between parallel and sequential stages in your sleep, and you've debugged a job that mysteriously got slower in production.
- Hands-on with IBM watsonx.data or strong experience with the underlying components — Iceberg table format, Presto/Trino, Spark SQL, object storage. If you haven't used watsonx.data specifically but have run an Iceberg-on-S3 lakehouse with Presto/Trino, we'll talk.
- Strong SQL on large datasets. Python for tooling, automation, and the occasional pipeline that doesn't belong in DataStage.
- Experience with IBM Cloud Pak for Data is a strong plus — it's the broader platform watsonx.data sits inside.
- Experience leading a team of 3+ engineers in a delivery context. You've run standups, sprint planning, design reviews, and 1:1s — and you're good at the 1:1s.
- Client-facing delivery experience. You can hold a room with a client CTO or Head of Data and represent both the technical reality and HYVE's position.
- Degree in Computer Science, Engineering, or equivalent practical experience.
Nice to have
- IBM certifications (DataStage, Cloud Pak for Data, watsonx).
- Exposure to RAG-based AI systems or watsonx.ai workloads consuming the lakehouse.
- Data governance frameworks (DAMA DMBOK) in a regulated-industry context.
- Arabic, alongside professional English.