Skip to Content
AI/MLData Analytics Hybrid

Lead Data Engineer

Job Overview

As Lead Data Engineer, you'll be a senior individual contributor at the heart of the data organisation - owning complex platform decisions, collaborating cross-functionally with AI, product, and go-to-market teams, and shipping data-driven features that…

Key points

  1. Own and evolve the data platform - StarRocks (OLAP), Apache Hudi (Data Lake), Trino, Spark, and Apache Ranger - ensuring performance, reliability…

  2. Build the next-gen AI-optimised data layer: clean, structured datasets that power natural language querying and AI add-on features for HackerRank for Work customers.

  3. Own in-product data features - exports, insights dashboards, interview analytics, and the self-serve Custom Reports interface.

  4. Enable self-service pipelines for internal teams (AI platform, analytics, go-to-market), reducing ad-hoc data requests and scaling data access across the org.

  5. Deep hands-on expertise with OLAP databases - StarRocks, ClickHouse, Druid, or similar.

  6. Strong experience with data lake technologies - Apache Hudi, Iceberg, or Delta Lake.

  7. Proficient with distributed query engines (Trino / Presto) and batch/streaming compute with Apache Spark.

  8. Solid understanding of data security, RBAC, and access control tools like Apache Ranger.

Skills

NLPStakeholder ManagementProduct StrategyInterviewingAWSLLMsRAGData Visualization

Experience: Senior-level · 6+ years

Similar jobs

More open roles like this one