Software Development Engineer III Data

Design and implement scalable and fault-tolerant data pipelines (batch and streaming) using frameworks like Apache Spark, Flink, and Kafka.

Lead the design and development of data platforms and reusable frameworks that serve multiple teams and use cases.

Build and optimize data models and schemas to support large-scale operational and analytical workloads.

Deeply understand Apache Spark internals and be capable of modifying or extending the open-source Spark codebase as needed.

Strong programming skills in Java, Scala, or Python, and expertise in SQL.

Experience implementing and tuning Spark/Delta Lake/Presto at terabyte-scale or beyond.

Strong understanding of Apache Spark internals (Catalyst, Tungsten, shuffle, etc.) with experience customizing or contributing to open-source code.

Familiarity and worked with modern open-source and cloud-native data stack components.