The Data Platform team delivers reliable, cost-efficient data processing that scales with growth — so engineers and analysts can focus on business problems instead of wrestling with infrastructure. The Data Platform team empowers data scientists and data engineers through a Scala data warehouse framework designed for data modeling and the creation of type-safe and easily testable batch jobs.
Operating and implementing new features in the framework and the services managed by the team.
Engaging with data scientists and identifying ways of improving their experience and productivity when using our framework and services.
Identifying and implementing computational improvements.
Making improvements and/or fixing bugs by submitting patches to open-source projects in our stack, such as Spark, Iceberg, Hadoop, Airflow, and many others.
Acting as an expert on Spark and Scala.
Mentoring engineers (including through pairing, design discussions, and knowledge-sharing sessions) and helping raise the bar on quality, reliability, and good practices across the team.
The runtime environment is based on Hadoop clusters on EC2 spot instances, dynamically scaling up as required, ensuring high resource utilization and stability.
Experience: Senior-level
More open roles like this one
Bengaluru, KA, IndiaIndia & South Asia
Canberra, AUST CAPITAL TERR, AustraliaAsia-Pacific
Sydney, NSW, AustraliaAsia-Pacific
Senior Compute Platform Engineer · Zeta Global
Don't have an account? Already have an account?