Skip to Content

Job Overview

You'll do this primarily by building the machine learning that detects sensitive entities in text and image data and replaces them consistently at scale.

Key points

  1. Run deep dives into enterprise data to assess quality: topic coherence across connectors, domain depth within connectors, completeness, and consistency.

  2. Design and automate validation suites for data pipelines — schema checks, completeness, drift detection, and reconciliation across raw processed sanitized stages.

  3. Surface and characterize quality issues in ways that engineering and product can act on.

  4. You'll build the detection models, validation infrastructure, adversarial test sets, and audit processes that let us make strong claims about data quality and de-identification…

  5. Strong Python for ML development and data validation (pytest, Great Expectations, Pandera, or similar).

  6. Solid SQL and experience validating data across pipeline stages.

  7. Familiarity with sensitive data categories and the relevant standards — HIPAA Safe Harbor for PHI, GDPR/LGPD for PII, PCI DSS for cardholder data…

  8. Experience building and testing NER or other ML-based detection systems: building labeled eval sets, computing precision/recall, handling non-determinism.

Skills

Machine LearningCI/CDPythonSQLREST APIsGoogle CloudLLMsComputer Vision

Experience: Mid-level · 4–5 years

Similar jobs

More open roles like this one