Director of AI Data Solutions Full Time NEW

About Us

Pearl is AI for professional services at global scale—combining advanced AI with verified human expertise to deliver help that’s accurate, accountable, and fast. Since 2003, our network has connected millions of customers with licensed professionals across 196 countries, making real expertise available anytime, anywhere.

Our Values

• Data driven: Data decides, not egos
• Courageous: We take risks and challenge the status quo
• Innovative: We’re constantly learning, creating, and adapting
• Lean: We focus on customers, using lean testing to learn how to serve them best
• Humble: Past success is not a guarantee of future success

THE OPPORTUNITY

Pearl (the parent company of JustAnswer) is building a category-defining enterprise business at the intersection of AI and professional human expertise. One of our most important bets is AI Human Data Services: Expert data products that accelerate frontier model development – data that goes beyond generic labeling and commodity reinforcement learning through human feedback (RLHF) into high-signal, professional-grade work that materially improves model behavior.

AI labs are moving from models that “know things” to models that “do things.” That shift demands training and evaluation data that is harder, longer-horizon, and more domain-specific: PhD-level human evaluations, expert preference selection, verifiers, rubrics, agentic task environments, and multimodal workflows. Pearl is uniquely positioned to win here because we have a large, liquid network of licensed professionals (>20,000 professionals), an operating platform built for high-trust expert work over the last 20 years, and multimodal production capabilities across chat, voice, and computer-use style tasks.

WHY THIS ROLE EXISTS

We need a AI data service entrepreneur/intraprenuer to discover where we can have maximum product-market fit and then build on early AI Data Services traction to build a durable product line: a repeatable set of data offerings, a world-class quality and evaluation system, and a delivery engine that frontier labs trust with their most important training and evaluation problems. This is not a quota-carrying sales role. It’s a product-and-operations leadership role with deep customer intimacy – owning the end-to-end data product lifecycle from discovery to specification to production to quality to expansion.

We believe the ideal leader is someone who has either:

• Owned procurement / partnerships for custom AI training or evaluation data inside a major AI lab (or equivalent model-building org), or
• Successfully brought to market high-end custom data programs at a leading data provider (e.g., Scale, Appen, Handshake, or similar), with firsthand experience of what differentiates “elite” data from commodity output

YOUR MANDATE

Build Pearl’s AI Data Services business into the trusted, go-to partner for frontier labs and AI-native companies that need expert-grade data at speed and scale – without sacrificing rigor, confidentiality, or quality.

You will:

• Define and productize our AI Data Services portfolio (what we sell, how it’s packaged, how it’s priced, what “done” means).
• Build the delivery engine: staffing, workflows, tooling, QA loops, and automation that make elite data repeatable.
• Establish Pearl’s quality bar and measurement system: rubrics, verifiers, audits, gold sets, calibration, and continuous performance scoring for experts and outputs.
• Own customer outcomes: translate ambiguous research needs into precise task designs and production-ready specs that reliably improve models.
• Build data rights and licensing strategy in partnership with Legal: ensure we can responsibly reuse and monetize data across customers when appropriate, while honoring confidentiality, privacy, and contractual commitments.
• Create Pearl’s external credibility in expert data: benchmarks, evaluation frameworks, and clearly articulated standards.

THE DATA PRODUCTS YOU’LL BUILD (EXAMPLES)

This role spans multiple data modalities and program types, including:

• Expert Supervised Fine Tuning (SFT) and instruction data for specialized domains.
• Preference data / ranking / pairwise comparisons with high-quality rubrics.
• RLHF-style programs: verifiers, critiques, and structured feedback loops.
• PhD-level and licensed-professional evaluations (truthfulness, reasoning, safety, policy adherence, domain correctness).
• “AI stumps” and hard-case datasets designed to expose failure modes.
• Agentic task environments and long-horizon workflows (models doing multi-step work, using tools, making decisions).
• Multimodal programs across text, voice, and computer-use tasks (screen-based workflows, tool usage, real software interaction, and voice-based reasoning).
• Safety, policy and adversarial evaluation programs for high-risk or high-accuracy domains.

EXPERIENCE & QUALIFICATIONS

• AI data procurement/partnerships at a frontier lab, data product leadership, data operations, ML research operations, or senior roles at an AI data provider delivering custom programs.
• Demonstrated experience building or operating high-quality human-data programs (SFT, preference data, evals, verifiers, rubric-driven QA).
• Strong technical intuition: comfortable working with ML researchers and engineers on dataset specs, formats, and evaluation methodology (you don’t need to be an ML engineer, but you must be credible).
• Strong contract and vendor maturity: familiarity with data rights, licensing, confidentiality constraints, and what “labs-grade” trust requires.
• Comfort operating in high-ambiguity, high-velocity environments with lean start-up methods, and clear articulation of what Pearl does better than anyone else.
• Smart, fun, get-things-done.

Remote From these States

California, Florida, Georgia, Idaho, Illinois, Massachusetts, Michigan, New Jersey, New York, North Carolina, Ohio, Oregon, Pennsylvania, Texas, Virginia, Washington, and Wisconsin.

Pay Transparency

Pearl will provide pay transparency information upon application to those in qualifying jurisdictions.

Employment is with JustAnswer LLC, a Pearl company.

Our Commitment to an Inclusive Workplace

We welcome people from all backgrounds who seek the opportunity to help build a future where professional services are readily available to all. If you have curiosity, passion, and a collaborative spirit, come work with us. Pearl is committed to an inclusive workplace. Pearl is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, disability, age, or other legally protected status.

AI Disclosure & Informed Consent

Artificial intelligence (AI) technology may be used during the hiring process to record, transcribe, analyze, and rank interview responses. By submitting your application and participating in the interview process, you acknowledge and consent to the use of AI technology in the hiring process. For more information see our AI Disclosure and Consent Policy.