Job Description

Job Title: Data Analyst-II

Client: DoorDash

Location: Remote

About the Role

DoorDash is seeking a highly motivated Data Analyst contractor to support our Search & Discovery teams. This role is ideal for early-career analysts who are proactive with LLMs, comfortable working with data, and eager to grow in a fast-paced, high-accountability environment. The position includes hands-on evaluation work, cross-functional collaboration, and the opportunity to build foundational experience in applied large language model workflows.

Key Responsibilities

LLM Evaluations & Insight Generation

• Conduct end-to-end evaluations of large language models (LLMs).
• Develop evaluation rubrics and write prompts for LLM testing.
• Scrape and prepare datasets using internal tools.
• Collect, annotate, and maintain high-quality "golden label" datasets.
• Collaborate with engineering teams to calibrate model quality and performance.
• Run evaluations regularly and maintain dashboards and reporting.
• Analyze results to uncover insights that improve evaluation quality and processes.

Third-Party Vendor Coordination

• Serve as the primary point of contact between DoorDash and external vendor teams.
• Assign tasks, manage deadlines, and perform QA on vendor evaluator outputs.
• Provide clear instructions, feedback, and clarifications to ensure consistent quality.

Internal Team Support & Triage

• Act as the first point of contact for inbound questions related to evaluation tasks.
• Route questions to appropriate stakeholders and track open issues.
• Ensure timely follow-up and smooth communication across teams.

Required Skills & Experience

• Prior experience in data analysis or a similar analytical role.
• Demonstrated interest and proactive engagement with LLMs and modern AI tools.
• Strong attention to detail and the ability to work independently.
• Excellent written and verbal communication skills.
• Comfort operating in a fast-paced, high-accountability environment .

Tools & Technical Skills

• Proficiency with Google Workspace , especially Google Sheets.
• Basic SQL skills (ability to write simple queries and troubleshoot results).
• Familiarity with Google Drive and documentation best practices.
• Bonus: Experience with prompt engineering or LLM prompt design.

What We're Looking For

• A self-starter who is curious, resourceful, and motivated to learn.
• Someone who enjoys solving ambiguous or open-ended problems.
• A collaborative team player comfortable working with product, engineering, and vendor partners.

A candidate hungry to grow and potentially convert into a full-time position.

Job Tags

Full time, For contractors, Remote work,

Similar Jobs