Job Description
Job Title: Data Analyst-II
Client: DoorDash
Location: Remote
About the Role
DoorDash is seeking a highly motivated Data Analyst contractor to support our Search & Discovery teams. This role is ideal for early-career analysts who are proactive with LLMs, comfortable working with data, and eager to grow in a fast-paced, high-accountability environment. The position includes hands-on evaluation work, cross-functional collaboration, and the opportunity to build foundational experience in applied large language model workflows.
Key Responsibilities
LLM Evaluations & Insight Generation
- Conduct end-to-end evaluations of large language models (LLMs).
- Develop evaluation rubrics and write prompts for LLM testing.
- Scrape and prepare datasets using internal tools.
- Collect, annotate, and maintain high-quality "golden label" datasets.
- Collaborate with engineering teams to calibrate model quality and performance.
- Run evaluations regularly and maintain dashboards and reporting.
- Analyze results to uncover insights that improve evaluation quality and processes.
Third-Party Vendor Coordination
- Serve as the primary point of contact between DoorDash and external vendor teams.
- Assign tasks, manage deadlines, and perform QA on vendor evaluator outputs.
- Provide clear instructions, feedback, and clarifications to ensure consistent quality.
Internal Team Support & Triage
- Act as the first point of contact for inbound questions related to evaluation tasks.
- Route questions to appropriate stakeholders and track open issues.
- Ensure timely follow-up and smooth communication across teams.
Required Skills & Experience
- Prior experience in data analysis or a similar analytical role.
- Demonstrated interest and proactive engagement with LLMs and modern AI tools.
- Strong attention to detail and the ability to work independently.
- Excellent written and verbal communication skills.
- Comfort operating in a fast-paced, high-accountability environment .
Tools & Technical Skills
- Proficiency with Google Workspace , especially Google Sheets.
- Basic SQL skills (ability to write simple queries and troubleshoot results).
- Familiarity with Google Drive and documentation best practices.
- Bonus: Experience with prompt engineering or LLM prompt design.
What We're Looking For
- A self-starter who is curious, resourceful, and motivated to learn.
- Someone who enjoys solving ambiguous or open-ended problems.
- A collaborative team player comfortable working with product, engineering, and vendor partners.
A candidate hungry to grow and potentially convert into a full-time position.
Job Tags
Full time, For contractors, Remote work,