AI助手评估员
AI Agent Evaluator
**Pay:** $25-$45 per hour (USD).
**Role Title: AI Agent Evaluator**
**Role Type: Contractor**
**Location: U.S based**
#### Opportunity Snapshot
**Pay:** $25-45/hour
**Time per task:** ~1.5 hours per run (evidence and scoring included)
**Project kickoff:** Monday, October 12
**Onboarding:** Today (Fri), Saturday, or Sunday, so you’re ready to start Monday October 10th
**You’ll need:** An active personal popular AI account (Free, Go, or Plus; not Pro), an active personal and a smartphone that can screen record
**Your tasks:** Run everyday errands with two AI agents, approve key steps, screen record, and score the results
#### About the role
AI agents are starting to handle real-life errands: paying bills, booking trips, doing the groceries. We want to know how well they actually do it, from the point of view of a real user. That’s you.
You’ll test **two AI agents** side by side, using your own accounts on your phone, and tell us what worked, what didn’t, and how it felt.
#### What you’ll do
1. Run real-life scenarios: bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms
2. Approve or stop the agent at key steps
3. Screen record every attempt
4. Score each run on **completion, quality, control issues, satisfaction, and time**
5. Share clear written feedback on the agent experience
#### Who we’re looking for
1. **US-based**, with a Bachelor’s degree
2. Someone who already uses **AI in daily life**
3. **2-3 years** of experience, preferably in engineering, business management, or office/operations
4. Detail-oriented, great at following instructions and documenting each step
5. Clear written communication
6. Generalists welcome, domain experts preferred
7. No coding or AI background needed
#### Why you’ll like it
1. Get paid to use the AI tools you already use
2. Work entirely from your phone, on your schedule
3. Have a direct say in how next-generation AI agents get built and improved
#### How the selection process works
1. **Apply**
2. **Complete the screening questions**
3. **Interview**: 15-30 minutes max
4. **Profile review:** if everything looks good, we present you to the client
5. **Onboarding:** our Talent Ops team will contact you to get you started