Yupp, a new chatbot platform, has launched offering users up to $50 per month for evaluating AI model responses through side-by-side comparisons. The platform monetizes human feedback by selling this valuable data to AI companies seeking to improve their models, creating a direct revenue stream from what was previously free labor in the AI training process.
How it works: Yupp displays responses from two different AI models side-by-side for every user query, then pays users to choose their preferred answer and explain why.
- The platform routes prompts to pairs of models selected from over 500 options, including products from OpenAI, Google, Anthropic, Alibaba, DeepSeek, and Mistral.
- Users earn digital scratch cards with Yupp credits for their feedback, with every 1,000 credits worth $1.
- Cash-out limits are set at $10 per day and $50 per month, with payment options including PayPal, Venmo, Bitcoin, and Ethereum.
The economics: Users must spend credits to generate responses, creating a balanced system where feedback can yield modest profits.
- In testing, credit rewards typically ranged from zero to around 250 per evaluation, with users able to earn approximately $4 per hour of active feedback.
- CEO Pankaj Gupta, Twitter’s 27th employee who now has cofounder Biz Stone as a backer, estimates users can make enough for “a few cups of coffee a month,” though the underlying data is worth significantly more to AI companies.
- The platform operates on API calls to model providers without current revenue-sharing agreements.
The bigger picture: Yupp transforms reinforcement learning with human feedback—a critical component of AI development—into a consumer-facing product with explicit value exchange.
- “This is a little bit of a departure from previous consumer companies,” says Gupta. “You provide feedback data, that data is going to be used in an anonymized way and sent to the model builders.”
- The platform competes with LMArena, which is popular among AI insiders but doesn’t compensate users for their evaluations.
In plain English: Reinforcement learning with human feedback is how AI companies improve their chatbots by having people rate which responses are better—like having thousands of people grade homework to help teach the AI what good answers look like.
Key features: Yupp includes a public leaderboard launching today that ranks models overall and by specific demographics and prompt categories.
- Users can filter rankings by age groups or specialized categories like healthcare-related questions.
- The platform encourages developers to submit their models for inclusion and supports both text and image generation.
- “Every AI for everyone” serves as the company’s tagline, emphasizing broad model accessibility.
What they’re saying: Gupta positions user participation as actively shaping AI development rather than passive consumption.
- “It’s better than free, because you are doing this great thing for AI’s future,” he explains. “Now, some people would want to know that, and others just want the best answers.”
- He views the platform as creating “network effects of consumers helping the model builders” while “model builders, hopefully, are improving the models and submitting them back to the consumers.”
This Chatbot Tool Pays Users $50 a Month for Their Feedback on AI Models