Define the task
Create an online project with clear instructions, examples and the questions each annotator answers.
Classify content, rate outputs, compare two answers side by side or collect short written responses. Every annotator is identity-verified, every task comes back as structured data, and you only pay for the work you approve.
Describe the task once and let verified people work through it in parallel.
Create an online project with clear instructions, examples and the questions each annotator answers.
Choose the pay per task and how many you need. The budget is reserved up front, so approved work is always funded.
Annotators pick tasks from the marketplace and submit their answers, with files attached when you ask for them.
Approve or reject each submission with a reason, and see the aggregated answers in your dashboard.
Each task is a short questionnaire, so results come back consistent and easy to aggregate.
Single or multiple choice labels for text, images or any item you describe: topic, sentiment, category, policy.
Score quality, relevance or accuracy on a numeric scale, for model outputs, search results or content.
Show two options and let the annotator pick the better one, match after match, for preference and ranking data.
Yes/no validations, numbers and free-text responses for verification, correction and transcription tasks.
Anonymous crowds were the norm on Mechanical Turk. Here every annotator is a real, verified person.
Classification with single or multiple choice, numeric ratings, side-by-side comparisons between two options, yes/no checks, numbers and free-text answers. Annotators can also attach files when the task requires it.
Not today. TaskMaster works with questionnaires, comparisons and file uploads rather than drawing tools, so it fits classification, rating, preference and short-answer work.
Identity-verified people who signed up as workers. Each one confirmed their identity with a government-issued ID and a selfie.
Yes, for this kind of work. You recreate your HITs as projects in the dashboard; there is no MTurk-compatible API to import them automatically.
You set the pay per task and reserve the budget when the project starts. You only pay for approved submissions.
Also on TaskMaster: Mechanical Turk alternative · Retail audits · Earn money with tasks
Sign-up is free. Launch your first annotation project today.