|
Requested
By |
Whitney |
|
Task
Expiration Time |
30
min or 01 hours |
|
Accept
rate |
96%
to 80% |
|
Review
time |
01
day or a few seconds |
|
Maximum
Earning |
14$ |
This task is available from time to time in different languages
but at this time Search relevance evaluation task is only available in the English language
so we have shared some tips and tricks on how to complete this task easily you can
follow these steps and do this task easily.
Instructions:
In this project, we use a
thorough examination and selection of the performers. To get more tasks and
earn more money, please be attentive and patient.
Stage 1: you have to pass free training tasks to learn different
cases on how to label query-product pairs.
Stage 2: you take an exam, which is paid if you complete it with a
good score. Please do your best, otherwise, you won't get access to a large
number of main tasks.
Main tasks: during your work on the main tasks, we constantly measure your
performance. We have a lot of those tasks which is a good opportunity for you.
Therefore, be careful and provide a good quality not to lose access to those
tasks.
For exams, we have set up auto-rejection of the assignment if you score
lesser than a threshold. Please beware that if many tasks are wrong, the
assignment is rejected within 1 day. Please be very attentive while labeling to
get access to bigger pools and higher skills.
Judgments:
Imagine
that you are shopping on Amazon. You will see a search query and (optional)
category selected, and one or more products to be judged for relevance to that
query. You will need to use one of four labels for each product you see:
1. Exact
Exact: This product fully satisfies the query. A broad or ambiguous query could be satisfied by any of a diverse set of products, so long as it is reasonable to expect that a customer who entered that query might buy that product. A very specific query will only be satisfied if the product matches all of the characteristics included in the query.
Tips: Availability in the widget/drop-down makes the product exact, despite the change in ASIN Multiple interpretation Search Queries (hereinafter SQs): a query can have multiple meanings and an ASIN that is Exact for any of the meanings should be judged Exact. For many broad queries, the customer's intent may be unclear. Multiple interpretations of the query could result in different judgments for an ASIN.
The given SQ of the scooter battery could be interpreted in 2
ways i.e. a battery-operated scooter or a battery for the scooter. As a reviewer, we
should be taking both or all possible interpretations into account before
judging a query.
In the above cases, both interpretations lead to an exact
judgment (scoter and battery). If one of the interpretations would result in
an Exact judgment for the query, then that should be the judgment, even if
other interpretations would result in Complement or Irrelevant judgments. If
the query is issued within a specific alias, then all the interpretations used
for judgment should respect that alias.
Exact Bundle: If a product is being sold with normal accessories which are to be expected for that purchase, we do not consider it a bundle. For example, an electric guitar being sold with a guitar case, a small amplifier, and a cord is normal, and all these accessories are normally expected with this type of product. Another example is when you buy an iPhone and earphones and a charging cable are included in the box. This is normal and not considered a bundle.
If You want to know Russian tasks visit our website.
Attention please: this is only Search Relevance Evaluation (English) task one part is an exact part we are we are working on more parts of this task so please attend and check this Amazon task section deeply.
