How does screening work?

[PVG_Spotter]

Does every single photo on this website get screened by 2 (if both reject) to 3 screeners (if 3rd one is needed to determine the result)?
Does senior screeners and/or admin get the power of rejection without any re-validation from other screeners?
I really hope there's a thorough explanation regarding how photos are being screened on this website. Thanks!

[dlowwa]

The process begins with the image and associated data being visible to the screener. Once the image/data has been reviewed, there are six options for the screener to select:

1. Vote Add - the image will remain in the queue. It will be added if it receives another Vote Add, or rejected if it receives two Vote Rejects
2. Vote Reject - the image will remain in the queue. It will be rejected if it receives another Vote Reject, or added if it receives two Vote Adds
3. Skip - the image will remain in the queue and await the next screener
4. Instant Add - the image will be added immediately to the DB
5. Instant Reject - the image will be rejected immediately
6. Senior Review - the image will be sent to a special queue to be reviewed by senior screeners

Numbers from yesterday's screening:

1. Vote Add - 1394
2. Vote Reject - 773
3. Skip - 56
4. Instant Add - 1259
5. Instant Reject - 626
6. Senior Review - 1

We cannot easily access specific numbers for appeals, but we receive 100-200 per day, of which 10-20 may be successful.

So to answer your questions:

• ~45% of images are immediately rejected/accepted after being seen by a single screener. We encourage this as it keeps the queue down, and as you can tell by the rate of successful appeals, the instant decisions (and votes) are correct the vast majority of the time.
• senior screeners can instant add/reject an image that has been voted on; regular screeners cannot, they can only vote or skip. Such decisions can be appealed as with any other rejection, but appeals of rejections from senior screeners have a very low success rate, under 5%

[PVG_Spotter]

This explains everything. Well done and thanks!

[PVG_Spotter]

The process begins with the image and associated data being visible to the screener. Once the image/data has been reviewed, there are six options for the screener to select:

1. Vote Add - the image will remain in the queue. It will be added if it receives another Vote Add, or rejected if it receives two Vote Rejects
2. Vote Reject - the image will remain in the queue. It will be rejected if it receives another Vote Reject, or added if it receives two Vote Adds
3. Skip - the image will remain in the queue and await the next screener
4. Instant Add - the image will be added immediately to the DB
5. Instant Reject - the image will be rejected immediately
6. Senior Review - the image will be sent to a special queue to be reviewed by senior screeners

Numbers from yesterday's screening:

1. Vote Add - 1394
2. Vote Reject - 773
3. Skip - 56
4. Instant Add - 1259
5. Instant Reject - 626
6. Senior Review - 1

We cannot easily access specific numbers for appeals, but we receive 100-200 per day, of which 10-20 may be successful.

So to answer your questions:

• ~45% of images are immediately rejected/accepted after being seen by a single screener. We encourage this as it keeps the queue down, and as you can tell by the rate of successful appeals, the instant decisions (and votes) are correct the vast majority of the time.
• senior screeners can instant add/reject an image that has been voted on; regular screeners cannot, they can only vote or skip. Such decisions can be appealed as with any other rejection, but appeals of rejections from senior screeners have a very low success rate, under 5%

Can regular screeners instant add/reject?

[dlowwa]

Can regular screeners instant add/reject?

Yes.

[CARBONOX CN]

The process begins with the image and associated data being visible to the screener. Once the image/data has been reviewed, there are six options for the screener to select:

1. Vote Add - the image will remain in the queue. It will be added if it receives another Vote Add, or rejected if it receives two Vote Rejects
2. Vote Reject - the image will remain in the queue. It will be rejected if it receives another Vote Reject, or added if it receives two Vote Adds
3. Skip - the image will remain in the queue and await the next screener
4. Instant Add - the image will be added immediately to the DB
5. Instant Reject - the image will be rejected immediately
6. Senior Review - the image will be sent to a special queue to be reviewed by senior screeners

Numbers from yesterday's screening:

1. Vote Add - 1394
2. Vote Reject - 773
3. Skip - 56
4. Instant Add - 1259
5. Instant Reject - 626
6. Senior Review - 1

We cannot easily access specific numbers for appeals, but we receive 100-200 per day, of which 10-20 may be successful.

So to answer your questions:

• ~45% of images are immediately rejected/accepted after being seen by a single screener. We encourage this as it keeps the queue down, and as you can tell by the rate of successful appeals, the instant decisions (and votes) are correct the vast majority of the time.
• senior screeners can instant add/reject an image that has been voted on; regular screeners cannot, they can only vote or skip. Such decisions can be appealed as with any other rejection, but appeals of rejections from senior screeners have a very low success rate, under 5%

btw, this isn't a payed job right? Seems like hard work screening so many photos everyday.

[dlowwa]

btw, this isn't a payed job right? Seems like hard work screening so many photos everyday.

We are not paid.

[bstolle]

The nerve wrecking part of the screening starts when the photo is being added to the rejected photo count, but remains in the screening queue until the final decision.

[Sam_F]

The process begins with the image and associated data being visible to the screener. Once the image/data has been reviewed, there are six options for the screener to select:

1. Vote Add - the image will remain in the queue. It will be added if it receives another Vote Add, or rejected if it receives two Vote Rejects
2. Vote Reject - the image will remain in the queue. It will be rejected if it receives another Vote Reject, or added if it receives two Vote Adds
3. Skip - the image will remain in the queue and await the next screener
4. Instant Add - the image will be added immediately to the DB
5. Instant Reject - the image will be rejected immediately
6. Senior Review - the image will be sent to a special queue to be reviewed by senior screeners

Numbers from yesterday's screening:

1. Vote Add - 1394
2. Vote Reject - 773
3. Skip - 56
4. Instant Add - 1259
5. Instant Reject - 626
6. Senior Review - 1

[/LIST]

Mr.dlowwa, thank you for explaining the screening process.
This is the first time I've heard of Vote Add and Vote Reject.
Five shots were added the other day, but the later shots in the queue were accepted overtaking the earlier ones.
This must be it!

[Matthias Klassen]

The process begins with the image and associated data being visible to the screener. Once the image/data has been reviewed, there are six options for the screener to select:

1. Vote Add - the image will remain in the queue. It will be added if it receives another Vote Add, or rejected if it receives two Vote Rejects
2. Vote Reject - the image will remain in the queue. It will be rejected if it receives another Vote Reject, or added if it receives two Vote Adds
3. Skip - the image will remain in the queue and await the next screener
4. Instant Add - the image will be added immediately to the DB
5. Instant Reject - the image will be rejected immediately
6. Senior Review - the image will be sent to a special queue to be reviewed by senior screeners

Numbers from yesterday's screening:

1. Vote Add - 1394
2. Vote Reject - 773
3. Skip - 56
4. Instant Add - 1259
5. Instant Reject - 626
6. Senior Review - 1

We cannot easily access specific numbers for appeals, but we receive 100-200 per day, of which 10-20 may be successful.

So to answer your questions:

• ~45% of images are immediately rejected/accepted after being seen by a single screener. We encourage this as it keeps the queue down, and as you can tell by the rate of successful appeals, the instant decisions (and votes) are correct the vast majority of the time.
• senior screeners can instant add/reject an image that has been voted on; regular screeners cannot, they can only vote or skip. Such decisions can be appealed as with any other rejection, but appeals of rejections from senior screeners have a very low success rate, under 5%

Hi! Thank you for sharing this, it's super interesting to understand how the system works. I have a suggestion that could perhaps help reduce the number of appeals on rejections: let the photographer know if their photo was rejected by a senior screener (instant add/reject). Since you said appeals of rejections from senior screeners have a very low success rate, this could make people think twice before appealing the photo and reduce the workload for the crew.

[Wheat]

I’m not sure if I’m allowed to share it but a while back I asked the same thing and Alex I believe shared a photo of what the screening process looks like.

[dlowwa]

I have a suggestion that could perhaps help reduce the number of appeals on rejections: let the photographer know if their photo was rejected by a senior screener (instant add/reject). Since you said appeals of rejections from senior screeners have a very low success rate, this could make people think twice before appealing the photo and reduce the workload for the crew.

Not going to happen. Letting people know who rejected whose image will cause more resentment than already exists. Already there are a fair number of people who believe they are targeted for rejections by crew who don't like them.

I’m not sure if I’m allowed to share it but a while back I asked the same thing and Alex I believe shared a photo of what the screening process looks like.

That was me.

[PVG_Spotter]

Not going to happen. Letting people know who rejected whose image will cause more resentment than already exists. Already there are a fair number of people who believe they are targeted for rejections by crew who don't like them.



That was me.

Can the screeners see the photographer id/name while screening?

[dlowwa]

Can the screeners see the photographer id/name while screening?

Yes, plus:

• Any warnings on their account
• All of their images in the DB
• All of their images currently in the queue
• All of their recently rejected images

[jakerepp]

Not going to happen. Letting people know who rejected whose image will cause more resentment than already exists. Already there are a fair number of people who believe they are targeted for rejections by crew who don't like them.



That was me.

Can you share screenshots again, or link to where those are? Curiosity is getting the better of me now