We should all be worried about AI infiltrating crowdsourced work

[ad_1]

A new paper from researchers at Swiss university EPFL suggests that between 33% and 46% of distributed crowd workers on Amazon’s Mechanical Turk service appear to have “cheated” when performing a particular task assigned to them, as they used tools such as ChatGPT to do some of the work. If that practice is widespread, it may turn out to be a pretty serious issue.

Amazon’s Mechanical Turk has long been a refuge for frustrated developers who want to get work done by humans. In a nutshell, it’s an application programming interface (API) that feeds tasks to humans, who do them and then return the results. These tasks are usually the kind that you wish computers would be better at. Per Amazon, an example of such tasks would be: “Drawing bounding boxes to build high-quality datasets for computer vision models, where the task might be too ambiguous for a purely mechanical solution and too vast for even a large team of human experts.”

Data scientists treat datasets differently according to their origin — if they’re generated by people or a large language model (LLM). However, the problem here with Mechanical Turk is worse than it sounds: AI is now available cheaply enough that product managers who choose to use Mechanical Turk over a machine-generated solution are relying on humans being better at something than robots. Poisoning that well of data could have serious repercussions.

“Distinguishing LLMs from human-generated text is difficult for both machine learning models and humans alike,” the researchers said. The researchers therefore created a methodology for figuring out whether text-based content was created by a human or a machine.

The test involved asking crowdsourced workers to condense research abstracts from the New England Journal of Medicine into 100-word summaries. It is worth noting that this is precisely the kind of task that generative AI technologies such as ChatGPT are good at.

[ad_2]

Source link

We will be happy to hear your thoughts

Leave a reply

https://www.hontrade.fi/slot-resmi/

https://psychprovider.com/wp-content/slot-bet100/

https://wznh.org/wp-content/slot88/

https://monika-boettcher.com/wp-content/slot-bet-100/

https://www.herbanaturalcolour.com/wp-content/slot88/

RTP

Slot Deposit

Slot Bet Kecil

Slot88

Slot Bet 100

Slot88

Slot88

Slot Bet 100

Slot88

Slot bet 100

Slot777

Slot

Slot PG Soft Bet 200

Pragmatic Play

Slot Bet 200

Situs Slot88

Slot Bet 200

Slot88 Gacor

https://fanboyscollectors.com/wp-includes/slot777/

https://flamencomv.com.ve/wp-includes/sbobet/

https://cafe-bazilio.ru/slot-bet-100/

https://irancar.co/wp-content/mahjong-ways/

https://mehravaraneshahr.com/wp-content/slot-bet-100/

https://webem.ru/wp-includes/slot88/

https://mesure-pro.com/wp-content/slot-resmi/

https://nhero.ru/wp-content/slot-deposit-pulsa/

https://cafe-bazilio.ru/slot-bet-100/

https://irancar.co/wp-content/mahjong-ways/

https://1goodstore.com/wp-content/slot88/

https://tribaltravellaos.com/wp-admin/slot777/

https://morganwantads.com/wp-includes/slot-server-platinum/

https://www.guuf.org/wp-includes/slot-gacor/

https://turkuazmobilya.net/wp-includes/slot-server-platinum/

https://passioncode.fr/wp-includes/slot88/

https://bistrotagines.se/wp-content/sbobet/

https://www.oligoflowersbeauty.it/wp-content/slot-resmi/

https://www.birkatshalom.org/wp-includes/slot-server-platinum/

Bonus New Member

akun pro platinum

Slot Server Platinum

Slot88

pragmatic

Slot88

bonus new member

https://plosefit.com/slot-kamboja/

https://www.socalimplants.com/

https://hernanbrito.online/

https://yourcbdsite.com/

https://www.esquimmo.com/olympus/

https://newsbell.website/wp-content/pragmatic-play/

https://ostalux.com/bonus-new-member/

https://sadirista.com/wp-content/rtp-slot/

https://burhanienterprise.net/wp-content/sbobet-euro/

https://apk.urbanciaga.com/wp-content/starlight-princess/

https://givebacktocommunity.org/wp-content/pragmatic-play/

https://www.vishwaarogyasena.com/wp-includes/slot-bonus/

https://psdwing.com/rtp-slot/

https://susanamendezjewelry.com/wp-content/sbobet-euro/

https://bidirdioglu.com/wp-includes/starlight-princess/

https://programacion.click/aztec-gems

https://successionquest.com/slot-bonanza

https://paggitech.com/starlight-princess/

https://rocmont.com/slot-qris

https://tonimarengo.es/slot-bonus/

Situs Judi Bola

Situs Judi Bola

Sbobet

Sbobet

Sbobet

judi bola online

judi bola online

daftar sbobet

Judi Bola

Judi Bola

Judi Bola

Judi Bola

Situs Judi Bola

sbobet88

https://rayaclub.com/judi-bola/

https://hergrill.com/judi-bola/

situs judi bola

situs judi bola

situs judi bola

judi bola

sbobet

situs judi bola

situs judi bola

Judi Bola

Judi Bola

Sbobet

Situs Judi Bola

Situs Judi Bola

Slot Dana

judi bola

Sbobet

Slot Mental

slot depo 10k

starlight princess

spaceman

aztec slot

olympus slot

demo rujak bonanza

gates of gatot kaca