Annotate named entities and pronouns in news documents (6)
$30-250 AUD
Completed
Posted about 13 years ago
$30-250 AUD
Paid on delivery
This task requires excellent English reading comprehension skills. Only native-quality speakers of American/British English should apply. A familiarity with Australian news is a plus. We will be hiring multiple people for this task, so once this project has been awarded, another one will be posted.
We are a university research lab working on improving how news is presented to readers. We are developing a system to track mentions of people, places, locations, brands, and other entities in the news. The system needs to be trained on manually annotated examples. This is where you come in.
You will be given an annotation tool that highlights all capitalised words and all pronouns (he, she, it, etc) in news documents. You must:
1) Confirm which highlighted sequences are the names of people, places, organisations, products, locations, etc;
2) Find any names that weren't highlighted;
3) Link together the names of the same entity within a document (e.g., you would link "Peter Dutton" to "Mr. Dutton", as they're the same person);
4) Link pronouns (he, she, we, etc) to the name they refer to (e.g. in "Peter Dutton has walked away from his seat", you would mark "his" as referring to "Peter Dutton")
5) Link the entities to Wikipedia articles.
You will be given detailed documentation of the task, and we will train you through the first few hours of the annotation. Accuracy is critical for this work, because the purpose of these documents is to train a statistical system. Incorrectly annotated documents are useless to us, because our system would learn the incorrect behaviour.
Previous annotators have averaged approximately _4 documents per hour_. Please do not assume in your bid that you will be annotating faster than this, as you probably will not be able to do so without making mistakes.
Please bid on a price to complete 60 documents, with a milestone at 10 documents. There will be a two hour training period before you begin, where I will talk you through the task over IM. Your accuracy will be assessed over the first 10 documents to see whether we'll be able to use your annotation. You will need the Google Chrome browser (it's free), and a reliable internet connection, as the annotation tool is web-based.
We have over 200 hours of similar annotation work to do over the next month, with more to come after that. We are looking to build relationships with reliable annotators for the future.
I am a careful and comprehensive reader with an editing background. I am confident I can learn your system and provide highly accurate annotation. Thank you for your consideration.
This looks like a fun project!
I have an extensive background in proofreading and editing, and a superior command of English.
I have several Australian friends and do tend to keep up on the big news stories over there.
I will not be able to devote more than two or three hours a day at this time. I hope that will be acceptable.
$132.50 AUD in 7 days
5.0 (1 review)
2.2
2.2
9 freelancers are bidding on average $147 AUD for this job