This dataset contains 30,000 messages drawn from events including an earthquake in Haiti in 2010, an earthquake in Chile in 2010, floods in Pakistan in 2010, super-storm Sandy in the U.S.A. in 2012, and news articles spanning a large number of years and 100s of different disasters.
The data has been encoded with 36 different categories related to disaster response and has been stripped of messages with sensitive information in their entirety.
Upon release, this is the featured dataset of a new Udacity course on Data Science and the AI4ALL summer school and is especially utile for text analytics and natural language processing (NLP) tasks and models.
Below, you’ll find a link to the Appen template used to annotate these messages. The “Duplicate Job” button will take you to that template should you want to duplicate the workflow or build on this dataset.
Job Design and Instructions
The input data in this job contains thousands of untranslated disaster-related messages and their English translations. In the “Data” tab above, you’ll find the annotated data, with 40 class labels for intent and content.
|9||test||UN reports Leogane 80-90 destroyed. Only Hospital St. Croix functioning. Needs supplies desperately.||UN reports Leogane 80-90 destroyed. Only Hospital St. Croix functioning. Needs supplies desperately.|
|39||test||We are at Gressier we needs assistance right away. ASAP, Come help us.||Se gressier nou an difikilte tanpri vin ede nou|
|49||test||Delmas 33 in Silo, need water.||Delma 33 silo gen problem dlo|
|79||test||SOS SOS, please provide police officers on the streets as they are very insecure||EMGENCY EMGENCY SI POLIS LA TE KA BAY PREZANS LI SOU CHAK PLAS AK LARI LI TAP BON PASKE CHAK SWA YO F ANPIL DEGA MENM DETWI LAVI MOUN ENPOTAN|
|99||test||I am a driver, a mechanic ,. I want to help||MWEN SE YON NMALIEN, CHOF, MEKANISYEN MWEN BEZWEN BAY SEKOU|
|119||test||We are at Fort Mercredi ( wednesday ) where can we find tents and treated water.||Nous sommes Fort - Mercredi Ou on peux trouver des tentes et des eaux traites|
|129||test||Our imcomprehensibley of 9 member was repatriated incomprehensible - (Location) Duvivier, Fond Grango||asyon de 9 manb nou nan rapatriye zon la plan divivye fontan, grango|
|139||test||A cold front is on Cuba this morning. It could cross Haiti tomorrow. Isolated rain showers are expected for our region.||Un front froid se retrouve sur Cuba ce matin. Il pourrait traverser Haiti demain. Des averses de pluie isolee sont encore prevues sur notre region ce soi|
|149||test||Please Bo Gravel Vob Ta A 41 we are hungry. Need food.||SVP BO GRAVEL VOB TAA 41 NOU GRANGOU|
This dataset contains the original message in its original language, the English translation, and dozens of classes for message content. These classes are noted in column titles with a simple binary 1= yes, 2=no.