Word Usage Graphs (WUGs)

Each resource contains the following data:

• readme: containing information specific to the resource.
• annotators: a list of all (anonymized) annotators.
• guidelines: used to train annotators.
• data: for each word including
  • uses: with the main use in the column 'context' as a spelling-normalized version of 'context_tokenized' (see code below). The column 'indexes_target_token' gives the character indexes of the target token in 'context' (Python list ranges as used in slicing), while the column 'indexes_target_sentence' gives the character indexes of the target sentence (containing the target token) in 'context'. Similarly, the columns 'indexes_target_token_tokenized' and 'indexes_target_sentence_tokenized' contain the token indexes of target token and sentence in the tokenized, lemmatized and POS-tagged version of the word use (after splitting at whitespaces). We provide meta-information on each use (POS, date, etc.) and tokenized, lemmatized and POS-tagged versions if available.
  • judgments: human semantic proximity judgments of use pairs.
  • senses (optional): sense descriptions, if available.
  • judgments_senses (optional): judgments of sense descriptions for uses, if available.
• graphs: WUGs derived from the annotated data as Python NetworkX objects (see code). The folder full/ contains the full graphs with all nodes and edges without clustering. opt/ contains the latest cleaned and optimized version including a clustering obtained with optimized parameters (see code). Additionally, we provide versions of the graphs related to previous publications (e.g. semeval/).
• clusters: clusterings extracted from the respective graphs.
• plots: two-dimensional visualizations of the respective graphs. Clusters are visualized as nodes with the same color (additionally marked by common numbers in nodes to avoid confusion of colors). Black edges mark median judgments with values above the chosen threshold for clustering (e.g. 2.5), while gray edges mark median judgments below that threshold. We provide various versions of the plots with different edge labels (e.g. edges labeled with all their judgments or only the median judgment respectively). Nodes contain the context of the corresponding word use with additional meta-information. Nodes can be moved by clicking and dragging. We also provide visualizations of subgraphs corresponding to each grouping of the nodes as specified in the use files (e.g. time periods) and pairwise aligned versions for each combination of groupings. Mozilla Firefox is often a good choice to open the visualizations.
• stats: statistics derived from the respective graphs including clustering statistics. We also report statistics concerning the comparison of clusterings between groupings including change scores as well as annotator agreement.

Additional data may be provided for individual resources, as specified in their readme.

All text files are tab-separated and use UTF-8 encoding. Quotes do not mark strings, but are part of the original contexts.

We provide code to create, process and cluster the graphs in the WUG repository.

Dominik Schlechtweg and Sabine Schulte im Walde. submitted. Clustering Word Usage Graphs: A Flexible Framework to Measure Changes in Contextual Word Meaning.