Corpora and Annotation

• Tony McEnery and Andrew Wilson (1996): Corpus Linguistics. Edinburgh University Press.
• Geoffrey Leech (1997): Introducing Corpus Annotation. In: Richard Garside, Geoffrey Leech and Tony McEnery, editors: Corpus Annotation. London, New York: Longman, pp. 1-18.
• Steven Bird and Gary Simons (2003): Seven dimensions of portability for language documentation and description. Language 79: 557-582.
• Tony McEnery (2003): Corpus Linguistics. In: Ruslan Mitkov, editor: The Oxford Handbook of Computational Linguistics, pp. 448-463. Oxford University Press.
• Nancy Ide (2004): Preparation and analysis of linguistic corpora. In Susan Schreibman, Ray Siemens, John Unsworth, editors: A Companion to Digital Humanities. Blackwell.
  
  
• Corpora Mailing List
• Corpus Encoding Standard (CES)

Tokenisation

• Gregory Grefenstette and Pasi Tapanainen (1994): What is a word, what is a sentence? Problems of tokenization. In Proceedings of the 3rd Conference on Computational Lexicography and Text Research, pp. 79-87. Budapest, Hungary.
• Andrei Mikheev (2002): Periods, Capitalized Words, etc. Computational Linguistics, 28(3):289-318.
• Andrei Mikheev (2003): Text segmentation. In: Ruslan Mitkov, editor: The Oxford Handbook of Computational Linguistics, pp. 376-394. Oxford University Press.
• Helmut Schmid (2007?): Tokenizing. In: Anke Lüdeling and Merja Kytö, editors: Corpus Linguistics. An International Handbook. Mouton de Gruyter, Berlin.
  
  
• Tokeniser:
  • LT TTT versions 1.0 and 3.0 beta, Edinburgh Language Technology Group: text tokenization and toolset
  • MXTERMINATOR, Jeffrey C. Reynar and Adwait Ratnaparkhi (1997): A Maximum Entropy Approach to Identifying Sentence Boundaries. In Proceedings of the 5th Conference on Applied Natural Language Processing. Washington, D.C.

Type/Token Frequency Distributions

• George K. Zipf (1949): Human Behaviour and the Principle of Least-Effort. Addison-Wesley, Cambridge, MA.
• Christopher D. Manning and Hinrich Schütze (1999): Foundations of Statistical Natural Language Processing, section 1.4. MIT Press.
• Harald Baayen (2001): Word frequency distributions. Kluwer Academic Publishers.
• Marco Baroni (2007?): Distributions in Text. In: Anke Lüdeling and Merja Kytö, editors: Corpus Linguistics. An International Handbook. Mouton de Gruyter, Berlin.

Part-of-Speech Tagging

• Anne Schiller and Simone Teufel (1995): Guidelines für das Tagging deutscher Textkorpora mit STTS. Manuscript, in German. Institut für Maschinelle Sprachverarbeitung, Universität Stuttgart.
• Christopher D. Manning and Hinrich Schütze (1999): Foundations of Statistical Natural Language Processing, chapter 10. MIT Press.
• Atro Voutilainen (2003): Part-of-speech tagging. In: Ruslan Mitkov, editor: The Oxford Handbook of Computational Linguistics, pp. 219-232. Oxford University Press.
• Helmut Schmid (2007?): Part-of-Speech Tagging. In: Anke Lüdeling and Merja Kytö, editors: Corpus Linguistics. An International Handbook. Mouton de Gruyter, Berlin.
  
  
• Tagger:
  • TnT - Trigram Tagger, Thorsten Brants (2000): TnT - A statistical part-of-speech tagger. In Proceedings of the 6th Applied Natural Language Processing Conference.
  • Tree Tagger, Helmut Schmid (1994): Probabilistic part-of-speech tagging using decision trees. In Proceedings of the International Conference on New Methods in Language Processing.
  • Brill Tagger, Eric Brill (1995): Transformation-based error-driven learning and Natural Language Processing: A case study in part-of-speech tagging. Computational Linguistics, 21(4):543-565.

Morphological Annotation

• Kimmo Koskenniemi (1984): A general computational model for word-form recognition and production. In Proceedings of the 10th International Conference on Computational Linguistics, pp. 178-181.
• Kenneth R. Beesley and Lauri Karttunen (2003): Finite state morphology. CSLI Publications.
• Harald Trost (2003): Computational Morphology. In: Ruslan Mitkov, editor: The Oxford Handbook of Computational Linguistics, pp. 25-47. Oxford University Press.
• Marco Baroni (2003): Distribution-driven morpheme discovery: A computational/experimental study. In: Geert Booij and Jaap van Marle, editors: "Yearbook of Morphology 2003", pp. 213-248.
• Harald Hammarström (2006): A naive theory of affixation and an algorithm for extraction. In Proceedings of the 8th Meeting of the ACL Special Interest Group in Computational Phonology (SIGPHON).
• PASCAL challenge on "Unsupervised segmentation of words into morphemes"
  
  
• Morphological analyser:
  • Porter Stemmer (for English)
  • Snowball, a system for stemming algorithms
  • Stuttgart Finite State Transducer Tools (SFST)

Word Distributions

• Zellig Harris (1968): Distributional Structure. In: Jerold J. Katz, editor: The Philosophy of Linguistics, pp. 26-47. Oxford University Press.
• Kenneth W. Church and Patrick Hanks (1990): Word association norms, mutual information, and lexicography. Computational Linguistics, 16(1):22-29.
• Ted Dunning (1993): Accurate methods for the statistics of surprise and coincidence. Computational Linguistics, 19(1):61-74.
• Stefan Evert (2004): The statistics of word cooccurrences: word pairs and collocations. PhD thesis, Institut für Maschinelle Sprachverarbeitung, Universität Stuttgart.
• Oliver Christ, Bruno M. Schulze, Anja Hofmann, Esther König (1999): The IMS corpus workbench: Corpus Query Processor. Technical report, Institut für Maschinelle Sprachverarbeitung, Universität Stuttgart.
• Adam Kilgarriff, Pavel Rychly, Pavel Smrz, and David Tugwell (2004): The Sketch Engine. In Proceedings of the 11th EURALEX International Congress. Lorient, France.
  
  
• Collocations and multiword expressions online:
  • collocations.de
  • CQP demo
  • sketch engine
  • multiword expressions project

Syntactic Annotation

• Steven Abney (1991): Parsing by chunks. In: Robert Berwick, Steven Abney and Carol Tenny, editors: Principle-Based Parsing. Kluwer Academic Publishers, Dordrecht.
• Geoffrey Leech and Elizabeth Eyes (1997): Syntactic Annotation: Treebanks. In: Richard Garside, Geoffrey Leech and Anthony McEnery, editors: Corpus Annotation. London, New York: Longman, pp. 34-52.
• John Carroll, Guido Minnen, and Ted Briscoe (1999): Corpus annotation for parser evaluation. In Proceedings of Linguistically Interpreted Corpora.
• Anne Abeille, editor (2003): Treebanks: Bulding and Using Parsed Corpora. Dordrecht, Boston, London: Kluwer Academic Publishers.
• Catherine Lai and Steven Bird (2004): Querying and updating treebanks: A critical survey and requirements analysis. In Proceedings of the Australasian Language Technology Workshop.
• Joakim Nivre (2007?): Treebanks. In: Anke Lüdeling and Merja Kytö, editors: Corpus Linguistics. An International Handbook. Mouton de Gruyter, Berlin.
  
  
• Penn Treebank:
  • Michell Marcus, Grace Kim, Mary Ann Marcinkiewicz, Robert MacIntyre, Ann Bies, Mark Ferguson, Karen Katz, Britta Schasberger (1994): The Penn Treebank: Annotating predicate argument structure. In Proceedings of the ARPA Human Language Technology Workshop.
  • Mitchell Marcus, Beatrice Santorini, Mary Ann Marcinkiewicz (1993): Building a large annotated corpus of English: The Penn Treebank. In: Computational Linguistics 19.
  • Survey of Penn Treebank II annotation
  • POS-Tagset
  • Penn Treebank Online Search
  
  
• TIGER Treebank:
  • TIGER Treebank Home
  • STTS-Tagset (Schiller et al., 1999)
  • Tagging Manual (in German)

Semantic Annotation

• Michael Lesk (1986): Automatic sense disambiguation using machine readable dictionaries: How to tell a pine cone from an ice cream cone. In Proceedings of the SIGDOC Conference. Toronto, Canada.
• William A. Gale, Kenneth W. Church, and David Yarowsky (1992): One sense per discourse. In Proceedings of the DARPA Speech and Natural Language Workshop.
• Adam Kilgarriff (1997): I don't believe in word senses. Computers and the Humanities, 31(2):91-113.
• Patrick Hanks (2000): Do word meanings exist? Computers and the Humanities, 34(1-2):205-215.
• Martha Palmer (2000): Consistent criteria for sense distinctions. Computers and the Humanities, 34(1-2):217-222.

• George A. Miller, editor (1990): WordNet: An on-line lexical database. Special issue of the International Journal of Lexicography, 3(4). Pre-print version.
• Christiane Fellbaum, editor (1998): WordNet - An electronic lexical database. MIT Press.
• Piek Vossen (2004): EuroWordNet: A multilingual database of autonomous and language-specific WordNets connected via an interlingual index. International Journal of Lexicography, 17:161-173.
  
  
• WordNets online:
  • WordNet
  • EuroWordNet
  • MultiWordNet
  • Global WordNet Association

• Eva Hajicová, Jarmila Panevová, and Petr Sgall (2000): A manual for tectogrammatic tagging of the Prague Dependency Treebank. UFAL/CKL Technical Report TR-2000-09, Charles University, Prague.
• Alena Böhmová, Jan Hajic, Eva Hajicová, and Barbora Hladká (2003): The Prague Dependency Treebank: A three-level annotation scenario. In: Anne Abeille, editor: "Treebanks: building and using syntactically annotated corpora". Kluwer Academic Publishers.
• Petr Sgall, Jarmila Panevová, and Eva Hajicová (2004): Deep syntactic annotation: Tectogrammatical representation and beyond. In Proceedings of the HLT-NAACL Workshop on "Frontiers in Corpus Annotation". Boston, MA.
• Jan Hajic and Zdenka Uresová (2005): The Prague Dependency Treebank and Valency Annotation. Tutorial at RANLP, Borovets.
• PDT online

• Collin F. Baker, Charles J. Fillmore, and John B. Lowe (1998): The Berkeley FrameNet project. In Proceedings of the 17th International Conference on Computational Linguistics, pp. 86-90.
• Thierry Fontenelle, editor (2003): FrameNet and frame semantics. Special issue of the International Journal of Lexicography, 16(3).

• Katrin Erk, Andrea Kowalski, Sebastian Padó, and Manfred Pinkal (2003): Towards a resource for lexical semantics: A large German corpus with extensive semantic annotation. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics.
• Aljoscha Burchardt, Katrin Erk, Anette Frank, Andrea Kowalski, Sebastian Padó, Manfred Pinkal (2006): The SALSA corpus: A German corpus resource for lexical semantics. In Proceedings of the 5th International Conference on Language Resources and Evaluation.

• Carlos Subirats and Hiroaki Sato (2004): Spanish FrameNet and FrameSQL. In Proceedings of the LREC Workshop on "Building Lexical Resources from Semantically Annotated Corpora".

• Kyoko Hirose Ohara, Seiko Fujii, Toshio Ohori, Ryoko Suzuki, Hiroaki Saito, and Shun Ishizaki (2004): The Japanese FrameNet project: An introduction. In Proceedings of the LREC Workshop on "Building Lexical Resources from Semantically Annotated Corpora".

• English
• German
• Spanish
• Japanese

• Paul Kingsbury and Martha Palmer (2002): From Treebank to PropBank. In Proceedings of the 3rd International Conference on Language Resources and Evaluation. Las Palmas de Gran Canaria, Spain.
• Martha Palmer, Dan Gildea, and Paul Kingsbury (2005): The Proposition Bank: A corpus annotated with semantic roles. Computational Linguistics, 31(1):71-106.
• Olga Babko-Malaya (2005): PropBank annotation guidelines. Manuscript.
• Olga Babko-Malaya (2005): Guidelines for PropBank framers. Manuscript.
  
  
• PropBank online
• NomBank online

• Invited talk by Eduard Hovy at LREC 2006: Corpus creation by annotation. Genoa, Italy.
• Eduard Hovy, Mitchell Marcus, Martha Palmer, Lance Ramshaw, and Ralph Weischedel (2006): OntoNotes: The 90% Solution. In Proceedings of the Human Language Technology of the North American Chapter of the Association for Computational Linguistics. New York City, NY.
• OntoBank online: link not yet available, check Eduard Hovy's website

• Nancy Ide and Jean Véronis (1998): Introduction to the special issue on Word Sense Disambiguation: The state of the art. Computational Linguistics, 24(1):1-40.
• Adam Kilgarriff and Martha Palmer (2000): Introduction to the special issue on SENSEVAL. Computers and the Humanities, 34(1-2):1-13.
• Philip Edmonds and Adam Kilgarriff (2002): Introduction to the special issue on evaluating Word Sense Disambiguation systems. Journal of Natural Language Engineering, 8(4).
• Xavier Carreras and Lluís Márquez (2004,2005): Introduction to the CoNLL shared task: semantic role labeling (2004,2005). Conferences on Natural Language Learning.
• SensEval and SemEval online

Evaluation

• Christopher D. Manning and Hinrich Schütze (1999): Foundations of Statistical Natural Language Processing, Section 8.1. MIT Press.
• Jean Carletta (1996): Assessing agreement on classification tasks: The kappa statistic. Computational Linguistics, 22(2):249-254.
• Brigitte Krenn, Stefan Evert, and Heike Zinsmeister (2004): Determining intercoder agreement for a collocation identification task. In Proceedings of KONVENS (Konferenz zur Verarbeitung natürlicher Sprache). Vienna, Austria.
• Barbara Di Eugenio and Michael Glass (2004): The kappa statistic: A second look. Computational Linguistics, 30(1):95-101.
  
  
• Application-based evaluation:
  • ParsEval
  • English parser evaluation test suite
  • SensEval
  • shared tasks at CoNNL
  • PASCAL challenges

More Levels of Corpus Annotation

• Eva Hajicová (1999): The Prague Dependency Treebank: Crossing the sentence boundary. In Proceedings of the 2nd Workshop on Text, Speech, Dialogue, pp. 20-27. Mariánske Lázne, Czech Republic.
• Eva Hajicová, Jarmila Panevová, and Petr Sgall (2000): Coreference in annotating a large corpus. In Proceedings of the 2nd International Conference on Language Resources and Evaluation, pp. 497-500. Athens, Greece.
• Oana Postolache, Ivana Kruijff-Korbayová, and Geert-Jan Kruijff (2005): Data-driven approaches for information structure identification. In Proceedings of the joint Conference on Human Language Technology and Empirical Methods in Natural Language Processing, pp. 9-16. Vancouver, Canada.
• PDT online

• William C. Mann and Sandra A. Thompson (1988): Rhetorical Structure Theory: Toward a functional theory of text organization. Text, 8(3):243-281.
• Maite Taboada and William C. Mann (2006, to appear): Rhetorical Structure Theory: Looking back and moving ahead. Discourse Studies, 8(3).
• Maite Taboada and William C. Mann (2006, to appear): Applications of Rhetorical Structure Theory. Discourse Studies.
• RST online

• Eleni Miltsakaki, Rashmi Prasad, Aravind Joshi, and Bonnie Webber (2004): The Penn Discourse TreeBank. In Proceedings of the 4th International Conference on Language Resources and Evaluation. Lisbon, Portugal.
• Eleni Miltsakaki, Rashmi Prasad, Aravind Joshi, and Bonnie Webber (2004): Annotating discourse connectives and their arguments. In Proceedings of the HLT/NAACL Workshop on "Frontiers in Corpus Annotation". Boston, MA.
• Eleni Miltsakaki, Nikhil Dinesh, Rashmi Prasad, Aravind Joshi, and Bonnie Webber (2005): Experiments on sense annotations and sense disambiguation of discourse connectives. In Proceedings of the 4th Workshop on "Treebanks and Linguistic Theories". Barcelona, Spain.
• Bonnie Webber, Aravind Joshi, Eleni Miltsakaki, Rashmi Prasad, Nikhil Dinesh, Alan Lee, and Kate Forbes (2005): A short introduction to the Penn Discourse TreeBank. In Copenhagen Working Papers in Language and Speech Processing.
• Bonnie Webber, Matthew Stone, Aravind Joshi, and Alistair Knott (2001): Anaphora and discourse structure. Computational Linguistics, 29(4):545-587.
• The PDTB Research Group (2006): The Penn Discourse TreeBank 1.0. Annotation Manual. IRCS Technical Report IRCS-06-01, Institute for Research in Cognitive Science, University of Pennsylvania.
• PDTB online

• Ruslan Mitkov, Richard Evans, Constantin Orasan, Catalina Barbu, Lisa Jones, and Violeta Sotirova (2000): Coreference and anaphora: Developing annotating tools, annotated resources and annotation strategies. In Proceedings of the Discourse, Anaphora and Reference Resolution Conference, pp. 49-58. Lancaster, UK.
• Eva Hajicová, Jarmila Panevová, and Petr Sgall (2000): Coreference in annotating a large corpus. In Proceedings of the 2nd International Conference on Language Resources and Evaluation, pp. 497-500. Athens, Greece.
• Erhard Hinrichs, Sandra Kübler, Karin Naumann, Heike Telljohann, Julia Trushkina, and Heike Zinsmeister (2005): Recent developments in linguistic annotations of the TüBa-D/Z Treebank. Poster at the 27th Annual Meeting of the German Linguistic Society (Deutsche Gesellschaft für Sprachwissenschaft). Köln, Germany.

• Benno Peters (2005): The database `The Kiel Corpus of Spontaneous Speech'. In Klaus J. Kohler, Felicitas Kleber, Benno Peters, editors: "Arbeitsberichte des Instituts für Phonetik und digitale Sprachverarbeitung der Universität Kiel: Prosodic Structures in German Spontaneous Speech", no. 35a, pp. 1-6.
• Caren Brinckmann (2005): The Kiel Corpus of Read Speech as a resource for prosody prediction in speech synthesis. In Proceedings of the 2nd Baltic Conference on Human Language Technologies. Tallinn, Estonia.
• Jonathan Harrington: The phonetic analysis of speech corpora. Manuscript. Parts available online.
• Kiel Corpus online

• Jean Carletta and Amy Isard (1999): The MATE annotation workbench: User requirements. In Proceedings of the ACL Workshop on "Towards Standards and Tools for Discourse Tagging".
• David McKelvie, Amy Isard, Andreas Mengel, Morten Baun Moller, Michael Grosse, and Marion Klein (2001): The MATE workbench - An annotation tool for XML coded speech corpora. In Speech Communication, 33(1-2):97-112. Special issue on "Speech Annotation and Corpus Tools".
• MATE online

• Niels Ole Bernsen, Laila Dybkjaer, and Mykola Kolodnytsky (2002): The NITE workbench - A tool for annotation of natural interactivity and multimodal data. In Proceedings of the 3rd International Conference on Language Resources and Evaluation, Las Palmas de Gran Canaria, Spain.
• Niels Ole Bernsen, Laila Dybkjaer, and Mykola Kolodnytsky (2002): An interface for annotating natural interactivity. In Jan van Kuppevelt and Ronnie W. Smith, editors: "Current and New Directions in Discourse and Dialogue". Kluwer Academic Publishers.
• NITE online

Web as Corpus

• Adam Kilgarriff and Gregory Grefenstette (2003): Introduction to the special issue on the web as corpus. In: Computational Linguistics 29(3).
• Marco Baroni and Silvia Bernardini (2004): BootCaT: Bootstrapping corpora and terms from the web. In Proceedings of the 4th International Conference on Language Resources and Evaluation. Lisbon, Portugal.