Next: Token-to-word rules Up: Modules Previous: Tokenization   Contents
With the help of ``CART-lists'' the feature ``token_pos'' is assigned to each token in the token relation. To display this information, (item.feat TOKEN ``token_pos'') can be used. The token-to-word rules make use of this information. In our German version the Token-POS module is, e.g., used to distinguish between ordinals and cardinals.