edu.northwestern.at.morphadorner.corpuslinguistics.tokenizer

## Interface PostTokenizer

- All Known Implementing Classes:
    AbstractPostTokenizer, DefaultPostTokenizer, EccoPostTokenizer, EEBOPostTokenizer

      public interface PostTokenizer

  Interface for processing an extracted token.

- - ### Method Summary

    Methods
    Modifier and Type | Method and Description
    --- | ---
    `void` | `close()` Close down the postTokenizer.
    `java.lang.String[]` | `postTokenize(java.lang.String token)` Process a token after tokenization.

- - ### Method Detail

    - #### postTokenize

          java.lang.String[] postTokenize(java.lang.String token)

      Process a token after tokenization.
      Parameters:
        `token` - The token to process after tokenization.
      Returns:
        Array of two strings. [0] = the token minimally processed. [1] = the token maximally processed.

        The minimally processed token is typically results in an original spelling.

        The maximally processed token typically results in a partially or completely standardized spelling.

        These may be identical.

    - #### close

          void close()

      Close down the postTokenizer.