public class TokenizerGateWrapper extends MorphAdornerGateWrapperBase
| Modifier and Type | Class and Description |
|---|---|
(package private) class |
TokenizerGateWrapper.TokenAnnotation
Hold a single token annotation.
|
| Modifier and Type | Field and Description |
|---|---|
protected SentenceSplitter |
sentenceSplitter
Sentence splitter.
|
protected WordTokenizer |
tokenizer
Word tokenizer.
|
alternateSpellingsURL, BASE_SENTENCE_ANNOTATION_TYPE_PARAMETER_NAME, BASE_TOKEN_ANNOTATION_TYPE_PARAMETER_NAME, baseSentenceAnnotationType, baseTokenAnnotationType, encoding, guesser, inputASName, lemmaSeparator, outputAnnotationType, outputASName, spellingsURL, spellingTokenizer, suffixLexicon, TAG_DOCUMENT_PARAMETER_NAME, TAG_INPUT_AS_PARAMETER_NAME, TAG_OUTPUT_AS_PARAMETER_NAME, tagSeparator, TOKEN_LEMMA_FEATURE_NAME, TOKEN_SPELLING_FEATURE_NAME, TOKEN_STANDARD_SPELLING_FEATURE_NAME, wordLexiconANNOTATION_COREF_FEATURE_NAME, DATE_ANNOTATION_TYPE, DATE_POSTED_ANNOTATION_TYPE, DOCUMENT_COREF_FEATURE_NAME, JOB_ID_ANNOTATION_TYPE, LOCATION_ANNOTATION_TYPE, LOOKUP_ANNOTATION_TYPE, LOOKUP_CLASS_FEATURE_NAME, LOOKUP_INSTANCE_FEATURE_NAME, LOOKUP_MAJOR_TYPE_FEATURE_NAME, LOOKUP_MINOR_TYPE_FEATURE_NAME, LOOKUP_ONTOLOGY_FEATURE_NAME, MONEY_ANNOTATION_TYPE, ORGANIZATION_ANNOTATION_TYPE, PERSON_ANNOTATION_TYPE, PERSON_GENDER_FEATURE_NAME, PR_NAMES, SENTENCE_ANNOTATION_TYPE, SPACE_TOKEN_ANNOTATION_TYPE, TOKEN_ANNOTATION_TYPE, TOKEN_CATEGORY_FEATURE_NAME, TOKEN_KIND_FEATURE_NAME, TOKEN_LENGTH_FEATURE_NAME, TOKEN_ORTH_FEATURE_NAME, TOKEN_STRING_FEATURE_NAME| Constructor and Description |
|---|
TokenizerGateWrapper() |
| Modifier and Type | Method and Description |
|---|---|
void |
execute()
Perform adornment.
|
gate.Resource |
init()
Initialize resources.
|
addFeatures, checkGateResources, commonInit, getBaseSentenceAnnotationType, getBaseTokenAnnotationType, getEncoding, getInputASName, getLexicons, getOutputAnnotationType, getOutputASName, getPartOfSpeechGuesser, setBaseSentenceAnnotationType, setBaseTokenAnnotationType, setEncoding, setInputASName, setOutputAnnotationType, setOutputASNamegetCorpus, getDocument, setCorpus, setDocumentaddProgressListener, addStatusListener, cleanup, fireProcessFinished, fireProgressChanged, fireStatusChanged, interrupt, isInterrupted, reInit, removeProgressListener, removeStatusListenercheckParameterValues, getBeanInfo, getName, getParameterValue, getParameterValue, removeResourceListeners, setName, setParameterValue, setParameterValue, setParameterValues, setParameterValues, setResourceListenersclone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitprotected SentenceSplitter sentenceSplitter
protected WordTokenizer tokenizer
public gate.Resource init()
throws gate.creole.ResourceInstantiationException
init in interface gate.Resourceinit in class MorphAdornerGateWrapperBasegate.creole.ResourceInstantiationExceptionpublic void execute()
throws gate.creole.ExecutionException
MorphAdornerGateWrapperBaseexecute in interface gate.Executableexecute in class MorphAdornerGateWrapperBasegate.creole.ExecutionException