Tok
Defined in: document.ts:14
A word token with GLOBAL char offsets into the original text (lexical rules).
Properties
Section titled “Properties”end:
number
Defined in: document.ts:21
lower:
string
Defined in: document.ts:17
lower-cased text, for matching.
sentence
Section titled “sentence”sentence:
number
Defined in: document.ts:23
Index of the sentence this token belongs to.
start:
number
Defined in: document.ts:20
text:
string
Defined in: document.ts:15
upos:
string
Defined in: document.ts:19
Universal POS tag from the parse (‘NOUN’, ‘VERB’, ‘PUNCT’, …).