Skip to main content
Version: 1.0

Token Class

Token stores data relative to a specific token. Tokens are delimited according to our Tokenizer.

Attributes / Properties

NameTypeDescription
common propertiesdepends on propertyProperties allowing access to specific data (pos, token etc.)