TokensToUpper (StringTokenizer property)

Convert returned tokens to all-uppercase?

TokensToUpper is a member of the StringTokenizer class.

This readWrite property returns or sets the Boolean value that indicates whether to convert returned, non-quoted, tokens to all-uppercase characters. The default value for a new tokenizer is False.

Syntax

  %bool = %tok:TokensToUpper

  %tok:TokensToUpper = %bool

Syntax terms

%bool

An enumeration object of type Boolean to contain the returned value of TokensToUpper. For more information about Boolean enumerations, see Using Boolean enumerations.

%tok

A StringTokenizer object variable.

Usage Notes

• TokensToUpper has no effect on non-alphabetic characters.
• The TokensToLower property specifies or reports whether returned tokens are to be converted to lowercase characters.

Examples

In the following example, the input string's tokens are returned in sequence under the default (False) setting of TokensToUpper:

    %tok is object stringtokenizer
    %tok = new
    %tok:string = 'Bad,F  ?3mO ,7,{x Z}'
    repeat while not %tok:atEnd
       printText {~} is {%tok:nextToken}
    end repeat

The resulting tokens are:

    %tok:nextToken is Bad,F
    %tok:nextToken is ?3mO
    %tok:nextToken is ,7,{x
    %tok:nextToken is Z}

If %tok:TokensToUpper = True is specified for the instantiated object, the resulting tokens are:

    %tok:nextToken is BAD,F
    %tok:nextToken is ?3MO
    %tok:nextToken is ,7,{X
    %tok:nextToken is Z}