NextToken (StringTokenizer function): Difference between revisions

From m204wiki
Jump to navigation Jump to search
mNo edit summary
mNo edit summary
Line 1: Line 1:
<span style="font-size:120%; color:black"><b>Next token forward in current tokenizer string</b></span>
{{Template:StringTokenizer:NextToken subtitle}}
[[Category:StringTokenizer methods|NextToken function]]
<!--DPL?? Category:StringTokenizer methods|NextToken function: Next token forward in current tokenizer string-->
<!--DPL?? Category:System methods|NextToken (StringTokenizer function): Next token forward in current tokenizer string-->
<p>
NextToken is a member of the [[StringTokenizer class]].
</p>


This method returns the string value of
This method returns the string value of
Line 21: Line 15:
The delimiters can be modified by the [[Spaces (StringTokenizer property)|Spaces]],
The delimiters can be modified by the [[Spaces (StringTokenizer property)|Spaces]],
[[Quotes (StringTokenizer property)|Quotes]], and [[TokenChars (StringTokenizer property)|TokenChars]] properties.
[[Quotes (StringTokenizer property)|Quotes]], and [[TokenChars (StringTokenizer property)|TokenChars]] properties.
===Syntax===
==Syntax==
  %string = %tok:NextToken([Skip=num])
{{Template:StringTokenizer:NextToken syntax}}
===Syntax terms===
===Syntax terms===
<dl>
<dl>
Line 39: Line 33:


</dl>
</dl>
===Usage Notes===
==Usage notes==
<ul>
<ul>
<li>If the value of [[AtEnd (StringTokenizer function)|AtEnd]] is <tt>True</tt>,
<li>If the value of [[AtEnd (StringTokenizer function)|AtEnd]] is <tt>True</tt>,
Line 58: Line 52:
PeekToken, however, does not advance the tokenizing position.
PeekToken, however, does not advance the tokenizing position.
</ul>
</ul>
===Examples===
==Examples==
<ol>
<ol>
<li>In the following request fragment, the printText statements display,
<li>In the following request fragment, the printText statements display,
Line 91: Line 85:
</pre>
</pre>
</ol>
</ol>
==See also==
{{Template:StringTokenizer:NextToken footer}}

Revision as of 19:54, 6 February 2011

Next token forward in current tokenizer string (StringTokenizer class)


This method returns the string value of the next token forward in the current tokenizer string. The next token parsing begins from the tokenizing position, which is the value returned by NextPosition.

When the next token is determined, NextToken advances the tokenizing position to the position following that token, then returns the token value.

The delimiters that are involved in determining the tokens are set initially by the New method that instantiates the StringTokenizer object. The delimiters can be modified by the Spaces, Quotes, and TokenChars properties.

Syntax

[%string =] stringTokenizer:NextToken[( [Skip= number], [Default= string])] Throws MismatchedQuote, OutOfBounds

Syntax terms

%string
A string variable to receive the value of the current token.
%tok
A StringTokenizer object variable.
Skip= num
This name required numeric argument specifies a number of tokens to skip before returning the next token. The value of num must be greater than 0, and it must be be less than the number of tokens remaining in the tokenizer string. For an example, see item ?? refid=skipxmp.. The Skip parameter is available as of version 7.7 of the Sirius Mods.

Usage notes

  • If the value of AtEnd is True, issuing NextToken is invalid and cancels the request.
  • For a new StringTokenizer instance, issuing NextToken, FindToken, or SkipTokens is required before CurrentToken may be issued without error.
  • The NextPosition NextPosition returns the position of the character after the NextToken value. Conversely, the determination of the NextToken value always starts at the position given by NextPosition. If you reset NextPosition, the value returned by your next NextToken call will be based on the new NextPosition value.
  • The FindToken and PeekToken functions also return the next token. Like NextToken, FindToken advances the tokenizing position to the position following that token. PeekToken, however, does not advance the tokenizing position.

Examples

  1. In the following request fragment, the printText statements display, respectively, example, of, and nextToken.
        %tok is object stringTokenizer
        %tok = new
        %tok:string = 'example of nextToken'
        printText {%tok:nextToken}
        printText {%tok:nextToken}
        printText {%tok:nextToken}
    


  2. The following request fragment shows the effect of the Skip parameter:
        %tok:string = ' * 0 * 1 * 2 * 3 * 4 * 5 * 6 * 7'
        repeat while %tok:notAtEnd
          printtext {~} = '{%tok:nextToken(skip=1)}'
        end repeat
    

    The result is:

        %tok:nextToken(skip=1) = '0'
        %tok:nextToken(skip=1) = '1'
        %tok:nextToken(skip=1) = '2'
        %tok:nextToken(skip=1) = '3'
        %tok:nextToken(skip=1) = '4'
        %tok:nextToken(skip=1) = '5'
        %tok:nextToken(skip=1) = '6'
        %tok:nextToken(skip=1) = '7'
    

See also