Spaces (StringTokenizer property) - Revision history

JAL2 at 01:12, 6 July 2012

2012-07-06T01:12:08Z

← Older revision		Revision as of 01:12, 6 July 2012
Line 7:		Line 7:

	You can specify "token delimiters," which are delimiters that are also tokens,		You can specify "token delimiters," which are delimiters that are also tokens,
	using the [[TokenChars (StringTokenizer property)\|TokenChars]] property or the [[New (StringTokenizer constructor)\|New]] constructor TokenChars parameter.		using the <var>[[TokenChars (StringTokenizer property)\|TokenChars]]</var> property or the <var>[[New (StringTokenizer constructor)\|New]]</var> constructor <var>TokenChars</var> parameter.

	One or multiple consecutive whitespace characters mark the end or beginning		One or multiple consecutive whitespace characters mark the end or beginning
Line 15:		Line 15:
	==Syntax==		==Syntax==
	{{Template:StringTokenizer:Spaces syntax}}		{{Template:StringTokenizer:Spaces syntax}}

	===Syntax terms===		===Syntax terms===
	<table class="syntaxTable">		<table class="syntaxTable">
	<tr><th>%currentString</th>		<tr><th>%currentString</th>
	<td>A string variable to contain the returned value of the current whitespace characters ~~or to be set as~~ the ~~new value(s). The default value for a new tokenizer instance~~ is a ~~blank~~ character.		<td>A string variable to contain the returned value of the current whitespace characters. Each character in the string is a space character. </td></tr>

	If you are setting <var>Spaces</var>, each character in the string is a space character — that is, you may not separate characters — and no character may repeat (except for apostrophe, which may be doubled). </td></tr>
	<tr><th>stringTokenizer</th>		<tr><th>stringTokenizer</th>
	<td>A <var>StringTokenizer</var> object expression.</td></tr>		<td>A <var>StringTokenizer</var> object expression.</td></tr>

	<tr><th>newString</th>		<tr><th>newString</th>
	<td>The String value to assign <var class="term">stringTokenizer</var>'s <var>Spaces</var> property.</td></tr>		<td>The <var>String</var> value to assign <var class="term">stringTokenizer</var>'s <var>Spaces</var> property. Each character in the string is a space character — that is, you may not separate characters — and no character may repeat (except for apostrophe, which may be doubled).</td></tr>
	</table>		</table>

	==Usage notes==		==Usage notes==
	<ul>		<ul>
	<li>The <var>Spaces</var> characters are initially settable in the [[New (StringTokenizer constructor)\|New]] call that creates the tokenizer instance.		<li>The <var>Spaces</var> characters are initially settable in the <var>[[New (StringTokenizer constructor)\|New]]</var> call that creates the tokenizer instance. The default value for a new tokenizer instance is a blank character.
	<li>No character can be one of the <var>Spaces</var> characters and also		<li>No character can be one of the <var>Spaces</var> characters and also
	one of ~~either~~ the Quotes ~~characters~~ or ~~the TokenChars~~ characters.		one of the <var>[[Quotes (StringTokenizer property)\|Quotes]]</var>, <var>TokenChars</var>, or <var>[[Separators (StringTokenizer property)\|Separators]]</var> characters.
	</ul>		</ul>

	==Examples==		==Examples==

	In the following example, a <var>StringTokenizer</var> object is instantiated		In the following example, a <var>StringTokenizer</var> object is instantiated
	with the default parameter settings for the New constructor.		with the default parameter settings for the <var>New</var> constructor.
	Then the input string's tokens are returned in sequence:		Then the input string's tokens are returned in sequence:
	<p class="code">%tok is object stringtokenizer		<p class="code">%tok is object stringtokenizer

Dme at 12:10, 25 May 2011

2011-05-25T12:10:17Z

New page

{{Template:StringTokenizer:Spaces subtitle}}

This readWrite property returns or sets the characters that are recognized as
"whitespace" characters, that is, as characters that separate tokens.
Such a character is also called a "non-token delimiter,"
because it is a delimiter that is not itself a token.

You can specify "token delimiters," which are delimiters that are also tokens,
using the [[TokenChars (StringTokenizer property)|TokenChars]] property or the [[New (StringTokenizer constructor)|New]] constructor TokenChars parameter.

One or multiple consecutive whitespace characters mark the end or beginning
of a token, except when these spaces are part of a quoted region.
In that case, the spaces become non-delimiters.

==Syntax==
{{Template:StringTokenizer:Spaces syntax}}
===Syntax terms===
<table class="syntaxTable">
<tr><th>%currentString</th>
<td>A string variable to contain the returned value of the current whitespace characters or to be set as the new value(s). The default value for a new tokenizer instance is a blank character.

If you are setting <var>Spaces</var>, each character in the string is a space character — that is, you may not separate characters — and no character may repeat (except for apostrophe, which may be doubled). </td></tr>
<tr><th>stringTokenizer</th>
<td>A <var>StringTokenizer</var> object expression.</td></tr>
<tr><th>newString</th>
<td>The String value to assign <var class="term">stringTokenizer</var>'s <var>Spaces</var> property.</td></tr>
</table>
==Usage notes==
<ul>
<li>The <var>Spaces</var> characters are initially settable in the [[New (StringTokenizer constructor)|New]] call that creates the tokenizer instance.
<li>No character can be one of the <var>Spaces</var> characters and also
one of either the Quotes characters or the TokenChars characters.
</ul>
==Examples==

In the following example, a <var>StringTokenizer</var> object is instantiated
with the default parameter settings for the New constructor.
Then the input string's tokens are returned in sequence:
<p class="code">%tok is object stringtokenizer
%tok = new
%tok:string = 'Bad,F ?3mO ,7,{x Z}'
repeat while not %tok:atEnd
printText {~} is {%tok:nextToken}
end repeat
</p>

The resulting tokens, which were delimited by the default space character (blank), are:
<p class="code">%tok:nextToken is Bad,F
%tok:nextToken is ?3mO
%tok:nextToken is ,7,{x
%tok:nextToken is Z}
</p>

If instead the tokenizer object is instantiated with a comma as the space character
<br>
(<tt>%tok = new(Spaces=',')</tt>), the resulting tokens are:
<p class="code">%tok:nextToken is Bad
%tok:nextToken is F ?3mO
%tok:nextToken is 7
%tok:nextToken is {x Z}
</p>

==See also==
{{Template:StringTokenizer:Spaces footer}}

Wiccan: 1 revision

2011-02-08T18:16:13Z

1 revision

← Older revision	Revision as of 18:16, 8 February 2011
(No difference)

Dme: /* Examples */

2011-02-08T18:16:11Z

Examples

← Older revision		Revision as of 18:16, 8 February 2011
Line 19:		Line 19:
	<tr><th>%string</th>		<tr><th>%string</th>
	<td>A string variable to contain the returned value of the current whitespace characters or to be set as the new value(s). The default value for a new tokenizer instance is a blank character.		<td>A string variable to contain the returned value of the current whitespace characters or to be set as the new value(s). The default value for a new tokenizer instance is a blank character.
	~~<p class="code">~~If you are setting <var>Spaces</var>, each character in the string is a space character — that is, you may not separate characters — and no character may repeat (except for apostrophe, which may be doubled). </td></tr>
	~~</p~~>		If you are setting <var>Spaces</var>, each character in the string is a space character — that is, you may not separate characters — and no character may repeat (except for apostrophe, which may be doubled). </td></tr>
	<tr><th>%tok</th>		<tr><th>%tok</th>
	<td>A <var>StringTokenizer</var> object variable.</td></tr>		<td>A <var>StringTokenizer</var> object variable.</td></tr>

Dme: /* Examples */

2011-02-06T22:26:38Z

Examples

← Older revision		Revision as of 22:26, 6 February 2011
Line 32:		Line 32:
	==Examples==		==Examples==

	In the following example, a <var>~~String~~</var>~~tokenizer~~ object is instantiated		In the following example, a <var>StringTokenizer</var> object is instantiated
	with the default parameter settings for the New constructor.		with the default parameter settings for the New constructor.
	Then the input string's tokens are returned in sequence:		Then the input string's tokens are returned in sequence:
Line 52:		Line 52:
	If instead the tokenizer object is instantiated with a comma as the space character		If instead the tokenizer object is instantiated with a comma as the space character
	<br>		<br>
	(<tt>%tok = new(~~<var>~~Spaces~~</var>~~=',')</tt>), the resulting tokens are:		(<tt>%tok = new(Spaces=',')</tt>), the resulting tokens are:
	<p class="code">%tok:nextToken is Bad		<p class="code">%tok:nextToken is Bad
	%tok:nextToken is F ?3mO		%tok:nextToken is F ?3mO
Line 58:		Line 58:
	%tok:nextToken is {x Z}		%tok:nextToken is {x Z}
	</p>		</p>

	==See also==		==See also==
	{{Template:StringTokenizer:Spaces footer}}		{{Template:StringTokenizer:Spaces footer}}

Wiccan: 1 revision

2011-02-06T21:48:05Z

1 revision

← Older revision	Revision as of 21:48, 6 February 2011
(No difference)

Wiccan: 1 revision

2011-02-06T21:48:03Z

1 revision

← Older revision		Revision as of 21:48, 6 February 2011
Line 19:		Line 19:
	<tr><th>%string</th>		<tr><th>%string</th>
	<td>A string variable to contain the returned value of the current whitespace characters or to be set as the new value(s). The default value for a new tokenizer instance is a blank character.		<td>A string variable to contain the returned value of the current whitespace characters or to be set as the new value(s). The default value for a new tokenizer instance is a blank character.
	If you are setting <var>Spaces</var>, each character in the string is a space character — that is, you may not separate characters — and no character may repeat (except for apostrophe, which may be doubled). </td></tr>		<p class="code">If you are setting <var>Spaces</var>, each character in the string is a space character — that is, you may not separate characters — and no character may repeat (except for apostrophe, which may be doubled). </td></tr>
			</p>
	<tr><th>%tok</th>		<tr><th>%tok</th>
	<td>A <var>StringTokenizer</var> object variable.</td></tr>		<td>A <var>StringTokenizer</var> object variable.</td></tr>
Line 34:		Line 35:
	with the default parameter settings for the New constructor.		with the default parameter settings for the New constructor.
	Then the input string's tokens are returned in sequence:		Then the input string's tokens are returned in sequence:
	<~~pre~~>		<p class="code">%tok is object stringtokenizer
	%tok is object stringtokenizer		%tok = new
	%tok = new		%tok:string = 'Bad,F ?3mO ,7,{x Z}'
	%tok:string = 'Bad,F ?3mO ,7,{x Z}'		repeat while not %tok:atEnd
	repeat while not %tok:atEnd		printText {~} is {%tok:nextToken}
	printText {~} is {%tok:nextToken}		end repeat
	end repeat		</p>
	</~~pre~~>

	The resulting tokens, which were delimited by the default space character (blank), are:		The resulting tokens, which were delimited by the default space character (blank), are:
	<~~pre~~>		<p class="code">%tok:nextToken is Bad,F
	%tok:nextToken is Bad,F		%tok:nextToken is ?3mO
	%tok:nextToken is ?3mO		%tok:nextToken is ,7,{x
	%tok:nextToken is ,7,{x		%tok:nextToken is Z}
	%tok:nextToken is Z}		</p>
	</~~pre~~>

	If instead the tokenizer object is instantiated with a comma as the space character		If instead the tokenizer object is instantiated with a comma as the space character
	<br>		<br>
	(<tt>%tok = new(<var>Spaces</var>=',')</tt>), the resulting tokens are:		(<tt>%tok = new(<var>Spaces</var>=',')</tt>), the resulting tokens are:
	<~~pre~~>		<p class="code">%tok:nextToken is Bad
	%tok:nextToken is Bad		%tok:nextToken is F ?3mO
	%tok:nextToken is F ?3mO		%tok:nextToken is 7
	%tok:nextToken is 7		%tok:nextToken is {x Z}
	%tok:nextToken is {x Z}		</p>
	</~~pre~~>
	==See also==		==See also==
	{{Template:StringTokenizer:Spaces footer}}		{{Template:StringTokenizer:Spaces footer}}

Wiccan: 1 revision

2011-02-06T21:47:22Z

1 revision

← Older revision	Revision as of 21:47, 6 February 2011
(No difference)

Wiccan: 1 revision

2011-02-06T21:47:18Z

1 revision

← Older revision		Revision as of 21:47, 6 February 2011
Line 19:		Line 19:
	<tr><th>%string</th>		<tr><th>%string</th>
	<td>A string variable to contain the returned value of the current whitespace characters or to be set as the new value(s). The default value for a new tokenizer instance is a blank character.		<td>A string variable to contain the returned value of the current whitespace characters or to be set as the new value(s). The default value for a new tokenizer instance is a blank character.
	If you are setting Spaces, each character in the string is a space character — that is, you may not separate characters — and no character may repeat (except for apostrophe, which may be doubled). </td></tr>		If you are setting <var>Spaces</var>, each character in the string is a space character — that is, you may not separate characters — and no character may repeat (except for apostrophe, which may be doubled). </td></tr>
	<tr><th>%tok</th>		<tr><th>%tok</th>
	<td>A StringTokenizer object variable.</td></tr>		<td>A <var>StringTokenizer</var> object variable.</td></tr>
	</table>		</table>
	==Usage notes==		==Usage notes==
	<ul>		<ul>
	<li>The Spaces characters are initially settable in the [[New (StringTokenizer constructor)\|New]] call that creates the tokenizer instance.		<li>The <var>Spaces</var> characters are initially settable in the [[New (StringTokenizer constructor)\|New]] call that creates the tokenizer instance.
	<li>No character can be one of the Spaces characters and also		<li>No character can be one of the <var>Spaces</var> characters and also
	one of either the Quotes characters or the TokenChars characters.		one of either the Quotes characters or the TokenChars characters.
	</ul>		</ul>
	==Examples==		==Examples==

	In the following example, a ~~Stringtokenizer~~ object is instantiated		In the following example, a <var>String</var>tokenizer object is instantiated
	with the default parameter settings for the New constructor.		with the default parameter settings for the New constructor.
	Then the input string's tokens are returned in sequence:		Then the input string's tokens are returned in sequence:
Line 53:		Line 53:
	If instead the tokenizer object is instantiated with a comma as the space character		If instead the tokenizer object is instantiated with a comma as the space character
	<br>		<br>
	(<tt>%tok = new(Spaces=',')</tt>), the resulting tokens are:		(<tt>%tok = new(<var>Spaces</var>=',')</tt>), the resulting tokens are:
	<pre>		<pre>
	%tok:nextToken is Bad		%tok:nextToken is Bad

Wiccan: 1 revision

2011-02-06T19:55:21Z

1 revision

← Older revision	Revision as of 19:55, 6 February 2011
(No difference)