StringTokenizer (String function) - Revision history

ELowell at 21:56, 3 September 2015

2015-09-03T21:56:57Z

← Older revision		Revision as of 21:56, 3 September 2015
Line 1:		Line 1:
	{{Template:String:StringTokenizer subtitle}}		{{Template:String:StringTokenizer subtitle}}

	This method returns a new instance of a <var>[[StringTokenizer class\|StringTokenizer]] </var> object using the method string as the tokenizer string.		This method returns a new instance of a <var>[[StringTokenizer class\|StringTokenizer]] </var> object using the method string as the tokenizer string.
	It has three optional arguments that let you specify the delimiter characters		It has three optional arguments that let you specify the delimiter characters
Line 10:		Line 9:
	===Syntax terms===		===Syntax terms===
	<table class="syntaxTable">		<table class="syntaxTable">
	<tr><th>%stringTokenizer</th>		<tr><th nowrap>%stringTokenizer</th>
	<td>A <var>StringTokenizer</var> object expression to contain the new object instance. </td></tr>		<td>A <var>StringTokenizer</var> object expression to contain the new object instance. </td></tr>

Line 71:		Line 70:
	%tok:nextToken is 'foo'		%tok:nextToken is 'foo'
	%tok:nextToken is 'bar'		%tok:nextToken is 'bar'

	</p>		</p>
	==See also==		==See also==

JAL: /* Usage notes */

2013-01-31T21:50:19Z

Usage notes

← Older revision		Revision as of 21:50, 31 January 2013
Line 42:		Line 42:
	<ul>		<ul>
	<li>Do not confuse the <var>StringTokenizer</var> <b>function</b>, which creates a new object, with the <var>[[String (StringTokenizer property)\|String]]</var> property of the <var>StringTokenizer</var> <b>class</b>, which only replaces the string to be tokenized (and resets the object to start tokenizing at the beginning), preserving various tokenizing properties such as <var>[[Separators (StringTokenizer property)\|Separators]]</var> and <var>[[Quotes (StringTokenizer property)\|Quotes]]</var>.		<li>Do not confuse the <var>StringTokenizer</var> <b>function</b>, which creates a new object, with the <var>[[String (StringTokenizer property)\|String]]</var> property of the <var>StringTokenizer</var> <b>class</b>, which only replaces the string to be tokenized (and resets the object to start tokenizing at the beginning), preserving various tokenizing properties such as <var>[[Separators (StringTokenizer property)\|Separators]]</var> and <var>[[Quotes (StringTokenizer property)\|Quotes]]</var>.
	<li>A character may belong to at most one of the Spaces,
	Quotes, or TokenChars sets of characters.		<li>A character may belong to at most one of the <var>Spaces</var>, <var>Quotes</var>, or <var>TokenChars</var> sets of characters.

	<li>If you are specifying <var>Quotes</var>, <var>Spaces</var>, <var>Separators</var>, or <var>TokenChars</var> characters,		<li>If you are specifying <var>Quotes</var>, <var>Spaces</var>, <var>Separators</var>, or <var>TokenChars</var> characters,
	each character in the string is a member of the defined set — that is, you may not separate characters — and no character		each character in the string is a member of the defined set — that is, you may not separate characters — and no character may repeat (except for apostrophe, which may be doubled).
	may repeat (except for apostrophe, which may be doubled).

	<li>A quoted region is not affected by the <var>[[TokensToLower (StringTokenizer property)\|TokensToLower]]</var>		<li>A quoted region is not affected by the <var>[[TokensToLower (StringTokenizer property)\|TokensToLower]]</var>

Dme: /* Usage notes */

2013-01-03T18:51:37Z

Usage notes

← Older revision		Revision as of 18:51, 3 January 2013
Line 41:		Line 41:
	==Usage notes==		==Usage notes==
	<ul>		<ul>
			<li>Do not confuse the <var>StringTokenizer</var> <b>function</b>, which creates a new object, with the <var>[[String (StringTokenizer property)\|String]]</var> property of the <var>StringTokenizer</var> <b>class</b>, which only replaces the string to be tokenized (and resets the object to start tokenizing at the beginning), preserving various tokenizing properties such as <var>[[Separators (StringTokenizer property)\|Separators]]</var> and <var>[[Quotes (StringTokenizer property)\|Quotes]]</var>.
	<li>A character may belong to at most one of the Spaces,		<li>A character may belong to at most one of the Spaces,
	Quotes, or TokenChars sets of characters.		Quotes, or TokenChars sets of characters.

JAL at 22:19, 5 November 2012

2012-11-05T22:19:37Z

← Older revision		Revision as of 22:19, 5 November 2012
Line 17:		Line 17:

	<tr><th><var>TokenChars</var></th>		<tr><th><var>TokenChars</var></th>
	<td>This name required string argument ~~<var>TokenChars</var>~~ is a set of single-character token-delimiters (delimiters that are also tokens) that may be separated by whitespace characters.		<td>This [[Notation conventions for methods#Named parameters\|name required]] string argument is a set of single-character token-delimiters (delimiters that are also tokens) that may be separated by whitespace characters.
	<var>TokenChars</var> is an optional argument that defaults to a null string. </td></tr>		<p>
			<var>TokenChars</var> is an optional argument that defaults to a null string. </p></td></tr>

	<tr><th><var>Spaces</var></th>		<tr><th><var>Spaces</var></th>
	<td>This name required string argument ~~<var>Spaces</var>~~ is a set of "whitespace" characters, that is, characters that separate tokens. Each of these characters is a "non-token delimiter," a delimiter that is not itself a token.		<td>This name required string argument is a set of "whitespace" characters, that is, characters that separate tokens. Each of these characters is a "non-token delimiter," a delimiter that is not itself a token.
			<p>
			<var>Spaces</var> is an optional argument that defaults to a blank character. </p></td></tr>

	~~<var>Spaces</var> is an optional argument that defaults to a blank character. </td></tr>~~
	<tr><th><var>Quotes</var></th>		<tr><th><var>Quotes</var></th>
	<td>This name required string argument ~~<var>Quotes</var>~~ is a set of quotation characters. The text between each disjoint pair of identical quotation characters (a "quoted region") is treated as a single token, and any delimiter characters (~~Quote~~, ~~Space~~, or ~~TokenChar~~) within a quoted region are treated as non-delimiters.		<td>This name required string argument is a set of quotation characters. The text between each disjoint pair of identical quotation characters (a "quoted region") is treated as a single token, and any delimiter characters (<var>Quotes</var>, <var>Spaces</var>, <var>Separators</var>, or <var>TokenChars</var>) within a quoted region are treated as non-delimiters.
			<p>
	<var>Quotes</var> is an optional argument that defaults to a null string.</td></tr>		<var>Quotes</var> is an optional argument that defaults to a null string.</p></td></tr>

			<tr><th><var>Separators</var></th>
			<td>This name required string argument is a set of single characters that separate tokens. Each of these characters is a "non-token delimiter," a delimiter that is not itself a token.
			<p>
			Multiple <var>Separators</var> characters do not compress to a single separator (like <var>Spaces</var> characters). </p>
			<p>
			<var>Separators</var> is an optional argument that defaults to a null string. It is available as of <var class="product">Sirius Mods</var> version 7.8. </p></td></tr>
	</table>		</table>

Line 34:		Line 43:
	<li>A character may belong to at most one of the Spaces,		<li>A character may belong to at most one of the Spaces,
	Quotes, or TokenChars sets of characters.		Quotes, or TokenChars sets of characters.
	<li>If you are specifying Spaces, ~~Quotes~~, or TokenChars,
	each character in the string is a ~~quotation~~		<li>If you are specifying <var>Quotes</var>, <var>Spaces</var>, <var>Separators</var>, or <var>TokenChars</var> characters,
	~~character~~ &~~ndash~~; that is, you may not separate characters &~~ndash~~; and no character		each character in the string is a member of the defined set — that is, you may not separate characters — and no character
	may repeat (except for apostrophe, which may be doubled).		may repeat (except for apostrophe, which may be doubled).
	<li>A quoted region is not affected by the [[TokensToLower (StringTokenizer property)\|TokensToLower]]
	and [[TokensToUpper (StringTokenizer property)\|TokensToUpper]] properties.		<li>A quoted region is not affected by the <var>[[TokensToLower (StringTokenizer property)\|TokensToLower]]</var>
			and <var>[[TokensToUpper (StringTokenizer property)\|TokensToUpper]]</var> properties.
	</ul>		</ul>

Line 64:		Line 74:
	</p>		</p>
	==See also==		==See also==
	[[~~New_~~(StringTokenizer_constructor)]]		<ul>
			<li><var>StringTokenizer</var> <var>[[New (StringTokenizer_constructor)\|New]]</var> constructor
			</ul>

	{{Template:String:StringTokenizer footer}}		{{Template:String:StringTokenizer footer}}

JAL2 at 00:33, 29 June 2012

2012-06-29T00:33:58Z

← Older revision		Revision as of 00:33, 29 June 2012
Line 4:		Line 4:
	It has three optional arguments that let you specify the delimiter characters		It has three optional arguments that let you specify the delimiter characters
	that determine the tokens in the string that is being tokenized.		that determine the tokens in the string that is being tokenized.

	==Syntax==		==Syntax==
	{{Template:String:StringTokenizer syntax}}		{{Template:String:StringTokenizer syntax}}

	===Syntax terms===		===Syntax terms===
	<table class="syntaxTable">		<table class="syntaxTable">

Dme: /* Usage notes */

2011-07-19T16:30:27Z

Usage notes

← Older revision		Revision as of 16:30, 19 July 2011
Line 34:		Line 34:
	<li>If you are specifying Spaces, Quotes, or TokenChars,		<li>If you are specifying Spaces, Quotes, or TokenChars,
	each character in the string is a quotation		each character in the string is a quotation
	character &~~amp;mdash~~; that is, you may not separate characters &~~amp;mdash~~; and no character		character – that is, you may not separate characters – and no character
	may repeat (except for apostrophe, which may be doubled).		may repeat (except for apostrophe, which may be doubled).
	<li>A quoted region is not affected by the [[TokensToLower (StringTokenizer property)\|TokensToLower]]		<li>A quoted region is not affected by the [[TokensToLower (StringTokenizer property)\|TokensToLower]]
	and [[TokensToUpper (StringTokenizer property)\|TokensToUpper]] properties.		and [[TokensToUpper (StringTokenizer property)\|TokensToUpper]] properties.
	</ul>		</ul>

	==Examples==		==Examples==

Dme at 13:40, 22 April 2011

2011-04-22T13:40:49Z

← Older revision		Revision as of 13:40, 22 April 2011
Line 1:		Line 1:
	{{Template:String:StringTokenizer subtitle}}		{{Template:String:StringTokenizer subtitle}}

	This method returns a new instance of a <var>StringTokenizer</var> object using the method string as the tokenizer string.		This method returns a new instance of a <var>[[StringTokenizer class\|StringTokenizer]] </var> object using the method string as the tokenizer string.
	It has three optional arguments that let you specify the delimiter characters		It has three optional arguments that let you specify the delimiter characters
	that determine the tokens in the string that is being tokenized.		that determine the tokens in the string that is being tokenized.

JALWiccan: 1 revision

2011-04-13T00:21:20Z

1 revision

← Older revision	Revision as of 00:21, 13 April 2011
(No difference)

John at 00:21, 13 April 2011

2011-04-13T00:21:16Z

← Older revision		Revision as of 00:21, 13 April 2011
Line 14:		Line 14:
	<td>The string to be tokenized.</td></tr>		<td>The string to be tokenized.</td></tr>

	<tr><th>TokenChars</th>		<tr><th><var>TokenChars</var></th>
	<td>This name required string argument <var>TokenChars</var> is a set of single-character token-delimiters (delimiters that are also tokens) that may be separated by whitespace characters.		<td>This name required string argument <var>TokenChars</var> is a set of single-character token-delimiters (delimiters that are also tokens) that may be separated by whitespace characters.
	<var>TokenChars</var> is an optional argument that defaults to a null string. </td></tr>		<var>TokenChars</var> is an optional argument that defaults to a null string. </td></tr>
	<tr><th>Spaces</th>		<tr><th><var>Spaces</var></th>
	<td>This name required string argument <var>Spaces</var> is a set of "whitespace" characters, that is, characters that separate tokens. Each of these characters is a "non-token delimiter," a delimiter that is not itself a token.		<td>This name required string argument <var>Spaces</var> is a set of "whitespace" characters, that is, characters that separate tokens. Each of these characters is a "non-token delimiter," a delimiter that is not itself a token.

	<var>Spaces</var> is an optional argument that defaults to a blank character. </td></tr>		<var>Spaces</var> is an optional argument that defaults to a blank character. </td></tr>
	<tr><th>Quotes</th>		<tr><th><var>Quotes</var></th>
	<td>This name required string argument <var>Quotes</var> is a set of quotation characters. The text between each disjoint pair of identical quotation characters (a "quoted region") is treated as a single token, and any delimiter characters (Quote, Space, or TokenChar) within a quoted region are treated as non-delimiters.		<td>This name required string argument <var>Quotes</var> is a set of quotation characters. The text between each disjoint pair of identical quotation characters (a "quoted region") is treated as a single token, and any delimiter characters (Quote, Space, or TokenChar) within a quoted region are treated as non-delimiters.

Line 34:		Line 34:
	<li>If you are specifying Spaces, Quotes, or TokenChars,		<li>If you are specifying Spaces, Quotes, or TokenChars,
	each character in the string is a quotation		each character in the string is a quotation
	character — that is, you may not separate characters — and no character		character &mdash; that is, you may not separate characters &mdash; and no character
	may repeat (except for apostrophe, which may be doubled).		may repeat (except for apostrophe, which may be doubled).
	<li>A quoted region is not affected by the [[TokensToLower (StringTokenizer property)\|TokensToLower]]		<li>A quoted region is not affected by the [[TokensToLower (StringTokenizer property)\|TokensToLower]]

John at 14:13, 29 March 2011

2011-03-29T14:13:39Z

← Older revision		Revision as of 14:13, 29 March 2011
Line 61:		Line 61:
	</p>		</p>
	==See also==		==See also==
			[[New_(StringTokenizer_constructor)]]
	{{Template:String:StringTokenizer footer}}		{{Template:String:StringTokenizer footer}}