TokensToLower (StringTokenizer property) - Revision history

JAL: /* Returning lowercased tokens */

2012-11-15T20:59:21Z

Returning lowercased tokens

← Older revision		Revision as of 20:59, 15 November 2012
Line 34:		Line 34:
	%tok:string = 'Bad,F ?3mO ,7,{x Z}'		%tok:string = 'Bad,F ?3mO ,7,{x Z}'
	repeat while not %tok:atEnd		repeat while not %tok:atEnd
	printText {~} is {%tok:nextToken}		[[Targeted Text statements#AuditText, PrintText, and TraceText\|printText]] {~} is {%tok:nextToken}
	end repeat		end repeat
	</p>		</p>
Line 52:		Line 52:
	%tok:nextToken is z}		%tok:nextToken is z}
	</p>		</p>

	===Preserving case setting===		===Preserving case setting===
	Since the case which is returned by tokenization is determined by both <var>TokensToUpper</var> and <var>TokensToLower</var>, if you wish to save the previous state and then force lower case tokens, you can use a technique such as the following:		Since the case which is returned by tokenization is determined by both <var>TokensToUpper</var> and <var>TokensToLower</var>, if you wish to save the previous state and then force lower case tokens, you can use a technique such as the following:

Dme: /* Syntax terms */

2012-11-09T17:22:14Z

Syntax terms

← Older revision		Revision as of 17:22, 9 November 2012
Line 17:		Line 17:

	<tr><th>newBoolean</th>		<tr><th>newBoolean</th>
	<td>The <var>Boolean</var> value to assign to <var class="term">stringTokenizer</var>'s <var>TokensToLower</var> property.</td></tr>		<td>The <var>Boolean</var> value to assign to <var class="term">stringTokenizer</var>'s <var>TokensToLower</var> property. Note that if the <var>TokensToUpper</var> property is <code>true</code>, the <var>TokensToLower</var> property is ignored, so if you want to force tokens to be returned in lower case, the <var>TokensToUpper</var> property must be <code>false</code> (which is its default value). If you need to save the tokenization case setting and then force lower case returned tokens, you can use a technique such as described in [[#Preserving case setting\|"Preserving case setting"]]. </td></tr>
	</table>		</table>

Dme: /* Preserving case setting */

2012-11-09T17:19:08Z

Preserving case setting

← Older revision		Revision as of 17:19, 9 November 2012
Line 58:		Line 58:
	%tok:tokensToUpper = false		%tok:tokensToUpper = false
	%tok:tokensToLower = true		%tok:tokensToLower = true
			...
	... use tokenizer, lower case tokens returned		... use tokenizer, lower case tokens returned
			...
	%tok:tokensToUpper = %oldUp		%tok:tokensToUpper = %oldUp
	%tok:tokensToLower = %oldLow		%tok:tokensToLower = %oldLow

Dme: /* Examples */

2012-11-09T17:18:40Z

Examples

← Older revision		Revision as of 17:18, 9 November 2012
Line 27:		Line 27:

	==Examples==		==Examples==
			===Returning lowercased tokens===
	In the following example, the input string's tokens are returned in sequence		In the following example, the input string's tokens are returned in sequence
	under the default (<var>False</var>) setting of <var>TokensToLower</var>:		under the default (<var>False</var>) setting of <var>TokensToLower</var>:
Line 50:		Line 51:
	%tok:nextToken is ,7,{x		%tok:nextToken is ,7,{x
	%tok:nextToken is z}		%tok:nextToken is z}
			</p>
			===Preserving case setting===
			Since the case which is returned by tokenization is determined by both <var>TokensToUpper</var> and <var>TokensToLower</var>, if you wish to save the previous state and then force lower case tokens, you can use a technique such as the following:
			<p class="code">%oldUp = %tok:tokensToUpper
			%oldLow = %tok:tokensToLower
			%tok:tokensToUpper = false
			%tok:tokensToLower = true
			... use tokenizer, lower case tokens returned
			%tok:tokensToUpper = %oldUp
			%tok:tokensToLower = %oldLow
	</p>		</p>

	==See also==		==See also==
	{{Template:StringTokenizer:TokensToLower footer}}		{{Template:StringTokenizer:TokensToLower footer}}

Dme: /* Usage notes */

2012-11-09T17:14:20Z

Usage notes

← Older revision		Revision as of 17:14, 9 November 2012
Line 23:		Line 23:
	<ul>		<ul>
	<li><var>TokensToLower</var> has no effect on non-alphabetic characters.		<li><var>TokensToLower</var> has no effect on non-alphabetic characters.
	<li>The <var>[[TokensToUpper (StringTokenizer property)\|TokensToUpper]]</var> property specifies or reports whether returned tokens are to be converted to uppercase characters. Note that if <var>TokensToUpper</var> is <code>true</~~var~~>, then <var>TokensToLower</var> is ignored.		<li>The <var>[[TokensToUpper (StringTokenizer property)\|TokensToUpper]]</var> property specifies or reports whether returned tokens are to be converted to uppercase characters. Note that if <var>TokensToUpper</var> is <code>true</code>, then <var>TokensToLower</var> is ignored.
	</ul>		</ul>

Dme: /* Usage notes */

2012-11-09T17:14:01Z

Usage notes

← Older revision		Revision as of 17:14, 9 November 2012
Line 23:		Line 23:
	<ul>		<ul>
	<li><var>TokensToLower</var> has no effect on non-alphabetic characters.		<li><var>TokensToLower</var> has no effect on non-alphabetic characters.
	<li>The <var>[[TokensToUpper (StringTokenizer property)\|TokensToUpper]]</var> property specifies or reports whether		<li>The <var>[[TokensToUpper (StringTokenizer property)\|TokensToUpper]]</var> property specifies or reports whether returned tokens are to be converted to uppercase characters. Note that if <var>TokensToUpper</var> is <code>true</var>, then <var>TokensToLower</var> is ignored.
	returned tokens are to be converted to uppercase characters.
	</ul>		</ul>

JAL2: /* Examples */

2012-07-06T01:39:05Z

Examples

← Older revision		Revision as of 01:39, 6 July 2012
Line 29:		Line 29:
	==Examples==		==Examples==
	In the following example, the input string's tokens are returned in sequence		In the following example, the input string's tokens are returned in sequence
	under the default (<~~code~~>False</~~code~~>) setting of <var>TokensToLower</var>:		under the default (<var>False</var>) setting of <var>TokensToLower</var>:
	<p class="code">%tok is object stringtokenizer		<p class="code">%tok is object stringtokenizer
	%tok = new		%tok = new

JAL2 at 01:35, 6 July 2012

2012-07-06T01:35:27Z

← Older revision		Revision as of 01:35, 6 July 2012
Line 1:		Line 1:
	{{Template:StringTokenizer:TokensToLower subtitle}}		{{Template:StringTokenizer:TokensToLower subtitle}}

	This readWrite property returns or sets the Boolean value that indicates		This readWrite property returns or sets the <var>[[Boolean enumeration\|Boolean]]</var> value that indicates
	whether to convert returned, non-quoted, tokens to all-lowercase characters.		whether to convert returned, non-quoted, tokens to all-lowercase characters.
	The default value for a new tokenizer is <var>False</var>.		The default value for a new tokenizer is <var>False</var>.
Line 7:		Line 7:
	==Syntax==		==Syntax==
	{{Template:StringTokenizer:TokensToLower syntax}}		{{Template:StringTokenizer:TokensToLower syntax}}

	===Syntax terms===		===Syntax terms===
	<table class="syntaxTable">		<table class="syntaxTable">
	<tr><th>%currentBoolean</th>		<tr><th>%currentBoolean</th>
	<td>A <var>Boolean</var> enumeration object to contain the returned value of <var>TokensToLower</var>. ~~For more information about Boolean enumerations, see [[Enumerations#Using_Boolean_enumerations\|"Using Boolean Enumerations"]].~~ </td></tr>		<td>A <var>Boolean</var> enumeration object to contain the returned value of <var>TokensToLower</var>. </td></tr>

	<tr><th>stringTokenizer</th>		<tr><th>stringTokenizer</th>
	<td>A <var>StringTokenizer</var> object ~~expression~~.</td></tr>		<td>A <var>StringTokenizer</var> object.</td></tr>

	<tr><th>newBoolean</th>		<tr><th>newBoolean</th>
	<td>The <var>Boolean</var> value to assign to <var class="term">stringTokenizer</var>'s <var>~~Editing~~ TokensToLower</var> property.</td></tr>		<td>The <var>Boolean</var> value to assign to <var class="term">stringTokenizer</var>'s <var>TokensToLower</var> property.</td></tr>
	</table>		</table>

Line 20:		Line 23:
	<ul>		<ul>
	<li><var>TokensToLower</var> has no effect on non-alphabetic characters.		<li><var>TokensToLower</var> has no effect on non-alphabetic characters.
	<li>The [[TokensToUpper (StringTokenizer property)\|TokensToUpper]] property specifies or reports whether		<li>The <var>[[TokensToUpper (StringTokenizer property)\|TokensToUpper]]</var> property specifies or reports whether
	returned tokens are to be converted to uppercase characters.		returned tokens are to be converted to uppercase characters.
	</ul>		</ul>

	==Examples==		==Examples==
			In the following example, the input string's tokens are returned in sequence
	In the following example,
	the input string's tokens are returned in sequence
	under the default (<code>False</code>) setting of <var>TokensToLower</var>:		under the default (<code>False</code>) setting of <var>TokensToLower</var>:
	<p class="code">%tok is object stringtokenizer		<p class="code">%tok is object stringtokenizer
Line 43:		Line 45:
	</p>		</p>

	If <tt>%tok:TokensToLower = True</tt> is specified for the instantiated object,		If <code>%tok:TokensToLower = True</code> is specified for the instantiated object,
	the resulting tokens are:		the resulting tokens are:
	<p class="code">%tok:nextToken is bad,f		<p class="code">%tok:nextToken is bad,f

JAL2 at 21:05, 5 July 2012

2012-07-05T21:05:43Z

← Older revision		Revision as of 21:05, 5 July 2012
Line 3:		Line 3:
	This readWrite property returns or sets the Boolean value that indicates		This readWrite property returns or sets the Boolean value that indicates
	whether to convert returned, non-quoted, tokens to all-lowercase characters.		whether to convert returned, non-quoted, tokens to all-lowercase characters.
	The default value for a new tokenizer is <~~code~~>False</~~code~~>.		The default value for a new tokenizer is <var>False</var>.

	==Syntax==		==Syntax==

JALWiccan: 1 revision

2012-07-05T21:02:58Z

1 revision

← Older revision	Revision as of 21:02, 5 July 2012
(No difference)