One-Step File Load utility - Revision history

JAL: more conversion cleanup

2015-01-12T22:48:03Z

more conversion cleanup

ELowell at 21:50, 22 January 2014

2014-01-22T21:50:06Z

← Older revision		Revision as of 21:50, 22 January 2014
Line 188:		Line 188:
	<p> </p>		<p> </p>

	[[Category:File ~~management~~]]		[[Category:File loading and reorganization]]

ELowell at 23:09, 13 December 2013

2013-12-13T23:09:05Z

← Older revision		Revision as of 23:09, 13 December 2013
Line 42:		Line 42:
	====Setting SPCORE or MAXBUF====		====Setting SPCORE or MAXBUF====
	<p>Set either the MAXBUF or the SPCORE parameter on User 0's parameter line to reserve the additional memory specified for the sorts. Otherwise, <var class="product">Model 204</var> uses the additional memory for disk buffers. If sufficient memory is not provided for the sorts to run, the step terminates with an error.</p>		<p>Set either the MAXBUF or the SPCORE parameter on User 0's parameter line to reserve the additional memory specified for the sorts. Otherwise, <var class="product">Model 204</var> uses the additional memory for disk buffers. If sufficient memory is not provided for the sorts to run, the step terminates with an error.</p>
	<p>For more information about the sort space, refer to the discussion of the s1 and s2 parameters in [[File Load ~~Utility~~: FLOD and FILELOAD commands#FILELOAD command\|FILELOAD command]].</p>		<p>For more information about the sort space, refer to the discussion of the s1 and s2 parameters in [[File Load utility: FLOD and FILELOAD commands#FILELOAD command\|FILELOAD command]].</p>

	===Sort program library===		===Sort program library===
Line 116:		Line 116:
	<li>Two work areas, one for each invocation of the sort utility </li>		<li>Two work areas, one for each invocation of the sort utility </li>
	</ul>		</ul>
	<p>If no deferred FRV records are generated by the file load program, only one copy of the sort is invoked. In this case, SPCORE can be reduced by the size occupied by one copy of the sort plus the size of the default work space for the sort. This work space is the value specified for the s2 argument in the FILELOAD command. For more information on the s2 parameter, refer to [[File Load ~~Utility~~: FLOD and FILELOAD commands#FILELOAD command\|FILELOAD command]]. </p>		<p>If no deferred FRV records are generated by the file load program, only one copy of the sort is invoked. In this case, SPCORE can be reduced by the size occupied by one copy of the sort plus the size of the default work space for the sort. This work space is the value specified for the s2 argument in the FILELOAD command. For more information on the s2 parameter, refer to [[File Load utility: FLOD and FILELOAD commands#FILELOAD command\|FILELOAD command]]. </p>
	<p>In general, the best performance is obtained when the amount of memory that the first sort is allowed to use is expanded. However, if any FRV fields are loaded, memory must be left for the second sort. This sort is run concurrently with the first sort, so there must be sufficient memory for both sorts to be active simultaneously.</p>		<p>In general, the best performance is obtained when the amount of memory that the first sort is allowed to use is expanded. However, if any FRV fields are loaded, memory must be left for the second sort. This sort is run concurrently with the first sort, so there must be sufficient memory for both sorts to be active simultaneously.</p>

ELowell at 21:01, 12 December 2013

2013-12-12T21:01:41Z

← Older revision		Revision as of 21:01, 12 December 2013
Line 48:		Line 48:

	====Valid sort programs with the File Load utility====		====Valid sort programs with the File Load utility====
	<p>Any sort program that is compatible with the IBM SORT SM-023 can be invoked by the File Load utility. (For more information about interfaces for sort utilities, see [[Hash ~~Key Files~~]].) The sort program invoked is the program that has the entry point, SORT, contained in one of the following libraries:</p>		<p>Any sort program that is compatible with the IBM SORT SM-023 can be invoked by the File Load utility. (For more information about interfaces for sort utilities, see [[Hash key files]].) The sort program invoked is the program that has the entry point, SORT, contained in one of the following libraries:</p>
	<table>		<table>
	<tr>		<tr>

Admin: Admin moved page One-Step File Load Utility to One-Step File Load utility

2013-12-12T00:01:22Z

Admin moved page One-Step File Load Utility to One-Step File Load utility

← Older revision	Revision as of 00:01, 12 December 2013
(No difference)

Admin at 23:42, 11 December 2013

2013-12-11T23:42:34Z

Dme at 14:16, 10 June 2013

2013-06-10T14:16:21Z

← Older revision		Revision as of 14:16, 10 June 2013
Line 42:		Line 42:
	<p>Depending upon the installation, you might need to include a SORTLIB DD statement to identify the library in which the sort program is stored. You might also need to specify sort work (SORTWK<var class="term">xx</var>) data sets. </p>		<p>Depending upon the installation, you might need to include a SORTLIB DD statement to identify the library in which the sort program is stored. You might also need to specify sort work (SORTWK<var class="term">xx</var>) data sets. </p>
	====Valid sort programs with the File Load utility====		====Valid sort programs with the File Load utility====
	<p>Any sort program that is compatible with the IBM SORT SM-023 can be invoked by the File Load utility. (For more information about interfaces for sort utilities, see [[ ~~Hash Key Files#Hash Key Files\|~~Hash Key Files]].) The sort program invoked is the program that has the entry point, SORT, contained in one of the following libraries:</p>		<p>Any sort program that is compatible with the IBM SORT SM-023 can be invoked by the File Load utility. (For more information about interfaces for sort utilities, see [[Hash Key Files]].) The sort program invoked is the program that has the entry point, SORT, contained in one of the following libraries:</p>
	<table>		<table>
	<tr>		<tr>

ELowell: /* z/VM EXECs */

2013-06-06T22:39:25Z

z/VM EXECs

← Older revision		Revision as of 22:39, 6 June 2013
Line 174:		Line 174:
	<p>The CCAIN file is the same as in the preceding z/OS example. </p>		<p>The CCAIN file is the same as in the preceding z/OS example. </p>
	<p> </p>		<p> </p>
	~~[[Category:File manager]]~~
	[[Category:File management]]		[[Category:File management]]

DmeWiccan: Automatically generated page update

2013-04-18T14:12:34Z

Automatically generated page update

← Older revision		Revision as of 14:12, 18 April 2013
Line 175:		Line 175:
	<p> </p>		<p> </p>
	[[Category:File manager]]		[[Category:File manager]]
	[[Category:File ~~Management~~]]		[[Category:File management]]

Rob at 23:24, 16 April 2013

2013-04-16T23:24:33Z

← Older revision		Revision as of 23:24, 16 April 2013
Line 175:		Line 175:
	<p> </p>		<p> </p>
	[[Category:File manager]]		[[Category:File manager]]
			[[Category:File Management]]

← Older revision		Revision as of 23:42, 11 December 2013
Line 18:		Line 18:
	<p>Note</p>		<p>Note</p>
	<p>The one-step File Load utility is not available under z/VSE.</p>		<p>The one-step File Load utility is not available under z/VSE.</p>

	===DD statements===		===DD statements===
	<p>The following DD statements have the meanings described earlier for the multistep procedure:</p>		<p>The following DD statements have the meanings described earlier for the multistep procedure:</p>
Line 33:		Line 34:
	</p>		</p>
	<p>The following sections summarize the <var class="term">differences</var> between one-step and multistep control statements.</p>		<p>The following sections summarize the <var class="term">differences</var> between one-step and multistep control statements.</p>

	===Providing space for sorting===		===Providing space for sorting===

	====Setting the REGION parameter of the EXEC statement====		====Setting the REGION parameter of the EXEC statement====
	<p>When running the one-step version of the File Load utility, the REGION parameter of the EXEC statement must be increased by at least 100K for each sort/Z sequence that is needed (see the description of CCA1WK<var class="term">xx</var> DD statements on [[#CCA1WKxx DD statement\|CCA1WKxx DD statement]]). To provide improved performance, increase the region more than the minimum and also increase the memory used by each sort (especially the first). </p>		<p>When running the one-step version of the File Load utility, the REGION parameter of the EXEC statement must be increased by at least 100K for each sort/Z sequence that is needed (see the description of CCA1WK<var class="term">xx</var> DD statements on [[#CCA1WKxx DD statement\|CCA1WKxx DD statement]]). To provide improved performance, increase the region more than the minimum and also increase the memory used by each sort (especially the first). </p>

	====Setting SPCORE or MAXBUF====		====Setting SPCORE or MAXBUF====
	<p>Set either the MAXBUF or the SPCORE parameter on User 0's parameter line to reserve the additional memory specified for the sorts. Otherwise, <var class="product">Model 204</var> uses the additional memory for disk buffers. If sufficient memory is not provided for the sorts to run, the step terminates with an error.</p>		<p>Set either the MAXBUF or the SPCORE parameter on User 0's parameter line to reserve the additional memory specified for the sorts. Otherwise, <var class="product">Model 204</var> uses the additional memory for disk buffers. If sufficient memory is not provided for the sorts to run, the step terminates with an error.</p>
	<p>For more information about the sort space, refer to the discussion of the s1 and s2 parameters in [[File Load Utility: FLOD and FILELOAD commands#FILELOAD command\|FILELOAD command]].</p>		<p>For more information about the sort space, refer to the discussion of the s1 and s2 parameters in [[File Load Utility: FLOD and FILELOAD commands#FILELOAD command\|FILELOAD command]].</p>

	===Sort program library===		===Sort program library===
	<p>Depending upon the installation, you might need to include a SORTLIB DD statement to identify the library in which the sort program is stored. You might also need to specify sort work (SORTWK<var class="term">xx</var>) data sets. </p>		<p>Depending upon the installation, you might need to include a SORTLIB DD statement to identify the library in which the sort program is stored. You might also need to specify sort work (SORTWK<var class="term">xx</var>) data sets. </p>

	====Valid sort programs with the File Load utility====		====Valid sort programs with the File Load utility====
	<p>Any sort program that is compatible with the IBM SORT SM-023 can be invoked by the File Load utility. (For more information about interfaces for sort utilities, see [[Hash Key Files]].) The sort program invoked is the program that has the entry point, SORT, contained in one of the following libraries:</p>		<p>Any sort program that is compatible with the IBM SORT SM-023 can be invoked by the File Load utility. (For more information about interfaces for sort utilities, see [[Hash Key Files]].) The sort program invoked is the program that has the entry point, SORT, contained in one of the following libraries:</p>
Line 58:		Line 64:
	</table>		</table>
	<p> </p>		<p> </p>

	==One-Step File Load, Phase 1: Defining CCA1WK and CCA2WK data sets (z/OS only)==		==One-Step File Load, Phase 1: Defining CCA1WK and CCA2WK data sets (z/OS only)==
	<p>When running the one-step version of the File Load utility under z/OS, deferred update index records are passed directly to the sort program as they are produced by the file load program. When the file load program is complete, the sort utility orders the deferred index records. </p>		<p>When running the one-step version of the File Load utility under z/OS, deferred update index records are passed directly to the sort program as they are produced by the file load program. When the file load program is complete, the sort utility orders the deferred index records. </p>

	===Sorting process===		===Sorting process===
	<p>The sort works as follows: </p>		<p>The sort works as follows: </p>
Line 81:		Line 89:
	<p>You need to define at least three CCA1WK<var class="term">xx</var> DD statements (CCA1WK01-CCA1WK03). The actual number of CCA1WK<var class="term">xx</var> statements you need depends on your sort package. The parameters on these statements are required by the particular sort utility being used to define work data sets.</p>		<p>You need to define at least three CCA1WK<var class="term">xx</var> DD statements (CCA1WK01-CCA1WK03). The actual number of CCA1WK<var class="term">xx</var> statements you need depends on your sort package. The parameters on these statements are required by the particular sort utility being used to define work data sets.</p>
	<p>The CCA1WK<var class="term">xx</var> DD statements provide temporary storage for the first sort while it is reordering the deferred index records. These DD statements are required. If they are not included, the execution phase of the file load program is aborted, and an error message issued. </p>		<p>The CCA1WK<var class="term">xx</var> DD statements provide temporary storage for the first sort while it is reordering the deferred index records. These DD statements are required. If they are not included, the execution phase of the file load program is aborted, and an error message issued. </p>

	===CCA2WKxx DD statement===		===CCA2WKxx DD statement===
	<p>CCCA2WK<var class="term">xx </var>DD statements are required only if you are generating FRV records with the File Load statements. If you are not generating FRV records, then the second sort is not invoked and you can omit both the SYSOUT2 and CCA2WK<var class="term">xx</var> DD statements.</p>		<p>CCCA2WK<var class="term">xx </var>DD statements are required only if you are generating FRV records with the File Load statements. If you are not generating FRV records, then the second sort is not invoked and you can omit both the SYSOUT2 and CCA2WK<var class="term">xx</var> DD statements.</p>
Line 88:		Line 97:
	</p>		</p>
	<p>Under z/VM, there are no CCA1WK or CCA2WK statements. Sort space is allocated dynamically by the sort subtasks. </p>		<p>Under z/VM, there are no CCA1WK or CCA2WK statements. Sort space is allocated dynamically by the sort subtasks. </p>

	===SYSOUT1 and SYSOUT2 DD statement===		===SYSOUT1 and SYSOUT2 DD statement===
	<p>The SYSOUT DD statements specify the data sets to which messages from the sort program are directed. Because two sorts can be invoked, include two SYSOUT DD statements, one for the messages from each sort. SYSOUT1 corresponds to the CCA1WK<var class="term">xx</var> DD statements, and SYSOUT2 corresponds to the CCA2WK<var class="term">xx</var> DD statements.</p>		<p>The SYSOUT DD statements specify the data sets to which messages from the sort program are directed. Because two sorts can be invoked, include two SYSOUT DD statements, one for the messages from each sort. SYSOUT1 corresponds to the CCA1WK<var class="term">xx</var> DD statements, and SYSOUT2 corresponds to the CCA2WK<var class="term">xx</var> DD statements.</p>
	==One-Step File Load, Phase 1: Setting SPCORE and MAXBUF parameters==		==One-Step File Load, Phase 1: Setting SPCORE and MAXBUF parameters==
	<p>Either the SPCORE, the MAXBUF parameter, or both must be set on User 0's parameter line, as discussed for the EXEC statement earlier. See the discussion of the SPCORE parameter in [[ Multistep File Load ~~Utility~~#Multistep File Load, Phase 1: Setting the SPCORE parameter\|Multistep File Load, Phase 1: Setting the SPCORE parameter]].</p>		<p>Either the SPCORE, the MAXBUF parameter, or both must be set on User 0's parameter line, as discussed for the EXEC statement earlier. See the discussion of the SPCORE parameter in [[ Multistep File Load utility#Multistep File Load, Phase 1: Setting the SPCORE parameter\|Multistep File Load, Phase 1: Setting the SPCORE parameter]].</p>
	<p>To provide sufficient memory for the sorts, do one of the following: </p>		<p>To provide sufficient memory for the sorts, do one of the following: </p>
	<ul>		<ul>
Line 97:		Line 107:
	<li>Limit the number of disk buffers that <var class="product">Model 204</var> obtains with MAXBUF. </li>		<li>Limit the number of disk buffers that <var class="product">Model 204</var> obtains with MAXBUF. </li>
	</ul>		</ul>

	===Setting SPCORE===		===Setting SPCORE===
	<p>If SPCORE is set, it must be set on User 0's parameter line to a value large enough to accommodate all of the following:</p>		<p>If SPCORE is set, it must be set on User 0's parameter line to a value large enough to accommodate all of the following:</p>
Line 107:		Line 118:
	<p>If no deferred FRV records are generated by the file load program, only one copy of the sort is invoked. In this case, SPCORE can be reduced by the size occupied by one copy of the sort plus the size of the default work space for the sort. This work space is the value specified for the s2 argument in the FILELOAD command. For more information on the s2 parameter, refer to [[File Load Utility: FLOD and FILELOAD commands#FILELOAD command\|FILELOAD command]]. </p>		<p>If no deferred FRV records are generated by the file load program, only one copy of the sort is invoked. In this case, SPCORE can be reduced by the size occupied by one copy of the sort plus the size of the default work space for the sort. This work space is the value specified for the s2 argument in the FILELOAD command. For more information on the s2 parameter, refer to [[File Load Utility: FLOD and FILELOAD commands#FILELOAD command\|FILELOAD command]]. </p>
	<p>In general, the best performance is obtained when the amount of memory that the first sort is allowed to use is expanded. However, if any FRV fields are loaded, memory must be left for the second sort. This sort is run concurrently with the first sort, so there must be sufficient memory for both sorts to be active simultaneously.</p>		<p>In general, the best performance is obtained when the amount of memory that the first sort is allowed to use is expanded. However, if any FRV fields are loaded, memory must be left for the second sort. This sort is run concurrently with the first sort, so there must be sufficient memory for both sorts to be active simultaneously.</p>

	===Setting MAXBUF===		===Setting MAXBUF===
	<p>As an alternative to setting SPCORE, the MAXBUF parameter can be set to reserve memory for the sorts by limiting the number of buffers that are allocated. Never set MAXBUF to less than 4. A File Load run loading a typical file with no ORDERED fields should not require more than ASIZE + 2 buffers. Files with unordered, sorted, or hash key organizations, or with ORDERED fields might require additional buffers. In general, files with ORDERED fields run more efficiently with a large number of buffers: up to ASIZE+DSIZE+2. </p>		<p>As an alternative to setting SPCORE, the MAXBUF parameter can be set to reserve memory for the sorts by limiting the number of buffers that are allocated. Never set MAXBUF to less than 4. A File Load run loading a typical file with no ORDERED fields should not require more than ASIZE + 2 buffers. Files with unordered, sorted, or hash key organizations, or with ORDERED fields might require additional buffers. In general, files with ORDERED fields run more efficiently with a large number of buffers: up to ASIZE+DSIZE+2. </p>
	==One-Step File Load, Phase 1 examples==		==One-Step File Load, Phase 1 examples==
	<p>The following JCL illustrates a sample invocation of the one-step File Load.</p>		<p>The following JCL illustrates a sample invocation of the one-step File Load.</p>

	====z/OS JCL====		====z/OS JCL====
	<p class="code">//M204FLOD EXEC PGM=BATCH204,REGION=5120K,		<p class="code">//M204FLOD EXEC PGM=BATCH204,REGION=5120K,