Fast/Unload DATESTAT analysis - Revision history

JAL: minor formatting

2016-08-04T22:45:38Z

minor formatting

← Older revision		Revision as of 22:45, 4 August 2016
Line 1:		Line 1:
	~~<!-- Page name: Fast/Unload DATESTAT analysis-->~~
	==DATESTAT sampling==		==DATESTAT sampling==
	If the <var>[[Fast/Unload Extraction Language (FUEL)#datestat\|DATESTAT]]</var> statement is present in the <code>FUNIN</code> data set,		If the <var>[[Fast/Unload Extraction Language (FUEL)#datestat\|DATESTAT]]</var> statement is present in the <code>FUNIN</code> data set,
Line 77:		Line 76:
	For the meaning of the components of these formats, see		For the meaning of the components of these formats, see
	[[Fast/Unload datetime processing considerations#dtfmt\|Datetime formats]].		[[Fast/Unload datetime processing considerations#dtfmt\|Datetime formats]].

	~~<div id="dtrep"></div>~~

	==DATESTAT reporting==		==<b id="dtrep"></b>DATESTAT reporting==
	~~<!--Caution: <div> above-->~~

	This section describes the reports created by the <var>DATESTAT SUMMARY</var>		This section describes the reports created by the <var>DATESTAT SUMMARY</var>
	and <var>DATESTAT DETAIL</var> statements.		and <var>DATESTAT DETAIL</var> statements.
Line 132:		Line 127:
	</table>		</table>

	==DATESTAT SUMMARY==		===DATESTAT SUMMARY===
	<var>DATESTAT SUMMARY</var> creates a report with one to three lines for each date field, in		<var>DATESTAT SUMMARY</var> creates a report with one to three lines for each date field, in
	the following form:		the following form:
Line 207:		Line 202:
	the date of the run up to and including the date of the run. </p>		the date of the run up to and including the date of the run. </p>

	==DATESTAT DETAIL==		===DATESTAT DETAIL===
	<var>DATESTAT DETAIL</var> creates a report with one page for each date field, which		<var>DATESTAT DETAIL</var> creates a report with one page for each date field, which
	includes:		includes:

Dme: /* DATESTAT DETAIL */

2015-08-17T17:32:26Z

DATESTAT DETAIL

← Older revision		Revision as of 17:32, 17 August 2015
Line 208:		Line 208:

	==DATESTAT DETAIL==		==DATESTAT DETAIL==
	<var>~~DATEST~~ DETAIL</var> creates a report with one page for each date field, which		<var>DATESTAT DETAIL</var> creates a report with one page for each date field, which
	includes:		includes:
	<ol>		<ol>

JAL: add template

2015-03-11T19:43:24Z

add template

← Older revision		Revision as of 19:43, 11 March 2015
Line 235:		Line 235:

	==See also==		==See also==
	[[Fast/Unload ~~overview#WIKFUN$$topics\|Fast/Unload topics]]~~		{{Template:Fast/Unload topic list}}

JAL: more conversion cleanup

2015-02-25T21:58:09Z

more conversion cleanup

Show changes

Dme: /* DATESTAT sampling */

2015-02-25T21:09:05Z

DATESTAT sampling

← Older revision		Revision as of 21:09, 25 February 2015
Line 52:		Line 52:
	DDMMYYYY		DDMMYYYY
	DDIMMIYYYY		DDIMMIYYYY
	MONTH DAY YY		MONTH DAY YY[ HH:MI:SS]
	MONTH DAY YYYY		MONTH DAY YYYY
	MMDDYY		MMDDYY[HHMISS]
	MMIDDIYY		MMIDDIYY
	MMDDYYYY		MMDDYYYY
	MMIDDIYYYY		MMIDDIYYYY
	YYDDD		YYDDD
	YY MON DAY		YY MON DAY[ HH:MI:SS]
	YY MONTH DAY		YY MONTH DAY
	YYMMDD		YYMMDD[HHMISS]
	YYIMMIDD		YYIMMIDD
	YYYYDDD		YYYYDDD
	YYYY MON DAY		YYYY MON DAY[ HH:MI:SS]
	YYYY MONTH DAY		YYYY MONTH DAY
	YYYYMMDD		YYYYMMDD[HHMISS]
	YYYYIMMIDD		YYYYIMMIDD
	</p>		</p>

Dme: /* DATESTAT sampling */

2015-02-25T21:06:16Z

DATESTAT sampling

← Older revision		Revision as of 21:06, 25 February 2015
Line 38:		Line 38:
	character other than <var>M</var>, <var>D</var>, or <var>Y</var>, or is followed immediately by		character other than <var>M</var>, <var>D</var>, or <var>Y</var>, or is followed immediately by
	time in the form <var>HHMMSS</var> otherwise.</p>		time in the form <var>HHMMSS</var> otherwise.</p>
	<p class="code">MON DAY YY		<p class="code">MON DAY YY[ HH:MI:SS]
	MON DAY YYYY		MON DAY YYYY
	DAY MON YY		DAY MON YY
Line 48:		Line 48:
	DAY MONTH, YY		DAY MONTH, YY
	DAY MONTH, YYYY		DAY MONTH, YYYY
	DDMMYY		DDMMYY[HHMISS]
	DDIMMIYY		DDIMMIYY
	DDMMYYYY		DDMMYYYY

Dme: /* DATESTAT sampling */

2015-02-25T21:03:18Z

DATESTAT sampling

← Older revision		Revision as of 21:03, 25 February 2015
Line 17:		Line 17:

	<li>At least one field value that conforms to a date format is found in the pass being performed, except:		<li>At least one field value that conforms to a date format is found in the pass being performed, except:
	<p class="note">A field is not a date if all dates were all numeric, there were more than 5 distinct non-date values, and fewer than 50% of the instances are dates. This is an attempt to avoid situations in which a field such as zip code could be treated as a 5-digit (YYDDD) date.</p></li>		<p class="note">A field is not a date if all dates were all numeric, there were more than 5 distinct non-date values, and fewer than 50% of the instances of the field are dates. This is an attempt to avoid situations in which a field such as zip code could be treated as a 5-digit (YYDDD) date.</p></li>

	<li>The field is not a <var>Blob</var> field. Such fields are not candidates for <var>DATESTAT</var> analysis.</li>		<li>The field is not a <var>Blob</var> field. Such fields are not candidates for <var>DATESTAT</var> analysis.</li>

Dme: /* DATESTAT sampling */

2015-02-25T21:02:18Z

DATESTAT sampling

← Older revision		Revision as of 21:02, 25 February 2015
Line 16:		Line 16:
	<li>For pass one, the field is not found in the 1000 records. </li>		<li>For pass one, the field is not found in the 1000 records. </li>

	<li>At least one field value that conforms to a date format is found in a pass, except:		<li>At least one field value that conforms to a date format is found in the pass being performed, except:
	<p class="note">A field is not a date if all dates were all numeric, there were more than 5 distinct non-date values, and fewer than 50% of the instances are dates. This is an attempt to avoid situations in which a field such as zip code could be treated as a 5-digit (YYDDD) date.</p></li>		<p class="note">A field is not a date if all dates were all numeric, there were more than 5 distinct non-date values, and fewer than 50% of the instances are dates. This is an attempt to avoid situations in which a field such as zip code could be treated as a 5-digit (YYDDD) date.</p></li>

JAL: misc cleanup

2015-02-25T17:34:54Z

misc cleanup

← Older revision		Revision as of 17:34, 25 February 2015
Line 13:		Line 13:
	At the end of each pass, certain fields are retained for date		At the end of each pass, certain fields are retained for date
	analysis and reporting. A field is retained if:		analysis and reporting. A field is retained if:
	<ol>		<ul>
	<li>For pass one, the field is not found in the 1000 records. </li>		<li>For pass one, the field is not found in the 1000 records. </li>

	<li>At least one field value that conforms to a date format is found in ~~the~~ pass, except:		<li>At least one field value that conforms to a date format is found in a pass, except:
	<p class="note">A field is not a date if all dates were all numeric, there were more than 5 distinct non-date values, and fewer than 50% of the instances are dates. This is an attempt to avoid situations in which a field such as zip code could be treated as a 5-digit (YYDDD) date.</p></li>		<p class="note">A field is not a date if all dates were all numeric, there were more than 5 distinct non-date values, and fewer than 50% of the instances are dates. This is an attempt to avoid situations in which a field such as zip code could be treated as a 5-digit (YYDDD) date.</p></li>
	~~</ol>~~
	<p>		<li>The field is not a <var>Blob</var> field. Such fields are not candidates for <var>DATESTAT</var> analysis.</li>
	~~Note that~~ <var>Blob</var> fields are not candidates for <var>DATESTAT</var> analysis.</p>		</ul>
	<p>		<p>
	The analysis keeps tracks of various totals that are used in		The analysis keeps tracks of various totals that are used in
Line 35:		Line 35:
	The date formats that are searched for consist of the following list,		The date formats that are searched for consist of the following list,
	plus each one of the formats in this list, followed by a blank and		plus each one of the formats in this list, followed by a blank and
	time in the form HH:MI:SS, if the date format contains a		time in the form <var>HH:MI:SS</var>, if the date format contains a
	character other than M, D, or Y, or followed immediately by		character other than <var>M</var>, <var>D</var>, or <var>Y</var>, or is followed immediately by
	time in the form HHMMSS otherwise.</p>		time in the form <var>HHMMSS</var> otherwise.</p>
	<p class="code">MON DAY YY		<p class="code">MON DAY YY
	MON DAY YYYY		MON DAY YYYY
Line 73:		Line 73:

	<div id="dtrep"></div>		<div id="dtrep"></div>

	==DATESTAT reporting==		==DATESTAT reporting==
	<!--Caution: <div> above-->		<!--Caution: <div> above-->

JAL: more conversion cleanup

2015-02-24T21:50:58Z

more conversion cleanup

Show changes