Deflate (String function): Difference between revisions
No edit summary |
No edit summary |
||
| Line 3: | Line 3: | ||
==Syntax== | ==Syntax== | ||
<p class="syntax"><span class="term">%outString</span><span class="literal"> =</span> <span class="term">string</span><span class="literal">:Deflate</span><span class="squareb">[</span><span class="literal">(</span> <span class="squareb">[</span><span class="literal" title="Boolean">FixedCode=</span> <span class="term" title="Boolean">boolean</span><span class="squareb">]</span><span class="comma">,</span> <span class="squareb">[</span><span class="literal" title="Boolean">LazyMatch=</span> <span class="term" title="Boolean">boolean</span><span class="squareb">]</span><span class="comma">,</span> - | |||
<span class="squareb">[</span><span class="literal" title="Number">MaxChain=</span> <span class="term" title="Number">number</span><span class="squareb">]</span><span class="comma">,</span> <span class="squareb">[</span><span class="literal" title="Boolean">Software=</span> <span class="term" title="Boolean">boolean</span><span class="squareb">]</span><span class="literal">)</span><span class="squareb">]</span></p> | |||
===Syntax terms=== | ===Syntax terms=== | ||
| Line 19: | Line 20: | ||
<li>With dynamic compression (<code>fixedCode=false</code>), the compression code tables are generated based on the input data. Dynamic tables typically provide somewhat better compression on most types of data. There is a very slight CPU overhead in computing the frequencies of byte values in the input data. Also, since the code tables are dynamic, they are included as part of the compressed data. This will increase the size of the compressed longstring, but these tables are small, since they are also stored in a compressed form. | <li>With dynamic compression (<code>fixedCode=false</code>), the compression code tables are generated based on the input data. Dynamic tables typically provide somewhat better compression on most types of data. There is a very slight CPU overhead in computing the frequencies of byte values in the input data. Also, since the code tables are dynamic, they are included as part of the compressed data. This will increase the size of the compressed longstring, but these tables are small, since they are also stored in a compressed form. | ||
</ul> | </ul> | ||
The default value for this argument is <var>False</var> (use dynamic compression). | The default value for this argument is <var>False</var> (use dynamic compression).</td></tr> | ||
</td></tr> | |||
<tr><th><var>LazyMatch</var></th> | <tr><th><var>LazyMatch</var></th> | ||
<td><var>LazyMatch</var> is an optional, name required, parameter that is a <var>Boolean</var> value that specifies whether to use "lazy match" compression, as specified in RFC 1951. | <td><var>LazyMatch</var> is an optional, name required, parameter that is a <var>Boolean</var> value that specifies whether to use "lazy match" compression, as specified in RFC 1951. | ||
The default value for this argument is <var>False</var> (do not use "lazy match" compression). | The default value for this argument is <var>False</var> (do not use "lazy match" compression).</td></tr> | ||
</td></tr> | |||
<tr><th><var>MaxChain</var></th> | <tr><th><var>MaxChain</var></th> | ||
<td><var>MaxChain</var> is an optional, name required, parameter that is a numeric value that specifies the maximum hash chain length, as explained in RFC 1951. | <td><var>MaxChain</var> is an optional, name required, parameter that is a numeric value that specifies the maximum hash chain length, as explained in RFC 1951. | ||
The default value for this argument is 0. If specified, it must be between 0 and 99, inclusive. | The default value for this argument is 0. If specified, it must be between 0 and 99, inclusive.</td></tr> | ||
<p>< | |||
<tr><th><var>Software</var></th> | |||
<td>[Introduced in Model 204 version 8.0] | |||
<p><var>Software</var> is an optional, [[Notation conventions for methods#Named parameters|name required]], parameter that is a <var>[[Boolean_enumeration#Using_Boolean_enumerations|Boolean]]</var> value that specifies whether to force the use of software compression instead of hardware compression.</p> | |||
<ul> | |||
<li>When <code>software=true</code>, compression is always performed in software, even if the DFLTCC hardware instruction is available on the processor. This can be useful for diagnostic purposes or when byte-for-byte reproducibility with pre-8.0 behavior is required.</li> | |||
<li>When <code>software=false</code> (the default), hardware compression is used automatically when DFLTCC is available (IBM z15 and above), falling back to software compression on older processors.</li> | |||
</ul> | |||
The default value for this argument is <var>False</var>. | |||
</td></tr> | </td></tr> | ||
</table> | </table> | ||
| Line 45: | Line 51: | ||
</ul> | </ul> | ||
==Hardware vs. software compression== | ===Hardware vs. software compression=== | ||
[Introduced in Model 204 version 8.0] | |||
<p>On IBM z15 and above processors, the <var>Deflate</var> method automatically exploits the DFLTCC (DEFLate Conversion Call) hardware instruction for significantly improved compression performance. The following differences apply when using hardware compression:</p> | |||
<p>On IBM z15 and above processors, <var>Deflate</var> automatically | |||
<ul> | <ul> | ||
<li>The <var>LazyMatch</var> and <var>MaxChain</var> parameters | <li>The <var>LazyMatch</var> and <var>MaxChain</var> parameters have no effect when hardware compression is used. The hardware uses its own internal matching algorithm. | ||
<li>The <var>FixedCode</var> parameter is honored by both hardware and software compression. When <code>fixedCode=true</code>, the hardware generates compressed data with fixed Huffman codes instead of generating a Dynamic Huffman Table (GDHT). | |||
<li> | <li>Compressing the same input data multiple times may produce different compressed output due to the implementation-dependent hash function for duplicate string matching, as documented in the z/Architecture Principles of Operation. This is a property of the hardware itself, not a software issue. | ||
<li>Hardware-compressed data can always be decompressed by any standards-compliant inflate implementation (and vice versa). | |||
<li>Hardware | |||
</ul> | </ul> | ||
<p>These differences also apply to the <var>[[Gzip (String function)|Gzip]]</var> and <var>[[Zip (String function)|Zip]]</var> methods, which use <var>Deflate</var> compression internally.</p> | <p>These differences also apply to the <var>[[Gzip (String function)|Gzip]]</var> and <var>[[Zip (String function)|Zip]]</var> methods, which use <var>Deflate</var> compression internally.</p> | ||
| Line 65: | Line 65: | ||
In the following example, <code>%out</code> is set to the compressed version of the given string: | In the following example, <code>%out</code> is set to the compressed version of the given string: | ||
<p class="code">%out = 'How much wood could a woodchuck chuck':deflate(fixedCode=true) | <p class="code">%out = 'How much wood could a woodchuck chuck':deflate(fixedCode=true) | ||
</p> | |||
The following example forces software compression: | |||
<p class="code">%out = 'How much wood could a woodchuck chuck':deflate(software=true) | |||
</p> | </p> | ||
Latest revision as of 13:39, 19 May 2026
Compress a longstring with deflate (String class)
[Introduced in Sirius Mods 7.4]
This function compresses a longstring using the "deflate" algorithm. The deflate algorithm is described completely in RFC 1951. It is very effective with HTML and XML data.
Syntax
%outString = string:Deflate[( [FixedCode= boolean], [LazyMatch= boolean], - [MaxChain= number], [Software= boolean])]
Syntax terms
| %outString | The resulting compressed string. |
|---|---|
| string | The string to be compressed. |
| FixedCode | FixedCode is an optional, name required, parameter that is a Boolean value that specifies whether the compression uses fixed codes or is dynamic, based on the contents of the input string.
|
| LazyMatch | LazyMatch is an optional, name required, parameter that is a Boolean value that specifies whether to use "lazy match" compression, as specified in RFC 1951. The default value for this argument is False (do not use "lazy match" compression). |
| MaxChain | MaxChain is an optional, name required, parameter that is a numeric value that specifies the maximum hash chain length, as explained in RFC 1951. The default value for this argument is 0. If specified, it must be between 0 and 99, inclusive. |
| Software | [Introduced in Model 204 version 8.0]
Software is an optional, name required, parameter that is a Boolean value that specifies whether to force the use of software compression instead of hardware compression.
The default value for this argument is False. |
Usage notes
- The NCMPBUF parameter must be set to a non-0 value during Model 204 initialization to allow use of the Deflate function; otherwise, invoking Deflate causes request cancellation.
- As with any compression scheme, it is possible that a particular string will become longer after compression. This would happen, for example, if a deflated string were passed to Deflate.
- Short strings (less than 128 bytes) typically compress better with
fixedCode=true.
Hardware vs. software compression
[Introduced in Model 204 version 8.0]
On IBM z15 and above processors, the Deflate method automatically exploits the DFLTCC (DEFLate Conversion Call) hardware instruction for significantly improved compression performance. The following differences apply when using hardware compression:
- The LazyMatch and MaxChain parameters have no effect when hardware compression is used. The hardware uses its own internal matching algorithm.
- The FixedCode parameter is honored by both hardware and software compression. When
fixedCode=true, the hardware generates compressed data with fixed Huffman codes instead of generating a Dynamic Huffman Table (GDHT). - Compressing the same input data multiple times may produce different compressed output due to the implementation-dependent hash function for duplicate string matching, as documented in the z/Architecture Principles of Operation. This is a property of the hardware itself, not a software issue.
- Hardware-compressed data can always be decompressed by any standards-compliant inflate implementation (and vice versa).
These differences also apply to the Gzip and Zip methods, which use Deflate compression internally.
Examples
In the following example, %out is set to the compressed version of the given string:
%out = 'How much wood could a woodchuck chuck':deflate(fixedCode=true)
The following example forces software compression:
%out = 'How much wood could a woodchuck chuck':deflate(software=true)
See also
- Inflate is used to decompress the string to its original value.
- Other related methods: