File Management - Revision history

Shtsai: /* References */

2026-07-28T16:34:47Z

References

← Older revision		Revision as of 12:34, 28 July 2026
Line 111:		Line 111:

	* pigz home page: https://zlib.net/pigz/		* pigz home page: https://zlib.net/pigz/
	* pigz manual page: https://zlib.net/pigz/pigz.pdf		<!-- * pigz manual page: https://zlib.net/pigz/pigz.pdf -->
	* gzip manual: https://www.gnu.org/software/gzip/manual/gzip.html		* gzip manual: https://www.gnu.org/software/gzip/manual/gzip.html


	==Creating tar files==		==Creating tar files==

2024-09-25T18:11:29Z

← Older revision		Revision as of 14:11, 25 September 2024
Line 14:		Line 14:
	</pre>		</pre>

	'''Note:''' Please do not run <code>gzip/gunzip/pigz/unpigz</code> commands directly on the Sapelo2 login nodes. Instead, please use either an interactive or a batch job for compressing and uncompressing files.		<blockquote style="background-color: lightyellow; border: solid thin grey;">
			'''Note:''' Please do not run <code>gzip/gunzip/pigz/unpigz</code> commands directly on the Sapelo2 login nodes. Instead, please use either an interactive or a batch job for compressing and uncompressing files. If we detect these commands being run on the login nodes, we may have to cancel them to avoid overloading the login nodes.
			</blockquote>

	===Some simple examples===		===Some simple examples===
Line 123:		Line 124:
	</pre>		</pre>

	'''Note:''' Please do not run <code>tar</code> directly on the Sapelo2 login nodes.		<blockquote style="background-color: lightyellow; border: solid thin grey;">
			'''Note:''' Please do not run <code>tar</code> directly on the Sapelo2 login nodes. Instead, please use either an interactive or a batch job for creating or extracting archive files.
			</blockquote>

	A tar file can be compressed with <code>pigz</code> using multiple cores in an interactive session that requested multiple cores with		A tar file can be compressed with <code>pigz</code> using multiple cores in an interactive session that requested multiple cores with

2024-09-24T20:17:28Z

← Older revision		Revision as of 16:17, 24 September 2024
Line 106:		Line 106:
	-rw-r--r-- 1 shtsai gclab 10G Dec 16 2021 10g.img		-rw-r--r-- 1 shtsai gclab 10G Dec 16 2021 10g.img
	</pre>		</pre>

			===References===

			* pigz home page: https://zlib.net/pigz/
			* pigz manual page: https://zlib.net/pigz/pigz.pdf
			* gzip manual: https://www.gnu.org/software/gzip/manual/gzip.html


	==Creating tar files==		==Creating tar files==

2024-09-24T20:01:44Z

← Older revision		Revision as of 16:01, 24 September 2024
Line 17:		Line 17:


	~~'''~~Some simple examples~~'''~~		===Some simple examples===

	Compress a file		Compress a file
Line 58:		Line 58:


	~~'''~~Sample timing comparison~~'''~~		===Sample timing comparison===

	This example shows the time required to compress a single 10GB file in an interactive session that has 10 cores available. The gzip command took about 84 seconds, while the pigz command took about 22 seconds, to compress a 10GB file down to 10MB (gzip) and 12MB (pigz).		This example shows the time required to compress a single 10GB file in an interactive session that has 10 cores available. The gzip command took about 84 seconds, while the pigz command took about 22 seconds, to compress a 10GB file down to 10MB (gzip) and 12MB (pigz).

2024-09-24T20:00:27Z

← Older revision		Revision as of 16:00, 24 September 2024
Line 133:		Line 133:
	tar zxvf dirname.tar.gz		tar zxvf dirname.tar.gz
	</pre>		</pre>


			==File transfer==

			The recommended way to transfer files between file systems on the cluster, or between GACRC and external storage systems is using Globus. For more information, please see https://wiki.gacrc.uga.edu/wiki/Globus

2024-09-24T19:57:10Z

← Older revision		Revision as of 15:57, 24 September 2024
Line 13:		Line 13:
	pigz --help		pigz --help
	</pre>		</pre>

			'''Note:''' Please do not run <code>gzip/gunzip/pigz/unpigz</code> commands directly on the Sapelo2 login nodes. Instead, please use either an interactive or a batch job for compressing and uncompressing files.


	'''Some simple examples'''		'''Some simple examples'''

2024-09-24T19:55:04Z

File Compression

2024-09-24T19:54:30Z

@@ Line 57: / Line 57: @@
 '''Sample timing comparison'''
-This example shows the time required to compress a 10GB file in an interactive session that has 10 cores available.
+This example shows the time required to compress a single 10GB file in an interactive session that has 10 cores available. The gzip command took about 84 seconds, while the pigz command took about 22 seconds, to compress a 10GB file down to 10MB (gzip) and 12MB (pigz).
 <pre class="gcommand">
 ==Creating tar files==

2024-09-24T19:35:40Z

File Compression

← Older revision		Revision as of 15:35, 24 September 2024
Line 53:		Line 53:
	unpigz -r dirname		unpigz -r dirname
	</pre>		</pre>


			'''Sample timing comparison'''

			This example shows the time required to compress a 10GB file in an interactive session that has 10 cores available.

			<pre class="gcommand">

	==Creating tar files==		==Creating tar files==

2024-09-24T19:28:51Z

Creating tar files

← Older revision		Revision as of 15:28, 24 September 2024
Line 76:		Line 76:
	</pre>		</pre>

	To extract a tar.gz file:		To extract the files from a tar.gz file:
	<pre class="gcommand">		<pre class="gcommand">
	tar zxvf dirname.tar.gz		tar zxvf dirname.tar.gz
	</pre>		</pre>