Transferring Files - Revision history

Shtsai at 18:33, 28 July 2026

2026-07-28T18:33:02Z

← Older revision		Revision as of 14:33, 28 July 2026
Line 71:		Line 71:
	{\| width="100%" border="1" cellspacing="0" cellpadding="2" align="center" class="wikitable unsortable"		{\| width="100%" border="1" cellspacing="0" cellpadding="2" align="center" class="wikitable unsortable"
	\|-		\|-
	\| [[Media:~~Xfer_Filezilla_12032018~~.pdf]]		\| [[Media:Xfer_Filezilla_07282026.pdf]]
	\|-		\|-
	\|}		\|}

Chelsea at 18:26, 28 July 2026

2026-07-28T18:26:29Z

← Older revision		Revision as of 14:26, 28 July 2026
Line 34:		Line 34:
	Data transfers happen unattended and are faster than SCP/SFTP, data verification is on by default, and automatic restarts or continuation of transfers happen after a disruption.		Data transfers happen unattended and are faster than SCP/SFTP, data verification is on by default, and automatic restarts or continuation of transfers happen after a disruption.

	Information about how to get started with and how to use Globus can be found on our Globus ~~wiki page~~ [[Globus\|~~here~~]].		Information about how to get started with and how to use Globus can be found on our Globus [[Globus\|wiki page]].

Chelsea: /* File Transfer Methods for Sapelo2 */

2026-07-28T17:49:50Z

File Transfer Methods for Sapelo2

← Older revision		Revision as of 13:49, 28 July 2026
Line 34:		Line 34:
	Data transfers happen unattended and are faster than SCP/SFTP, data verification is on by default, and automatic restarts or continuation of transfers happen after a disruption.		Data transfers happen unattended and are faster than SCP/SFTP, data verification is on by default, and automatic restarts or continuation of transfers happen after a disruption.

	Information about how to get started with a use Globus ~~cana~~ be found on our Globus wiki page [[Globus\|here]].		Information about how to get started with and how to use Globus can be found on our Globus wiki page [[Globus\|here]].

Chelsea at 17:49, 28 July 2026

2026-07-28T17:49:25Z

← Older revision		Revision as of 13:49, 28 July 2026
Line 1:		Line 1:
	[[Category:Sapelo2]][[Category:Teaching]]		[[Category:Sapelo2]][[Category:Teaching]]

	==The File Transfer nodes (xfer.gacrc.uga.edu)==		=Transferring Files to and from Sapelo2=

			To transfer files from your local storage device to Sapelo2 or from Sapelo2 to your local storage device, please connect to xfer.gacrc.uga.edu (use your UGA MyID, the MyID password to authenticate). You will also be prompted for two-factor authentication with Archpass Duo.

			==The File Transfer nodes for Sapelo2 (xfer.gacrc.uga.edu)==

	Users can transfer files between their local machines and GACRC storage using various programs, such as (a) Filezilla, (b) WinSCP, and (c) a secure copy (scp). To transfer files, you must have a file transfer program installed on your local machine and a connection to the UGA campus network.		Users can transfer files between their local machines and GACRC storage using various programs, such as (a) Filezilla, (b) WinSCP, and (c) a secure copy (scp). To transfer files, you must have a file transfer program installed on your local machine and a connection to the UGA campus network.
Line 24:		Line 28:
	4. The project file system for the lab: /project/groupname		4. The project file system for the lab: /project/groupname

	==~~Transferring Files~~ from your local storage ~~device to Sapelo2~~ or ~~vice-versa==~~		==File Transfer Methods for Sapelo2==

			===Globus===
			Globus is a high-performance data-transfer platform that allows you to perform and/or automate data transfers and is the recommended method for transferring files to/from the Sapelo2 Cluster. These transfers can be to and from other institutions, your local computer, or your Sapelo2 directories, including your /project area. Collaborators can also share data with you by sharing a Collection or an "endpoint" with you. The shared Collection/Endpoint can be on another institution, on a desktop or laptop, or on their GACRC storage.
			Data transfers happen unattended and are faster than SCP/SFTP, data verification is on by default, and automatic restarts or continuation of transfers happen after a disruption.

	~~To transfer files from your local storage device~~ to ~~Sapelo2 or from Sapelo2 to your local storage device, please connect to xfer.gacrc.uga.edu (~~use ~~your UGA MyID, the MyID password to authenticate). You will also~~ be ~~prompted for two-factor authentication with Archpass Duo~~.		Information about how to get started with a use Globus cana be found on our Globus wiki page [[Globus\|here]].


Line 250:		Line 258:
	File transfer between the Sapelo or Sapelo2 home directory, /lustre1, or /lscratch (on compute node) and /project can be done using scp in a batch job.		File transfer between the Sapelo or Sapelo2 home directory, /lustre1, or /lscratch (on compute node) and /project can be done using scp in a batch job.

	In order to do this from your job script without using password you have to have ssh keys setup on ~~Sapelo or~~ Sapelo2.		In order to do this from your job script without using password you have to have ssh keys setup on Sapelo2.

	To setup ssh keys on ~~Sapelo or~~ Sapelo2 (if you have not done so yet), ~~login into Sapelo1 login node or~~ the Sapelo2 login node and execute the following command		To setup ssh keys on Sapelo2 (if you have not done so yet), log in to the Sapelo2 login node and execute the following command

	<pre class="gcommand">		<pre class="gcommand">
Line 258:		Line 266:
	</pre>		</pre>

	This will create ssh keys for your account and add it to authorized keys file. This will let you ssh/scp from ~~sapelo~~ compute nodes to xfer nodes.		This will create ssh keys for your account and add it to authorized keys file. This will let you ssh/scp from sapelo2 compute nodes to xfer nodes.

	Once you have the ssh keys setup you can scp or even rsync the results from /home, /lustre1, or /lscratch (on compute node) to your project area on xfer node.		Once you have the ssh keys setup you can scp or even rsync the results from /home, /lustre1, or /lscratch (on compute node) to your project area on xfer node.
Line 277:		Line 285:
	-->		-->

	==The File Transfer node for the ~~teaching cluster~~ (txfer.gacrc.uga.edu)==		=Transferring Files to and from the Teaching Cluster=

			==The File Transfer node for the Teaching Cluster (txfer.gacrc.uga.edu)==

	Users can transfer files between their local machines and the teaching cluster using (a) Filezilla, (b) a secure copy (scp), or (c) WinSCP. To transfer files using scp (or SSH file transfer) you must have scp (or SSH) on your local machine and a connection to the UGA campus network. An scp software is included in recent releases of Unix based operating systems (including Linux and Mac OS X).		Users can transfer files between their local machines and the teaching cluster using (a) Filezilla, (b) a secure copy (scp), or (c) WinSCP. To transfer files using scp (or SSH file transfer) you must have scp (or SSH) on your local machine and a connection to the UGA campus network. An scp software is included in recent releases of Unix based operating systems (including Linux and Mac OS X).
Line 284:		Line 294:
	[https://eits.uga.edu/access_and_security/infosec/tools/archpass archpass_duo] .		[https://eits.uga.edu/access_and_security/infosec/tools/archpass archpass_duo] .

	~~==Transferring Files from your local storage device to the teaching cluster==~~

	To transfer files from your local storage device to the teaching cluster, please connect to txfer.gacrc.uga.edu (use your UGA MyID and the MyID password to authenticate). You will also be prompted for two-factor authentication with Archpass Duo.

			==File Transfer Methods for the Teaching Cluster==
			To transfer files from your local storage device to the teaching cluster, please connect to the file transfer node, txfer.gacrc.uga.edu (use your UGA MyID and the MyID password to authenticate). You will also be prompted for two-factor authentication with Archpass Duo.

	===Using FileZilla===		===Using FileZilla===
Line 377:		Line 386:
	</pre>		</pre>

	==Transferring Files between ~~your~~ Sapelo2 ~~directories~~ and the ~~teaching cluster=~~=		=Transferring Files between Sapelo2 and the Teaching Cluster=

	To transfer files between your Sapelo2 directories (e.g. your Sapelo2 home directory or /scratch directory) and your teaching cluster home directory, please first use ssh to login into xfer.gacrc.uga.edu. Then use the scp command to copy files to/from your home directory at txfer.gacrc.uga.edu.		To transfer files between your Sapelo2 directories (e.g. your Sapelo2 home directory or /scratch directory) and your teaching cluster home directory, please first use ssh to login into xfer.gacrc.uga.edu. Then use the scp command to copy files to/from your home directory at txfer.gacrc.uga.edu.
Line 419:		Line 428:
	When you enter your password, you will be prompted for the two-factor authentication step. Once you enter a passcode or select an option, the file transfer will start.		When you enter your password, you will be prompted for the two-factor authentication step. Once you enter a passcode or select an option, the file transfer will start.

	==Transferring Files between your project area and the ~~teaching cluster~~==		==Transferring Files between your Sapelo2 project area and the Teaching Cluster==

	To transfer files between your /project area and your teaching cluster home directory, please first use ssh to login into xfer.gacrc.uga.edu. Then use the scp command to e.g. copy files from /project to your home directory at txfer.gacrc.uga.edu (or to copy files from your home directory at txfer.gacrc.uga.edu to your /project area).		To transfer files between your /project area and your teaching cluster home directory, please first use ssh to login into xfer.gacrc.uga.edu. Then use the scp command to e.g. copy files from /project to your home directory at txfer.gacrc.uga.edu (or to copy files from your home directory at txfer.gacrc.uga.edu to your /project area).
Line 430:		Line 439:
	where ''abclab'' needs to be changed to the name of your group.		where ''abclab'' needs to be changed to the name of your group.

	== ~~Globus~~ ==		==Other Methods==
	Globus is a high-performance data-transfer platform that allows you to perform and/or automate data transfers. These transfers can be to and from other institutions, your local computer, or your GACRC /project area. Collaborators can also share data with you by sharing a Collection or an "endpoint" with you. The shared Collection/Endpoint can be on another institution, on a desktop or laptop, or on their GACRC storage.		===Using iCommands to access the Cyverse Data Store===
	~~Data transfers happen unattended and are faster than SCP/SFTP, data verification is on by default, and automatic restarts or continuation of transfers happen after a disruption.~~

	To use Globus you will need a Globus Identity. At a minimum you will need to setup your identity using the University of Georgia organizational login in order to access UGA systems. More information about how to get started using Globus can be found on the [[Globus\|'''Globus''']] page. You can also get more information about Globus from the [https://docs.globus.org/ Official Globus Documentation]

	== Using iCommands to access the Cyverse Data Store ==
	[https://cyverse.org/data-store Cyverse] is a secure data storage and management service. iCommands is a collection of commands for Linux and Mac OS operating systems that are used to interact with the CyVerse Data Store. iCommands can be used by CyVerse account users to download files that have been shared by other users and to upload files to the Data Store, as well as add metadata, change permissions, and more. A CyVerse account is not required to download a public data file via iCommands.		[https://cyverse.org/data-store Cyverse] is a secure data storage and management service. iCommands is a collection of commands for Linux and Mac OS operating systems that are used to interact with the CyVerse Data Store. iCommands can be used by CyVerse account users to download files that have been shared by other users and to upload files to the Data Store, as well as add metadata, change permissions, and more. A CyVerse account is not required to download a public data file via iCommands.

Shtsai at 16:18, 28 July 2026

2026-07-28T16:18:02Z

← Older revision		Revision as of 12:18, 28 July 2026
Line 6:		Line 6:

	All Sapelo2 users, as well as all GACRC PIs, can access the xfer nodes using the hostname '''xfer.gacrc.uga.edu''' and using their UGA MyID (not the 810 or 811 number) and the MyID password to authenticate. Two-factor authentication using Archpass Duo is also necessary. For more details of Archpass Duo, please refer to		All Sapelo2 users, as well as all GACRC PIs, can access the xfer nodes using the hostname '''xfer.gacrc.uga.edu''' and using their UGA MyID (not the 810 or 811 number) and the MyID password to authenticate. Two-factor authentication using Archpass Duo is also necessary. For more details of Archpass Duo, please refer to
	[https://~~eits~~.~~uga~~.~~edu~~/~~access_and_security~~/~~infosec~~/~~tools~~/~~archpass~~ archpass_duo].		[https://uga.teamdynamix.com/TDClient/3190/eitsclientportal/KB/Category/23825/ArchPass-powered-by-Duo archpass_duo ].

	The GACRC file transfer nodes (xfer) are configured to facilitate file transfer. These nodes, which have a hostname of '''xfer.gacrc.uga.edu''', are connected via a higher-bandwidth network connection. Hence, maximum transfer speed between a user's local machine and the GACRC systems can be achieved by transferring files to/from the host xfer.gacrc.uga.edu (instead of the login nodes of the clusters).		The GACRC file transfer nodes (xfer) are configured to facilitate file transfer. These nodes, which have a hostname of '''xfer.gacrc.uga.edu''', are connected via a higher-bandwidth network connection. Hence, maximum transfer speed between a user's local machine and the GACRC systems can be achieved by transferring files to/from the host xfer.gacrc.uga.edu (instead of the login nodes of the clusters).

Shtsai at 18:17, 20 March 2026

2026-03-20T18:17:43Z

Show changes

Shtsai: /* The File Transfer node for the teaching cluster (txfer.gacrc.uga.edu) */

2025-01-08T16:26:46Z

The File Transfer node for the teaching cluster (txfer.gacrc.uga.edu)

← Older revision		Revision as of 12:26, 8 January 2025
Line 282:		Line 282:

	Access to txfer.gacrc.uga.edu requires an active MyID and password, and two-factor authentication with Archpass Duo. For more details of Archpass Duo, please refer to		Access to txfer.gacrc.uga.edu requires an active MyID and password, and two-factor authentication with Archpass Duo. For more details of Archpass Duo, please refer to
	[https://eits.uga.edu/access_and_security/infosec/tools/~~archpass_duo~~ archpass_duo] .		[https://eits.uga.edu/access_and_security/infosec/tools/archpass archpass_duo] .

	===Transferring Files from your local storage device to the teaching cluster===		===Transferring Files from your local storage device to the teaching cluster===

Shtsai: /* The File Transfer nodes (xfer.gacrc.uga.edu) */

2025-01-08T16:26:09Z

The File Transfer nodes (xfer.gacrc.uga.edu)

← Older revision		Revision as of 12:26, 8 January 2025
Line 6:		Line 6:

	All Sapelo2 users, as well as all GACRC PIs, can access the xfer nodes using the hostname '''xfer.gacrc.uga.edu''' and using their UGA MyID (not the 810 or 811 number) and the MyID password to authenticate. Two-factor authentication using Archpass Duo is also necessary. For more details of Archpass Duo, please refer to		All Sapelo2 users, as well as all GACRC PIs, can access the xfer nodes using the hostname '''xfer.gacrc.uga.edu''' and using their UGA MyID (not the 810 or 811 number) and the MyID password to authenticate. Two-factor authentication using Archpass Duo is also necessary. For more details of Archpass Duo, please refer to
	[https://eits.uga.edu/access_and_security/infosec/tools/~~archpass_duo~~ archpass_duo].		[https://eits.uga.edu/access_and_security/infosec/tools/archpass archpass_duo].

	The GACRC file transfer nodes (xfer) are configured to facilitate file transfer. These nodes, which have a hostname of '''xfer.gacrc.uga.edu''', are connected via a higher-bandwidth network connection. Hence, maximum transfer speed between a user's local machine and the GACRC systems can be achieved by transferring files to/from the host xfer.gacrc.uga.edu (instead of the login nodes of the clusters).		The GACRC file transfer nodes (xfer) are configured to facilitate file transfer. These nodes, which have a hostname of '''xfer.gacrc.uga.edu''', are connected via a higher-bandwidth network connection. Hence, maximum transfer speed between a user's local machine and the GACRC systems can be achieved by transferring files to/from the host xfer.gacrc.uga.edu (instead of the login nodes of the clusters).
Line 23:		Line 23:

	4. The project file system for the lab: /project/groupname		4. The project file system for the lab: /project/groupname


	===Transferring Files from your local storage device to Sapelo2 or vice-versa===		===Transferring Files from your local storage device to Sapelo2 or vice-versa===

Keeko: added cyverse

2021-12-01T15:25:13Z

added cyverse

← Older revision		Revision as of 11:25, 1 December 2021
Line 435:		Line 435:
	Data transfers happen unattended and are faster than SCP/SFTP, data verification is on by default, and automatic restarts or continuation of transfers happen after a disruption.		Data transfers happen unattended and are faster than SCP/SFTP, data verification is on by default, and automatic restarts or continuation of transfers happen after a disruption.

	To use Globus you will need a Globus Identity. At a minimum you will need to setup your identity using the University of Georgia organizational login in order to access UGA systems. More information about how to get started using Globus can be found on the [[Globus\|'''Globus''']] page.		To use Globus you will need a Globus Identity. At a minimum you will need to setup your identity using the University of Georgia organizational login in order to access UGA systems. More information about how to get started using Globus can be found on the [[Globus\|'''Globus''']] page. You can also get more information about Globus from the [https://docs.globus.org/ Official Globus Documentation]

			=== Using iCommands to access the Cyverse Data Store ===
			[https://cyverse.org/data-store Cyverse] is a secure data storage and management service. iCommands is a collection of commands for Linux and Mac OS operating systems that are used to interact with the CyVerse Data Store. iCommands can be used by CyVerse account users to download files that have been shared by other users and to upload files to the Data Store, as well as add metadata, change permissions, and more. A CyVerse account is not required to download a public data file via iCommands.

			version 4.2.8 of iCommands is installed on Sapelo2 IRODS '''transfer node''' (xfer-irods.gacrc.uga.edu). Please note that this command is not available on the other transfer nodes.

			You will need to log on a Sapelo2 transfer node xfer-irods.gacrc.uga.edu and then initialize the connection to iRODS by using the iinit command to use iCommands

			More information about using iCommands can be found on the [[ICommands-Sapelo2\|'''ICommands-Sapelo2''']] page. You can also read [https://cyverse.atlassian.net/wiki/spaces/DS/pages/241869855/Using+iCommands Official iCommands Documentation]

Keeko at 15:25, 30 November 2021

2021-11-30T15:25:36Z

← Older revision		Revision as of 11:25, 30 November 2021
Line 432:		Line 432:

	=== Globus ===		=== Globus ===
	Globus is a high-performance data-transfer platform that allows you to perform and/or automate data transfers.		Globus is a high-performance data-transfer platform that allows you to perform and/or automate data transfers. These transfers can be to and from other institutions, your local computer, or your GACRC /project area. Collaborators can also share data with you by sharing a Collection or an "endpoint" with you. The shared Collection/Endpoint can be on another institution, on a desktop or laptop, or on their GACRC storage.
	Data transfers happen unattended and are faster than SCP/SFTP, data verification is on by default, and automatic restarts or continuation of transfers happen after a disruption.		Data transfers happen unattended and are faster than SCP/SFTP, data verification is on by default, and automatic restarts or continuation of transfers happen after a disruption.

	To use Globus you will need a Globus Identity. At a minimum you will need to setup your identity using the University of Georgia organizational login in order to access UGA systems. More information about how to get started using Globus can be found on the [[Globus\|'''Globus''']] page.		To use Globus you will need a Globus Identity. At a minimum you will need to setup your identity using the University of Georgia organizational login in order to access UGA systems. More information about how to get started using Globus can be found on the [[Globus\|'''Globus''']] page.