Research Computing Center Wiki - User contributions [en]

OnDemand/Current Annoucements

2025-09-26T13:33:46Z

Bcarpenter: Created page with "== Important Notice: IGV App Unavailable, run IGV from X Desktop == The IGV app is currently not functional. However, you can still run IGV through an X Desktop session in Open OnDemand. To do this: * Start an X Desktop session on Sapelo2 within OnDemand. * Select your desired resources (e.g., number of cores, memory, walltime limit, partition, etc.). * Once the job is running and the X Desktop session is launched, open a Terminal in the X Desktop environment. * Load..."

== Important Notice: IGV App Unavailable, run IGV from X Desktop ==

The IGV app is currently not functional. However, you can still run IGV through an X Desktop session in Open OnDemand.

To do this:

* Start an X Desktop session on Sapelo2 within OnDemand.
* Select your desired resources (e.g., number of cores, memory, walltime limit, partition, etc.).
* Once the job is running and the X Desktop session is launched, open a Terminal in the X Desktop environment.
* Load the IGV module and start the application using the following commands:

<code>
ml IGV/2.19.1-Java-21

igv.sh
</code>

The igv.sh command should open the IGV GUI.
=====

OnDemand

2021-10-11T17:54:46Z

Bcarpenter:

= Open OnDemand (OOD) =

Open OnDemand ("OOD") is a web-based service provided by GACRC which provides users an alternative and/or complimentary method to access the HPC clusters. It helps computational researchers and students efficiently utilize remote computing resources by making them easy to access from any device, via a convenient web interface. Through Open OnDemand, graphical applications can be utilized on the cluster far more easily and smoothly than using X11 forwarding. It also helps computer center staff support a wide range of clients by simplifying the user interface and experience.

OOD Features:

* Job submission and monitoring
* File transfer and management
* File editing
* Shell access
* Graphical Desktop on the cluster
* Interactive Applications

{| class="wikitable"
|+Open OnDemand Integration with GACRC Clusters
!Availability
!Cluster
!URL
|-
|Production
|Sapelo2
|https://ondemand.gacrc.uga.edu
|-
|Development Testing
|Sapelo2
|https://oodev.gacrc.uga.edu
|-
|Future
|Teach
|N/A
|}

----
[[#top|Back to Top]]

= How to access Open OnDemand =

'''In order to access the GACRC OOD login page, You must be connected to the UGA Network, either directly or by [https://eits.uga.edu/access_and_security/infosec/tools/vpn/ VPN].'''

'''Logging in requires a [https://wiki.gacrc.uga.edu/wiki/User_Accounts GACRC Cluster Account].'''

'''GACRC OOD uses UGA Single Sign-On Service (SSO) for authentication.'''

# Open a web browser to the cluster's Open OnDemand URL: https://oodev.gacrc.uga.edu
# Login with your UGA MyID credentials
===<span id ="Browser"></span>Browser Requirements/Notes===
To have the best experience using OnDemand, GACRC recommends using the latest version of '''Google Chrome, Mozilla Firefox,''' or '''Microsoft Edge'''. Any modern browser that supports ECMAScript 2016 ''should'' work, but GACRC will not support it.

'''Individual browser notes'''

* Google Chrome is currently the ''only'' web browser that natively supports the copy and paste functionality in <code>noVNC</code>. Other browsers can do copy and pasting manually through the <code>noVNC</code> tool drawer.

* Safari users '''''may''''' have issues when using the Shell App or <code>noVNC</code>. If you have issues, make sure your application is up-to-date.
* Internet Explorer 11 is '''NOT''' supported.

----
[[#top|Back to Top]]

= Using Open OnDemand =

Upon logging into Open OnDemand, all of its tools can be accessed via the links in the top menu bar.

[[File: Oodheader.png| OOD Menu Bar]]



== Files ==

Clicking "Files" in the top menu bar will open a drop menu that displays yours and your lab's directories on the cluster. Clicking any of those displayed directories will take you to a new page that allows you to manage the directories contents, as well as navigate to other directories on the cluster to which you have access. In this file browsing interface, there is a menu above the file browsing area that allows you to:

*Open an interactive shell in the current directory
*Create a new file
*Create a new directory
*Upload files
*Download files
*Copy/move files
*Delete files

[[File:Oodfiles2.png |900px]]

Clicking on a directory will navigate the OOD file browser to that directory. Clicking on a text file will open a new read-only window, displaying the file. If you would like to edit a file from within OOD, click the three-vertical-dots button to the right of a file name, and then click "Edit". This will open a new tab that allows you to edit and save changes to a file. The OOD file editor has a plethora of different syntax highlighting options. If the file you're editing has a file extension in its name for which OOD has syntax highlighting, it will pre-select that option, however you can change the syntax highlighting by selecting a different option from the "Mode" drop down menu at the top. Additionally in the top menu of the OOD file editor, you can change the font size, as well as select a different display theme.

=== File Transfer Limitations ===

'''Copy and Moving files'''
When it comes to copying and moving files within the cluster, it is recommended that you only use OOD for smaller files. For anything else, please use the [[Transferring Files|transfer nodes]]. This is due to the OOD server acting as a "man-in-the-middle" for transferring files between the different file systems. For example, if you move something from /home to /scratch, in the background the file first has to be transferred to a temporary storage on the OOD server, before it is then transferred to the destination.

'''Uploading files'''
GACRC '''highly''' recommends using the [[Transferring Files|transfer nodes]] or [[Globus]] for larger file transfers. If you must use OOD for large file transfers, please be aware there is a hard-limit in place of ~10.0 Gib. GACRC reserves the right to lower this limit in the future.

[[#top|Back to Top]]

== Jobs ==

Clicking "Jobs" will open a drop down menu allowing you to navigate to "Active Jobs" or "Job Composer".

=== Active Jobs ===

In the Active Jobs interface, you're able to view information about your currently running jobs. Clicking the arrow on the left will expand this interface displaying further information about the job, as seen below.

[[File:oodjobs2.png | 1200px]] [[File:Oodjobs.png | 1200px]]

[[#top|Back to Top]]

== Clusters ==

Clicking "Clusters" will open a drop down menu giving you an option to open a shell for the cluster in your browser, on one of the login nodes. This functions just as if you had connected to a Sapelo2 login node via PuTTY (Windows) or Terminal (Mac/Linux). In the top right of this interface you are able to select a different theme for your shell. Please see [[#Browser | Browser Requirements/Notes]] for possible limitations.

[[File:Oodcli1.png | 600 px]]

[[#top|Back to Top]]

== Interactive Apps ==

One of the best features of Open OnDemand is the ability to directly launch interactive graphical applications. "Interactive Applications" or "Apps" are wrappers that will schedule a Slurm job with a particular application, and give you direct web based access into the interface.

These apps can be accessed near the bottom of the Open OnDemand main page called "Pinned Apps" or from the "Interactive Apps" in the top menu bar. ''Note that the image below is only an example, as the list of interactive applications will grow over time.''

[[File:Ood-interactive-apps-3.png|600px]]

===Launching an application===
Clicking the icon of the interactive application that you would like to use will take you to a new page in which you define the resources allocated to interactive application.

If the GUI application you want to use has its own interactive app in Open OnDemand, you should use that launcher. If the GUI application you want to use does not have a launcher yet you have two options; You an open a ticket with GACRC and request the application be added to OnDemand (Link TBD), or you can use the "[[#X_Desktop |X Desktop Session]]".

====Configuring the resources====
Resources must be defined like this because an Open OnDemand interactive app is happening within the context of a Slurm job. Each application may allow for the customization of different resources, while some may have static defined resources that cannot be changed. Almost all of the resources available to be configured should be familiar to a user who has submitted a job before.

'''Please note''' that the <code>Number of hours</code> option is equivalent to "wall time". If you do not terminate the job before this limit is reached, Slurm will terminate the job for you.

Once you have defined the resources for your job, click "Launch" to be taken to a new page ([[#Inter |My Interactive Sessions]]). After a small delay, the page will refresh showing the status of the job that your app has scheduled. See [[#Inter |My Interactive Sessions]] section of the wiki for more information.

===<span id="X_Desktop"></span>X Desktop Session (A.K.A. The Interactive X login app)===
The "X Desktop Session on Sapelo2" is an interactive app that will start an X Desktop GUI session as a job. Launching the VNC session will connect you to an actual X desktop running on a Sapelo2 compute node, in your browser. This desktop is currently configured to run the XFCE lightweight graphical manager.

The Sapelo2 X desktop can be used for graphical applications that do not have a dedicated Open OnDemand interactive app. Please be aware that while it is possible within a Sapelo2 Desktop session to open a terminal, load a module, and run a graphical application, for example grace or gnuplot, some of the computing resources requested for this job would be used by the desktop itself. If you find that you have an application that you do this with regularly, please consider opening a ticket with GACRC requesting an interactive app.

====Copy/Paste in VNC====
If launching an interactive session in the portal, there are a few extra steps that need to be taken. Please reference the media below, or the summary of steps below that for more information.

#Open the toolbar on the left of the screen and select "Clipboard".
#If you want to paste text from your host computer to the remote session, paste the text in the clipboard box. You can then use the middle-mouse button (MMB) to paste it in your terminal.
#If you want to copy text from the remote session to your host computer's clipboard, simply highlight the text in the terminal. It will appear in the Clipboard toolbar pop-out where you can copy it to your host clipboard.

[[#top|Back to Top]]

==<span id="Inter"></span>My Interactive Sessions==

The last item in Open OnDemand top menu bar is "My Interactive Sessions". This interface will list your current and recent interactive app sessions.

[[File:Interactive Session Example.png|frameless|693x693px]]

'''Notable items:'''

*'''Host''': Click the name of the host to open a shell to the compute node that is running this job.
*'''Time Remaining''': This is how long the job will remain running before terminating. (Can be thought of as remaining wall time.)
*'''Session ID''': The unique ID of this session. Clicking the link will open a file app window to this Ondemand sessions working directory. (Useful for troubleshooting issues with application launch)
*'''Compression/Image Quality''': These sliders allow you to change the amount of graphical compression and quality of the VNC session. If you are on a particularly slow connection, or find that the 'redraw' time is slow, try lowering the Image Quality, increasing the Compression, or both, and relaunch the VNC window.
*'''Launch Button''': This button will open a new tab with the web based VNC viewer application. Closing the VNC window will NOT terminate the job, only the VNC connection to it. You may return at any time (as long as the job has time remaining) and click the Launch button to reconnect to your session.
*'''View Only''': This will open a new web based VNC viewer application just like the Launch button, with the caveat that no user input is allowed. You can then copy the URL for this window and send it to others, who will be able to view the VNC session, but not interact with it. (e.g. move the mouse, etc) (This is a great function if you want to show multiple people something in a controlled session!)
*'''Delete''': This button will terminate the job, and delete the session.

[[#top|Back to Top]]

=Additional Notes=

==Interactive applications and GPUs (Hardware accelerated rendering)==
Sapelo2 is currently not configured for applications to use hardware GPU for accelerated graphical rendering. This is currently on our "To Do" list.

Requesting a GPU for an interactive application will assign a GPU to the job just as it would requesting one from a normal command line submit script, but the Xserver will not use this GPU for graphical acceleration. (e.g. you can still use the GPU for computation, but it will not accelerate your frame rate.)

==Per-User Experience==
OnDemand will spawn a Per User Nginx session upon successful login. This means that each connection on the OOD server is running as that particular user. Each session is completely separated from other users sessions.

==Troubleshooting==

For any assistance with Open OnDemand, please reach out to us in via the "General Support" form of the "For Users" section at help.gacrc.uga.edu.

[[#top|Back to Top]]

OnDemand

2021-09-21T19:43:02Z

Bcarpenter: /* Additional Notes */

= Open OnDemand (OOD) =

Open OnDemand ("OOD") is a web-based service provided by GACRC which provides users an alternative and/or complimentary method to access the HPC Clusters. It helps computational researchers and students efficiently utilize remote computing resources by making them easy to access from any device, via a convenient web interface. Through Open OnDemand, graphical applications can be utilized on the cluster far more easily and smoothly than using X11 Forwarding. It also helps computer center staff support a wide range of clients by simplifying the user interface and experience.

OOD Features:

* Job submission and monitoring
* File transfer and management
* File editing
* Shell access
* Graphical Desktop on the cluster
* Interactive Applications

{| class="wikitable"
|+Open OnDemand Integration with GACRC Clusters
!Cluster
!Phase
!URL
|-
|Sapelo2
|Beta Testing
|https://ondemand.gacrc.uga.edu
|-
|Teach
|Future
|N/A
|}

----
[[#top|Back to Top]]

= How to access Open OnDemand =

'''In order to access the GACRC OOD login page, You must be connected to the UGA Network, either directly or by [https://eits.uga.edu/access_and_security/infosec/tools/vpn/ VPN].'''

'''Logging in requires a [https://wiki.gacrc.uga.edu/wiki/User_Accounts GACRC Cluster Account].'''

'''GACRC OOD uses UGA Single Sign-On Service (SSO) for authentication.'''

# Open a web browser to the cluster's Open OnDemand UR: https://ondemand.gacrc.uga.edu
# Login with your UGA MyID credentials
===Browser Requirements/Notes===
To have the best experience using OnDemand, GACRC recommends using the latest version of '''Google Chrome, Mozilla Firefox,''' or '''Microsoft Edge'''. Any modern browser that supports ECMAScript 2016 ''should'' work, but GACRC will not support it.

==== Individual browser notes: ====

* Google Chrome is currently the ''only'' web browser that natively supports the copy and paste functionality in <code>noVNC</code>. Other browsers can do copy and pasting manually through the <code>noVNC</code> tool drawer.

* Safari users '''''may''''' have issues when using the Shell App or <code>noVNC</code>. If you have issues, make sure your application is up-to-date.
* Internet Explorer 11 is '''NOT''' supported.

----
[[#top|Back to Top]]

= Using Open OnDemand =

Upon logging into Open OnDemand, all of its tools can be accessed via the links in the top menu bar.

[[File: Oodheader.png| OOD Menu Bar]]



== Files ==

Clicking "Files" in the top menu bar will open a drop menu that displays yours and your lab's directories on the cluster. Clicking any of those displayed directories will take you to a new page that allows you to manage the directories contents, as well as navigate to other directories on the cluster to which you have access. In this file browsing interface, there is a menu above the file browsing area that allows you to:

*Open an interactive shell in the current directory
*Create a new file
*Create a new directory
*Upload files
*Download files
*Copy/move files
*Delete files

[[File:Oodfiles2.png |900px]]

Clicking on a directory will navigate the OOD file browser to that directory. Clicking on a text file will open a new read-only window, displaying the file. If you would like to edit a file from within OOD, click the three-vertical-dots button to the right of a file name, and then click "Edit". This will open a new tab that allows you to edit and save changes to a file. The OOD file editor has a plethora of different syntax highlighting options. If the file you're editing has a file extension in its name for which OOD has syntax highlighting, it will pre-select that option, however you can change the syntax highlighting by selecting a different option from the "Mode" drop down menu at the top. Additionally in the top menu of the OOD file editor, you can change the font size, as well as select a different display theme.

=== File Transfer Limitations ===

==== Copy and Moving files: ====
When it comes to copying and moving files within the cluster, it is recommended that you only use OOD for smaller files. For anything else, please use the [[Transferring Files|transfer nodes]]. This is due to the OOD server acting as a "man-in-the-middle" for transferring files between the different file systems. For example, if you move something from /home to /scratch, in the background the file first has to be transferred to a temporary storage on the OOD server, before is is then transferred to the destination.

==== Uploading files: ====
GACRC '''highly''' recommends using the [[Transferring Files|transfer nodes]] for larger file transfers. If you must use OOD for large file transfers, please be aware there is a hard-limit in place of ~10.0 Gib. GACRC reserves the right to lower this limit in the future.

[[#top|Back to Top]]

== Jobs ==

Clicking "Jobs" will open a drop down menu allowing you to navigate to "Active Jobs" or "Job Composer".

=== Active Jobs ===

In the Active Jobs interface, you're able to view information about your currently running jobs.

[[File:oodjobs2.png | 1200px]]

Clicking the arrow on the left will expand this interface displaying further information about the job, as seen below.

[[File:Oodjobs.png | 1200px]]

=== Job Composer ===

The Job Composer interface offers a convenient way to launch jobs from OOD with submission script templates.

[ Maybe rethink whether to document this at all. Large job output files could quickly fill up /home. Can get around this with --chdir. Maybe more trouble than it's worth ]

== Clusters ==

Clicking "Clusters" will open a drop down menu giving you an option to open a shell for the cluster in your browser, on one of the login nodes. In the top right of this interface you are able to select a different theme for your shell.

Please see the "Individual browser notes" section for possible limitations.

[[File:Oodcli1.png | 600 px]]

== Interactive Apps ==

== My Interactive Sessions ==
[[File:Interactive Session Example.png|frameless|693x693px]]

===== Notable items: =====

* '''Host''': Click the name of the host to open a shell to the compute node that is running this job.
* '''Time Remaining''': This is how long the job will remain running before terminating. (Can be thought of as remaining wall time.)
* '''Session ID''': The unique ID of this session. Clicking the link will open a file app window to this Ondemand sessions working directory. (Useful for troubleshooting issues with application launch)
* '''Compression/Image Quality''': These sliders allow you to change the amount of graphical compression and quality of the VNC session. If you are on a particularly slow connection, or find that the 'redraw' time is slow, try lowering the Image Quality, increasing the Compression, or both, and relaunch the VNC window.
* '''Launch Button''': This button will open a new tab with the web based VNC viewer application. Closing the VNC window will NOT terminate the job, only the VNC connection to it. You may return at any time (as long as the job has time remaining) and click the Launch button to reconnect to your session.
* '''View Only''': This will open a new web based VNC viewer application just like the Launch button, with the caveat that no user input is allowed. You can then copy the URL for this window and send it to others, who will be able to view the VNC session, but not interact with it. (e.g. move the mouse, etc) (This is a great function if you want to show multiple people something in a controlled session!)
* '''Delete''': This button will terminate the job, and delete the session.

== Additional Notes ==

=== Interactive applications and GPUs (Hardware accelerated rendering) ===
Sapelo2 is currently not configured for applications to use hardware GPU based accelerated rendering.

Requesting a GPU for an interactive application will assign a GPU to the job just as it would requesting one from a normal submit script. The X session will not use this GPU for graphical acceleration.

== Per User Experience ==
OnDemand will spawn a Per User Nginx session upon successful login. This means that each connection on the OOD server is running as that particular user. Each session is completely separated from other users sessions.

== Troubleshooting ==

File:Interactive Session Example.png

2021-09-21T19:23:39Z

Bcarpenter:

Interactive Session Example

OnDemand

2021-09-20T22:36:41Z

Bcarpenter: /* File Transfer Limitations */

= Open OnDemand (OOD) =

Open OnDemand ("OOD") is a web-based service provided by GACRC which provides users an alternative and/or complimentary method to access the HPC Clusters. It helps computational researchers and students efficiently utilize remote computing resources by making them easy to access from any device, via a convenient web interface. Through Open OnDemand, graphical applications can be utilized on the cluster far more easily and smoothly than using X11 Forwarding. It also helps computer center staff support a wide range of clients by simplifying the user interface and experience.

OOD Features:

* Job submission and monitoring
* File transfer and management
* File editing
* Shell access
* Graphical Desktop on the cluster
* Interactive Applications

{| class="wikitable"
|+Open OnDemand Integration with GACRC Clusters
!Cluster
!Phase
!URL
|-
|Sapelo2
|Beta Testing
|https://ondemand.gacrc.uga.edu
|-
|Teach
|Future
|N/A
|}

----
[[#top|Back to Top]]

= How to access Open OnDemand =

'''In order to access the GACRC OOD login page, You must be connected to the UGA Network, either directly or by [https://eits.uga.edu/access_and_security/infosec/tools/vpn/ VPN].'''

'''Logging in requires a [https://wiki.gacrc.uga.edu/wiki/User_Accounts GACRC Cluster Account].'''

'''GACRC OOD uses UGA Single Sign-On Service (SSO) for authentication.'''

# Open a web browser to the cluster's Open OnDemand UR: https://ondemand.gacrc.uga.edu
# Login with your UGA MyID credentials
===Browser Requirements/Notes===
To have the best experience using OnDemand, GACRC recommends using the latest version of '''Google Chrome, Mozilla Firefox,''' or '''Microsoft Edge'''. Any modern browser that supports ECMAScript 2016 ''should'' work, but GACRC will not support it.

==== Individual browser notes: ====

* Google Chrome is currently the ''only'' web browser that natively supports the copy and paste functionality in <code>noVNC</code>. Other browsers can do copy and pasting manually through the <code>noVNC</code> tool drawer.

* Safari users '''''may''''' have issues when using the Shell App or <code>noVNC</code>. If you have issues, make sure your application is up-to-date.
* Internet Explorer 11 is '''NOT''' supported.

----
[[#top|Back to Top]]

= Using Open OnDemand =

Upon logging into Open OnDemand, all of its tools can be accessed via the links in the top menu bar.

[[File: Oodheader.png| OOD Menu Bar]]



== Files ==

Clicking "Files" in the top menu bar will open a drop menu that displays yours and your lab's directories on the cluster. Clicking any of those displayed directories will take you to a new page that allows you to manage the directories contents, as well as navigate to other directories on the cluster to which you have access. In this file browsing interface, there is a menu above the file browsing area that allows you to:

*Open an interactive shell in the current directory
*Create a new file
*Create a new directory
*Upload files
*Download files
*Copy/move files
*Delete files

[[File:Oodfiles2.png |900px]]

Clicking on a directory will navigate the OOD file browser to that directory. Clicking on a text file will open a new read-only window, displaying the file. If you would like to edit a file from within OOD, click the three-vertical-dots button to the right of a file name, and then click "Edit". This will open a new tab that allows you to edit and save changes to a file. The OOD file editor has a plethora of different syntax highlighting options. If the file you're editing has a file extension in its name for which OOD has syntax highlighting, it will pre-select that option, however you can change the syntax highlighting by selecting a different option from the "Mode" drop down menu at the top. Additionally in the top menu of the OOD file editor, you can change the font size, as well as select a different display theme.

=== File Transfer Limitations ===

==== Copy and Moving files: ====
When it comes to copying and moving files within the cluster, it is recommended that you only use OOD for smaller files. For anything else, please use the [[Transferring Files|transfer nodes]]. This is due to the OOD server acting as a "man-in-the-middle" for transferring files between the different file systems. For example, if you move something from /home to /scratch, in the background the file first has to be transferred to a temporary storage on the OOD server, before is is then transferred to the destination.

==== Uploading files: ====
GACRC '''highly''' recommends using the [[Transferring Files|transfer nodes]] for larger file transfers. If you must use OOD for large file transfers, please be aware there is a hard-limit in place of ~10.0 Gib. GACRC reserves the right to lower this limit in the future.

[[#top|Back to Top]]

== Jobs ==

Clicking "Jobs" will open a drop down menu allowing you to navigate to "Active Jobs" or "Job Composer".

=== Active Jobs ===

In the Active Jobs interface, you're able to view information about your currently running jobs.

[[File:oodjobs2.png | 1200px]]

Clicking the arrow on the left will expand this interface displaying further information about the job, as seen below.

[[File:Oodjobs.png | 1200px]]

=== Job Composer ===

The Job Composer interface offers a convenient way to launch jobs from OOD with submission script templates.

== Clusters ==

Clicking "Clusters" will open a drop down menu giving you an option to open a shell for the cluster in your browser, on one of the login nodes. In the top right of this interface you are able to select a different theme for your shell.

[[File:Oodcli1.png | 600 px]]

== Interactive Apps ==

== My Interactive Sessions ==

= Additional Notes =

== Per User Experience ==
OnDemand will spawn a Per User Nginx session upon successful login. This means that each connection on the OOD server is running as that particular user. Each session is completely separated from other users sessions.

== Troubleshooting ==

OnDemand

2021-08-23T20:49:55Z

Bcarpenter:

== Open OnDemand ('''OOD''') ==
Open OnDemand is a web-based service provided by GACRC which provides users an alternative and/or complimentary method to access the HPC Clusters.

* It helps computational researchers and students efficiently utilize remote computing resources by making them easy to access from any device.
* It helps computer center staff support a wide range of clients by simplifying the user interface and experience.

''Throughout this documentation, the Open OnDemand application may be referenced by the acronym "'''OOD'''".''
{| class="wikitable"
|+OnDemand Integration with Clusters
!Cluster
!Phase
!URL
|-
|Sapelo2
|Beta Testing
|https://ondemand.gacrc.uga.edu
|-
|Teach
|Future
|N/A
|}

== How to access OOD ==
'''''Note: You must be connected to the UGA Network, either directory or by VPN, to access the OOD web page.'''''

* Open a web browser to the URL: https://ondemand.gacrc.uga.edu
* Username will be your UGA MyID[[File:OOD Login Page Example.png|thumb|OOD Login Page Example]]

==== Browser Requirements/Notes ====
To have the best experience using OnDemand, use the latest versions of Google Chrome, Mozilla Firefox or Microsoft Edge. Use any modern browser that supports ECMAScript 2016.

Google Chrome has the widest range of support since the Shell App uses <code>hterm.js</code> which is supported officially by Google. Chrome currently is the only web browser that natively supports the copy and paste functionality in <code>noVNC</code>. Other browsers can do copy and pasting manually through the <code>noVNC</code> tool drawer.

Safari users ''may'' have issues when using the Shell App or <code>noVNC</code>.

There is no IE 11 support.

=== Per User Experience ===
OnDemand will spawn a Per User Nginx session upon successful login. This means that each connection on the OOD server is running as that particular user. Each session is completely separated from other users sessions.

== Main Page Layout ==
[[File:OOD-main-page.png|thumb|Example main page after login]]
After successful login, the main page will be displayed.

A list of the different sections of the main page:

* '''The Top Menu:''' See the individual documentation sections for each drop down: [[OOD Apps: Files|Files]], [[OOD Apps: Jobs|Jobs]], [[OOD Apps: Clusters|Clusters]], [[OOD Apps: Interactive|Interactive Apps]], [[OOD Apps: My Interactive Sessions|My Interactive Sessions]]
* '''Announcement Message:''' Shows important announcements only.
* '''Message of the Day:''' Shows recent updates or notices about the OnDemand Service
* '''Cluster Graphs:''' Shows Overall Node Utilization and Job Status on the cluster.

== Available Applications ==
The Files menu will list file locations that you have access to and OOD has been configured to display. 

Jobs

Clusters

Interactive Apps

My Interactive Sessions

[[File:Files dropdown.png|thumb]]
*

[[Category:OnDemand]]
{{DEFAULTSORT:OnDemand}}

OOD Apps: Files

2021-08-23T20:49:43Z

Bcarpenter: Created page with "OnDemand provides a web-based File Explorer that can be used to upload and download files to your OSC home directory or project directory, and copy, delete, rename, and edit f..."

OnDemand provides a web-based File Explorer that can be used to upload and download files to your OSC home directory or project directory, and copy, delete, rename, and edit files.

<s>Here is a tutorial video that gives a overview of OnDemand's file management client's capabilities and how to utilize them:</s>

<s>Here you can see a screen shot of what the main interface looks like.</s>

== Navigating ==

=== Selecting which File System ===
By default the first option in the Files application will launch with your home directory. If you have access to a project space or other directory, you can switch to those by utilizing the list on the left of the Files application. In addition, you can use the "Change Directory" option next to your current path, which will open an option type the path you wish to navigate to.

=== Switching Folders ===
On the left side of the screen is a tree view of the directory structure. You can navigate this tree the same way you might on a normal desktop GUI to select the folder you wish to use.

== Uploading and Downloading Files ==
There are several methods to upload files. The first is to simply navigate to the desired destination, and then drag the file from your local desktop or window navigator to the OnDemand window. You can also click the "Upload" button to open a dialog that will allow you to navigate your local computer and select which files you want to upload.

To download files, you must select the file or files you wish to download, and then use the "Download" button. If you select multiple files ("control+click" or "shift+click") or a folder, the server will zip the files up and download a single zip archive to your desktop machine.

== File Operations ==
Most file operations can be accomplished by selecting the checkbox next to the file in the main window pane and selecting the desired operation from the main menu.

=== Viewing and/or Editing a File ===
The application also includes several built-in file editors. To access these editors and viewers, select the file you wish to view or edit, and select "Edit" from the main menu. This will open up a text editor in a new tab.

OnDemand

2021-08-23T20:24:18Z

Bcarpenter: Basic page complete

== Open OnDemand ('''OOD''') ==
Open OnDemand is a web-based service provided by GACRC which provides users an alternative and/or complimentary method to access the HPC Clusters.

* It helps computational researchers and students efficiently utilize remote computing resources by making them easy to access from any device.
* It helps computer center staff support a wide range of clients by simplifying the user interface and experience.

''Throughout this documentation, the Open OnDemand application may be referenced by the acronym "'''OOD'''".''
{| class="wikitable"
|+OnDemand Integration with Clusters
!Cluster
!Phase
!URL
|-
|Sapelo2
|Beta Testing
|https://ondemand.gacrc.uga.edu
|-
|Teach
|Future
|N/A
|}

== How to access OOD ==
'''''Note: You must be connected to the UGA Network, either directory or by VPN, to access the OOD web page.'''''

* Open a web browser to the URL: https://ondemand.gacrc.uga.edu
* Username will be your UGA MyID[[File:OOD Login Page Example.png|thumb|OOD Login Page Example]]

==== Browser Requirements/Notes ====
To have the best experience using OnDemand, use the latest versions of Google Chrome, Mozilla Firefox or Microsoft Edge. Use any modern browser that supports ECMAScript 2016.

Google Chrome has the widest range of support since the Shell App uses <code>hterm.js</code> which is supported officially by Google. Chrome currently is the only web browser that natively supports the copy and paste functionality in <code>noVNC</code>. Other browsers can do copy and pasting manually through the <code>noVNC</code> tool drawer.

Safari users ''may'' have issues when using the Shell App or <code>noVNC</code>.

There is no IE 11 support.

== Main Page Layout ==
[[File:OOD-main-page.png|thumb|Example main page after login]]
After successful login the main page will be displayed.

A list of the different sections of the main page:

* '''The Top Menu:''' See the individual documentation sections for each drop down: [[OOD Apps: Files|Files]], [[OOD Apps: Jobs|Jobs]], [[OOD Apps: Clusters|Clusters]], [[OOD Apps: Interactive|Interactive Apps]], [[OOD Apps: My Interactive Sessions|My Interactive Sessions]]
* '''Announcement Message:''' Shows important announcements only.
* '''Message of the Day:''' Shows recent updates or notices about the OnDemand Service
* '''Cluster Graphs:''' Shows Overall Node Utilization and Job Status on the cluster.
**

[[Category:OnDemand]]
{{DEFAULTSORT:OnDemand}}

OnDemand

2021-08-20T19:21:41Z

Bcarpenter: /* Open OnDemand (OOD) */

<big>'''''In Development!'''''</big>

== Open OnDemand ('''OOD''') ==
Open OnDemand is a web-based service provided by GACRC which provides users an alternative and/or complimentary method to access the HPC Clusters.

* It helps computational researchers and students efficiently utilize remote computing resources by making them easy to access from any device.
* It helps computer center staff support a wide range of clients by simplifying the user interface and experience.

''Throughout this documentation, the Open OnDemand application may be referenced by the acronym "'''OOD'''".''
{| class="wikitable"
|+OnDemand Integration with Clusters
!Cluster
!Phase
!URL
|-
|Sapelo2
|Beta Testing
|https://ondemand.gacrc.uga.edu
|-
|Teach
|Future
|N/A
|}

== How to access OOD ==
'''''Note: You must be connected to the UGA Network, either directory or by VPN, to access the OOD web page.'''''

* Open a web browser to the URL: https://ondemand.gacrc.uga.edu
* Username will be your UGA MyID[[File:OOD Login Page Example.png|thumb|OOD Login Page Example]]

==== Browser Requirements/Notes ====
To have the best experience using OnDemand, use the latest versions of Google Chrome, Mozilla Firefox or Microsoft Edge. Use any modern browser that supports ECMAScript 2016.

Google Chrome has the widest range of support since the Shell App uses <code>hterm.js</code> which is supported officially by Google. Chrome currently is the only web browser that natively supports the copy and paste functionality in <code>noVNC</code>. Other browsers can do copy and pasting manually through the <code>noVNC</code> tool drawer.

Safari users ''may'' have issues when using the Shell App or <code>noVNC</code>.

There is no IE 11 support.

== <TODO> ==

* Introduction to OOD
* How to access/connect
* Navigation and description of different apps
** File Manager
** Shell App
** Job Management
** Interactive Apps
**

[[Category:OnDemand]]
{{DEFAULTSORT:OnDemand}}

Georgia Advanced Computing Resource Center

2021-07-27T20:16:42Z

Bcarpenter: Status change

__NOTOC__
Welcome to the Georgia Advanced Computing Resource Center wiki. The information provided here is a supplement to the GACRC webpage. The GACRC online information resources include:

*[http://gacrc.uga.edu/ Web Site] – General overview
*[https://wiki.gacrc.uga.edu/ Wiki] – Software docs and how-to’s - "You Are Here"
*[https://kaltura.uga.edu/channel/GACRC/176125031 Kaltura] – Linux and HPC training videos









<div style="width=100%; margin:0; background:red; font-size:120%; font-weight:bold; border:1px solid #00CC33; text-align:left; color:white; padding:0.2em 0.4em;"> Current Status: <span style="color:black"> Offline </span></div>






<div style="width=100%; margin:0; background:#333333; font-size:120%; font-weight:bold; border:1px solid #f9f9f9; text-align:left; color:#eeeeee; padding:0.2em 0.4em;"> IMPORTANT NEWS </div>
The following is an important notice for all of our current users.






* ''' [[Upcoming Maintenance - July 27-28, 2021]]'''
* Sapelo2 Oct. 24-29, 2020 upgrade. Please refer to [[Sapelo2 changes after Oct.24 maintenance]] for more information.





<div style="width=100%; margin:0; background:#333333; font-size:120%; font-weight:bold; border:1px solid #f9f9f9; text-align:left; color:#eeeeee; padding:0.2em 0.4em;"> Getting Started </div>
Welcome to the Georgia Advanced Computing Resource Center at the University of Georgia. If you're new to the GACRC, start with these links to get acquainted with our resources.
* [[User Accounts]]
* [[Instructional Accounts]]
* [[Connecting]]
* [[Transferring Files]]
* [[Password | Changing your Password]]
* [[Frequently Asked Questions | FAQ]]
* [[Command List]]
* [[Getting Help]]
* [[Policies]]
* [[Consulting]]
* [[Training]]

<div style="width=100%; margin:0; background:#333333; font-size:120%; font-weight:bold; border:1px solid #f9f9f9; text-align:left; color:#eeeeee; padding:0.2em 0.4em;"> System Information </div>
Hardware information and operational procedures are described below.
* [[Systems]]
* [[Disk Storage]]
* [[Sapelo2 and Sapelo2 (old) comparison]]

<div style="width=100%; margin:0; background:#333333; font-size:120%; font-weight:bold; border:1px solid #f9f9f9; text-align:left; color:#eeeeee; padding:0.2em 0.4em;"> Job and Data Management </div>
Information on how to run jobs and data management.
* [[Running Jobs]]
* [[Monitoring Jobs]]
* [[Job Submission Partitions]]
* [[Sample Scripts | Sample Job Submission Scripts]]
* [[Migrating from Torque to Slurm]]
* [[Troubleshooting on Sapelo2]]
* [[Best Practices]]

<div style="width=100%; margin:0; background:#333333; font-size:120%; font-weight:bold; border:1px solid #f9f9f9; text-align:left; color:#eeeeee; padding:0.2em 0.4em;"> Software and Libraries </div>
Documentation for software applications, programming tools, and usage.
* [[Software]]
* [[Available Toolchains and Toolchain Compatibility]]
* [[Bioinformatics Databases]]
* [[OpenMP]]
* [[MPI | Message Passing Interface (MPI)]]
* [[Compilers]]
* [[GPU|GPU and CUDA Programming]]
* [[Installing Applications]]

OnDemand

2021-07-27T20:15:00Z

Bcarpenter:

<big>'''''In Development!'''''</big>

== Open OnDemand (OOD) ==
Open OnDemand is a web-based service provided by GACRC which provides users an alternative and/or complimentary method to access the HPC Clusters. ''Throughout documentation, the Open OnDemand application may be referenced by the acronym "'''OOD'''".''
{| class="wikitable"
|+OnDemand Integration with Clusters
!Cluster
!OOD Available?
!URL
|-
|Sapelo2
|Coming Soon
|https://ondemand.gacrc.uga.edu
|-
|Teach
|Future
|N/A
|}

== <TODO> ==

* Introduction to OOD
* How to access/connect
* Navigation and description of different apps
** File Manager
** Job Management
** Interactive Apps
**

[[Category:OnDemand]]
{{DEFAULTSORT:OnDemand}}

Open OnDemand

2021-07-27T18:45:27Z

Bcarpenter: Bcarpenter moved page Open OnDemand to OnDemand: Match category

#REDIRECT [[OnDemand]]

OnDemand

2021-07-27T18:45:27Z

Bcarpenter: Bcarpenter moved page Open OnDemand to OnDemand: Match category

In Development
[[Category:OnDemand]]
{{DEFAULTSORT:OnDemand}}

OnDemand

2021-07-27T18:44:27Z

Bcarpenter:

In Development
[[Category:OnDemand]]
{{DEFAULTSORT:OnDemand}}

OnDemand

2021-07-27T18:43:40Z

Bcarpenter: Add category for OnDemand

In Development
[[Category:OnDemand]]

User:Bcarpenter

2021-07-27T18:36:16Z

Bcarpenter:

[[File:20170222 112328.jpg|thumb]]
Nothing special here.

File:20170222 112328.jpg

2021-07-27T18:35:14Z

Bcarpenter:

Test

User:Bcarpenter

2021-07-27T18:10:59Z

Bcarpenter: Created page with "Nothing special here."

Nothing special here.

OnDemand

2021-07-19T18:44:04Z

Bcarpenter: Initial Page

In Developement

Sapelo2 and Sapelo2 (old) comparison

2020-09-02T23:01:19Z

Bcarpenter: Updated sap2test login node core count

[[Category:Sapelo2]]

Side-by-side comparison of Sapelo2 and the Slurm test cluster (Sap2test).

{| width="100%" border="1" cellspacing="0" cellpadding="2" align="center" class="wikitable sortable"
|-
! scope="col" class="unsortable" width="200px"|
! scope="col" class="unsortable" width="240px"| Sapelo2
! scope="col" class="unsortable" width="240px"| Sap2test
! scope="col" width="20px"|
|-

| Operating system || Centos 7.5 || Centos 7.8 || [[File:Up20.png|20px|link=#top]]
|-
| Queueing system || Torque 6.1.2, Moab 9.1.2 || Slurm 20.02.3 || [[File:Up20.png|20px|link=#top]]
|-
| Deployment system || Foreman || xCAT || [[File:Up20.png|20px|link=#top]]
|-
| Node and system configuration || Puppet || Puppet || [[File:Up20.png|20px|link=#top]]
|-
| Login node RAM || 128GB and 32GB || 32GB || [[File:Up20.png|20px|link=#top]]
|-
| Login node cores || one 24-core Intel, one 16-core Intel VM || two 16-core Intel VMs || [[File:Up20.png|20px|link=#top]]
|-
| Home directory || /home/MyID, NFS exported || same as on Sapelo2 || [[File:Up20.png|20px|link=#top]]
|-
| Scratch directory || /scratch/MyID, DDN Lustre || same as on Sapelo2 || [[File:Up20.png|20px|link=#top]]
|-
| Shared application path|| /usr/local/apps || /apps || [[File:Up20.png|20px|link=#top]]
|-
| Environment modules || LMOD 7.4.17 || LMOD 8.3.13 || [[File:Up20.png|20px|link=#top]]
|-
| Containers || Singularity || Singularity || [[File:Up20.png|20px|link=#top]]
|-
| User ssh access to job-running nodes|| Enabled || Enabled || [[File:Up20.png|20px|link=#top]]

|-
|}
[[#top|Back To Top]] [[File:Up20.png|20px|link=#top]]

Disk Storage

2018-06-05T19:22:22Z

Bcarpenter: /* Storage Architecture */

[[Category:Zcluster]][[Category:Storage]]

== Storage Overview ==

Network attached storage systems at the GACRC are tiered in three levels based on speed and capacity. Ranked in order of decreasing speed, the file systems are "scratch", "home", and "offline" storage. The home filesystem is the "landing zone" when users login, and the scratch filesystem is where jobs should be run. Scratch is considered temporary and files are not to be left on it long-term. The offline storage filesystem is where data that is currently being used should be stored when it is not being used on scratch.

Each compute node has local physical hard drives that the user can utilize as temporary storage, aka lscratch. The lscratch device is a very fast storage device compared to the network attached storage systems. The drawback is that the capacity is low and it cannot be accessed from outside the compute node. The data in lscratch is not backed up and it can be deleted anytime after the job on the compute node is finished.

For home and scratch directories, users are assigned the following quotas (maximum space allowed):
<pre>
zcluster
home= 100GB
scratch= 4TB
/lscratch= Limited by device size

sapelo
home= 100GB
scratch= Currently none
/lscratch= Limited by device size (Approx. 250GB)
</pre>
The offline storage filesystem is named "project" and is configured for use by lab groups, and by default, each lab group has a 1TB quota. Individual members of a lab group can create subdirectories under their lab's project directory. PI's of lab groups can request additional storage on project as needed. Please note that this storage is not meant for long-term (e.g., archive) storage of data. That type of storage is the responsibility of the user.

=== Storage Architecture ===

The home and scratch filesystems are mounted on the zcluster and the sapelo cluster as follows, using an example user 'jsmith' in a lab group 'abclab':
<pre>
zcluster-

home= /home/abclab/jsmith
scratch= /escratch4/jsmith/jsmith_Month_Day
lscratch= /lscratch/jsmith

sapelo-

home= /home/jsmith
scratch= /lustre1/jsmith
lscratch= /lscratch

Note that sapelo users already have a scratch directory. Users of the zcluster need to type

make_escratch

while on the login node (not interactive nodes) to create a scratch directory - the command will return the name of the directory.
</pre>

The project filesystem is not mounted on the compute nodes and cannot be accessed by running jobs. It is mounted on the zcluster login node, and on the file "copy" and "xfer" nodes. The copy and xfer nodes (discussed under [[Transferring Files | Transferring Files]]) are the preferred servers to use for copying and moving files between all of the filesystems, and to and from the outside world.

The project filesystem has a consistent mount point of:

/project/abclab

=== Auto Mounting Filesystems ===

Some filesystems are "auto mounted" when they are first accessed on a server. For the xfer nodes, this includes Sapelo home directories and the project filesystems. For the zcluster copy nodes, this includes the project filesystems. Sapelo interactive ("qlogin") nodes will mount a user's home directory when the qlogin happens.

=== Snapshots ===

Home directories are snapshotted. Snapshots are like backups in that they are read-only moment-in-time captures of files and directories which can be used to restore files that may have been accidentally deleted or overwritten.

Home directories on sapelo have snapshots taken once a day and maintained for 4 days, giving the user the ability to retrieve old files for up to 4 days after they have deleted them. On the zcluster, some home directories have snapshots taken once a day, and some have snapshots taken once every 2 days; these are maintained for 4 days.

Any directory on the /home filesystem contains a completely invisible directory named ".snapshot". This directory cannot be listed with ls or viewed by any program at all. Only the "cd" command can be used to enter this directory. Users of /home directories may retrieve files from these snapshots by using the "cd" command and copying files from the appropriate snapshot to any location they would like.

'''Note: ANY user, from any HOME directory can access the snapshots *from that directory* to restore files'''

Here is the example for zcluster:

<pre>
[cecombs@sites test]$ cd .snapshot
[cecombs@sites .snapshot]$ ls
2013.04.16.00.00.01.daily 2013.04.17.00.00.01.daily 2013.04.18.00.00.01.daily
[cecombs@sites .snapshot]$ cd 2013.04.18.00.00.01.daily/
[cecombs@sites 2013.04.18.00.00.01.daily]$ cp my-to-restore-file /home/rccstaff/cecombs/test
</pre>

For Sapelo, please send in a ticket for such request. It is a different procedure at backend.

=== Current Storage Systems ===

(1) Panasas ActiveStor 12 storage cluster with 133TB usable capacity, running PanFS parallel file system. Currently supporting the home filesystem on the zcluster

(1) Seagate (Xyratex) Lustre appliance with 480TB usable capacity. Currently supporting the scratch filesystem on sapelo

(3) Penguin IceBreakers storage chains running ZFS mounted through NFS for a total of 84TB usable capacity. Currently supporting home directories on sapelo

(2) Penguin IceBreakers storage chains running ZFS mounted through NFS for a total of 374TB usable capacity. This storage is used as an active project repository

(1) Penguin IceBreaker storage chains running ZFS mounted through NFS for a total of 142TB usable capacity. This storage is used as a backup resource for the home and project filesystems