OnDemand: Difference between revisions

From Research Computing Center Wiki
Jump to navigation Jump to search
No edit summary
Line 44: Line 44:
To have the best experience using OnDemand, GACRC recommends using the latest version of '''Google Chrome, Mozilla Firefox,''' or '''Microsoft Edge'''.  Any modern browser that supports ECMAScript 2016 ''should'' work, but GACRC will not support it.   
To have the best experience using OnDemand, GACRC recommends using the latest version of '''Google Chrome, Mozilla Firefox,''' or '''Microsoft Edge'''.  Any modern browser that supports ECMAScript 2016 ''should'' work, but GACRC will not support it.   


==== Individual browser notes: ====
==== Individual browser notes ====


* Google Chrome is currently the ''only'' web browser that natively supports the copy and paste functionality in <code>noVNC</code>.  Other browsers can do copy and pasting manually through the <code>noVNC</code> tool drawer.   
* Google Chrome is currently the ''only'' web browser that natively supports the copy and paste functionality in <code>noVNC</code>.  Other browsers can do copy and pasting manually through the <code>noVNC</code> tool drawer.   
Line 107: Line 107:
=== Active Jobs ===
=== Active Jobs ===


In the Active Jobs interface, you're able to view information about your currently running jobs.
In the Active Jobs interface, you're able to view information about your currently running jobs.  Clicking the arrow on the left will expand this interface displaying further information about the job, as seen below.




[[File:oodjobs2.png | 1200px]]
[[File:oodjobs2.png | 1200px]] [[File:Oodjobs.png | 1200px]]


Clicking the arrow on the left will expand this interface displaying further information about the job, as seen below.
[[File:Oodjobs.png | 1200px]]
=== Job Composer ===
The Job Composer interface offers a convenient way to launch jobs from OOD with submission script templates.
[ Maybe rethink whether to document this at all.  Large job output files could quickly fill up /home.  Can get around this with --chdir.  Maybe more trouble than it's worth ]


== Clusters ==
== Clusters ==
Line 131: Line 122:


[[File:Oodcli1.png | 600 px]]
[[File:Oodcli1.png | 600 px]]


== Interactive Apps ==
== Interactive Apps ==
One of the best features of Open OnDemand is the ability to directly launch interactive graphical applications.  They can be accessed from the Open OnDemand home page or from the "Interactive Apps" in the top menu bar.
[[File:Ood-interactive-apps-3.png|600px]]
The list of interactive applications will grow over time.  Click the icon of the interactive application that you would like to use to be taken to a new page in which you define the resources allocated to interactive application .  Resources must be defined like this because an Open OnDemand interactive app is happening within the context of a Slurm job.  The Sapelo2 Desktop interactive app will open an actual desktop running on a Sapelo2 compute node, in your browser.  The applications listed under "GUIs" will will also be running on a Sapelo2 compute node, displayed in your browser.  If the GUI application you want to use has its own interactive app in Open OnDemand, you should use that.  While it is possible to within a Sapelo2 Desktop session to open a terminal, load a module, and run a graphical application, some of the computing resources you request for your job would be used by the desktop itself.  The Sapelo2 desktop can be used for graphical applications that do not have a dedicated Open OnDemand interactive app.


== My Interactive Sessions ==
== My Interactive Sessions ==
[[File:Interactive Session Example.png|frameless|693x693px]]
[[File:Interactive Session Example.png|frameless|693x693px]]


===== Notable items: =====
=== Notable items: ===


* '''Host''': Click the name of the host to open a shell to the compute node that is running this job.
* '''Host''': Click the name of the host to open a shell to the compute node that is running this job.
Line 147: Line 148:
* '''Delete''': This button will terminate the job, and delete the session.
* '''Delete''': This button will terminate the job, and delete the session.


== Additional Notes ==
= Additional Notes =


=== Interactive applications and GPUs (Hardware accelerated rendering) ===
== Interactive applications and GPUs (Hardware accelerated rendering) ==
Sapelo2 is currently not configured for applications to use hardware GPU based accelerated rendering.   
Sapelo2 is currently not configured for applications to use hardware GPU based accelerated rendering.   


Requesting a GPU for an interactive application will assign a GPU to the job just as it would requesting one from a normal submit script.  The X session will not use this GPU for graphical acceleration.
Requesting a GPU for an interactive application will assign a GPU to the job just as it would requesting one from a normal submit script.  The X session will not use this GPU for graphical acceleration.


== Per User Experience ==
== Per-User Experience ==
OnDemand will spawn a Per User Nginx session upon successful login.  This means that each connection on the OOD server is running as that particular user.  Each session is completely separated from other users sessions.
OnDemand will spawn a Per User Nginx session upon successful login.  This means that each connection on the OOD server is running as that particular user.  Each session is completely separated from other users sessions.


== Troubleshooting ==
== Troubleshooting ==

Revision as of 14:59, 27 September 2021

Open OnDemand (OOD)

Open OnDemand ("OOD") is a web-based service provided by GACRC which provides users an alternative and/or complimentary method to access the HPC Clusters. It helps computational researchers and students efficiently utilize remote computing resources by making them easy to access from any device, via a convenient web interface. Through Open OnDemand, graphical applications can be utilized on the cluster far more easily and smoothly than using X11 Forwarding. It also helps computer center staff support a wide range of clients by simplifying the user interface and experience.

OOD Features:

  • Job submission and monitoring
  • File transfer and management
  • File editing
  • Shell access
  • Graphical Desktop on the cluster
  • Interactive Applications
Open OnDemand Integration with GACRC Clusters
Cluster Phase URL
Sapelo2 Beta Testing https://ondemand.gacrc.uga.edu
Teach Future N/A



Back to Top

How to access Open OnDemand

In order to access the GACRC OOD login page, You must be connected to the UGA Network, either directly or by VPN.

Logging in requires a GACRC Cluster Account.

GACRC OOD uses UGA Single Sign-On Service (SSO) for authentication.

  1. Open a web browser to the cluster's Open OnDemand UR: https://ondemand.gacrc.uga.edu
  2. Login with your UGA MyID credentials

Browser Requirements/Notes

To have the best experience using OnDemand, GACRC recommends using the latest version of Google Chrome, Mozilla Firefox, or Microsoft Edge. Any modern browser that supports ECMAScript 2016 should work, but GACRC will not support it.

Individual browser notes

  • Google Chrome is currently the only web browser that natively supports the copy and paste functionality in noVNC. Other browsers can do copy and pasting manually through the noVNC tool drawer.
  • Safari users may have issues when using the Shell App or noVNC. If you have issues, make sure your application is up-to-date.
  • Internet Explorer 11 is NOT supported.



Back to Top

Using Open OnDemand

Upon logging into Open OnDemand, all of its tools can be accessed via the links in the top menu bar.


OOD Menu Bar


Files

Clicking "Files" in the top menu bar will open a drop menu that displays yours and your lab's directories on the cluster. Clicking any of those displayed directories will take you to a new page that allows you to manage the directories contents, as well as navigate to other directories on the cluster to which you have access. In this file browsing interface, there is a menu above the file browsing area that allows you to:

  • Open an interactive shell in the current directory
  • Create a new file
  • Create a new directory
  • Upload files
  • Download files
  • Copy/move files
  • Delete files


Oodfiles2.png


Clicking on a directory will navigate the OOD file browser to that directory. Clicking on a text file will open a new read-only window, displaying the file. If you would like to edit a file from within OOD, click the three-vertical-dots button to the right of a file name, and then click "Edit". This will open a new tab that allows you to edit and save changes to a file. The OOD file editor has a plethora of different syntax highlighting options. If the file you're editing has a file extension in its name for which OOD has syntax highlighting, it will pre-select that option, however you can change the syntax highlighting by selecting a different option from the "Mode" drop down menu at the top. Additionally in the top menu of the OOD file editor, you can change the font size, as well as select a different display theme.

File Transfer Limitations

Copy and Moving files:

When it comes to copying and moving files within the cluster, it is recommended that you only use OOD for smaller files. For anything else, please use the transfer nodes. This is due to the OOD server acting as a "man-in-the-middle" for transferring files between the different file systems. For example, if you move something from /home to /scratch, in the background the file first has to be transferred to a temporary storage on the OOD server, before is is then transferred to the destination.

Uploading files:

GACRC highly recommends using the transfer nodes for larger file transfers. If you must use OOD for large file transfers, please be aware there is a hard-limit in place of ~10.0 Gib. GACRC reserves the right to lower this limit in the future.


Back to Top

Jobs

Clicking "Jobs" will open a drop down menu allowing you to navigate to "Active Jobs" or "Job Composer".

Active Jobs

In the Active Jobs interface, you're able to view information about your currently running jobs. Clicking the arrow on the left will expand this interface displaying further information about the job, as seen below.


Oodjobs2.png Oodjobs.png


Clusters

Clicking "Clusters" will open a drop down menu giving you an option to open a shell for the cluster in your browser, on one of the login nodes. In the top right of this interface you are able to select a different theme for your shell.

Please see the "Individual browser notes" section for possible limitations.


Oodcli1.png


Interactive Apps

One of the best features of Open OnDemand is the ability to directly launch interactive graphical applications. They can be accessed from the Open OnDemand home page or from the "Interactive Apps" in the top menu bar.


Ood-interactive-apps-3.png


The list of interactive applications will grow over time. Click the icon of the interactive application that you would like to use to be taken to a new page in which you define the resources allocated to interactive application . Resources must be defined like this because an Open OnDemand interactive app is happening within the context of a Slurm job. The Sapelo2 Desktop interactive app will open an actual desktop running on a Sapelo2 compute node, in your browser. The applications listed under "GUIs" will will also be running on a Sapelo2 compute node, displayed in your browser. If the GUI application you want to use has its own interactive app in Open OnDemand, you should use that. While it is possible to within a Sapelo2 Desktop session to open a terminal, load a module, and run a graphical application, some of the computing resources you request for your job would be used by the desktop itself. The Sapelo2 desktop can be used for graphical applications that do not have a dedicated Open OnDemand interactive app.


My Interactive Sessions

Interactive Session Example.png

Notable items:

  • Host: Click the name of the host to open a shell to the compute node that is running this job.
  • Time Remaining: This is how long the job will remain running before terminating. (Can be thought of as remaining wall time.)
  • Session ID: The unique ID of this session. Clicking the link will open a file app window to this Ondemand sessions working directory. (Useful for troubleshooting issues with application launch)
  • Compression/Image Quality: These sliders allow you to change the amount of graphical compression and quality of the VNC session. If you are on a particularly slow connection, or find that the 'redraw' time is slow, try lowering the Image Quality, increasing the Compression, or both, and relaunch the VNC window.
  • Launch Button: This button will open a new tab with the web based VNC viewer application. Closing the VNC window will NOT terminate the job, only the VNC connection to it. You may return at any time (as long as the job has time remaining) and click the Launch button to reconnect to your session.
  • View Only: This will open a new web based VNC viewer application just like the Launch button, with the caveat that no user input is allowed. You can then copy the URL for this window and send it to others, who will be able to view the VNC session, but not interact with it. (e.g. move the mouse, etc) (This is a great function if you want to show multiple people something in a controlled session!)
  • Delete: This button will terminate the job, and delete the session.

Additional Notes

Interactive applications and GPUs (Hardware accelerated rendering)

Sapelo2 is currently not configured for applications to use hardware GPU based accelerated rendering.

Requesting a GPU for an interactive application will assign a GPU to the job just as it would requesting one from a normal submit script. The X session will not use this GPU for graphical acceleration.

Per-User Experience

OnDemand will spawn a Per User Nginx session upon successful login. This means that each connection on the OOD server is running as that particular user. Each session is completely separated from other users sessions.

Troubleshooting