File System Purging - Revision history

Jerky at 22:03, 31 January 2019

2019-01-31T22:03:14Z

← Older revision		Revision as of 18:03, 31 January 2019
Line 1:		Line 1:
	==SCRATCH Filesystem==		==SCRATCH Filesystem==
	The SCRATCH filesystem (mounted under the /scratch directory) is subject to the 30-day file purge rule. Any file that has not been accessed in over 30 days will be purged. The purge process deletes files but not directories.		The SCRATCH filesystem (mounted under the /scratch directory) is subject to the 30-day file purge rule. Any file that has not been accessed in over 30 days will be purged. The purge process deletes files but not directories.

	In order to help users identify old files in their /scratch directory, we generate one file per user, every morning. This file, namely /usr/local/var/lustre_stats/$USER.over30d.files.lst (where $USER refers to the user's UGA MyID), contains a list of all the files that this user has in his/her /scratch directory and that have not been accessed in over 30 days. This file provides the full path, the last accessed date, and the size of the files that have not been accessed in over 30 days. Because the /scratch filesystem only updates on-disk file access times every 5 days, the last accessed time reported in that list file is approximate and could be off by up to 5 days. The purging system understands this and will make sure the access time falls within the purge window before deleting the file.		In order to help users identify old files in their /scratch directory, we generate one file per user, every morning. This file, namely /usr/local/var/lustre_stats/$USER.over30d.files.lst (where $USER refers to the user's UGA MyID), contains a list of all the files that this user has in his/her /scratch directory and that have not been accessed in over 30 days. This file provides the full path, the last accessed date, and the size of the files that have not been accessed in over 30 days. Because the /scratch filesystem only updates on-disk file access times every 5 days, the last accessed time reported in that list file is approximate and could be off by up to 5 days. The purging system understands this and will make sure the access time falls within the purge window before deleting the file.

Jerky at 22:02, 31 January 2019

2019-01-31T22:02:54Z

← Older revision		Revision as of 18:02, 31 January 2019
Line 1:		Line 1:
	==SCRATCH Filesystem==		==SCRATCH Filesystem==
	The SCRATCH filesystem (mounted under the /scratch directory) is subject to the 30-day file purge rule. Any file that has not been accessed in over 30 days will be purged. In order to help users identify old files in their /scratch directory, we generate one file per user, every morning. This file, namely /usr/local/var/lustre_stats/$USER.over30d.files.lst (where $USER refers to the user's UGA MyID), contains a list of all the files that this user has in his/her /scratch directory and that have not been accessed in over 30 days. This file provides the full path, the last accessed date, and the size of the files that have not been accessed in over 30 days. Because the /scratch filesystem only updates on-disk file access times every 5 days, the last accessed time reported in that list file is approximate and could be off by up to 5 days. The purging system understands this and will make sure the access time falls within the purge window before deleting the file.		The SCRATCH filesystem (mounted under the /scratch directory) is subject to the 30-day file purge rule. Any file that has not been accessed in over 30 days will be purged. The purge process deletes files but not directories.
	~~During the purge only files are deleted. Directories will be left alone. Please let us know if you have any questions~~.		In order to help users identify old files in their /scratch directory, we generate one file per user, every morning. This file, namely /usr/local/var/lustre_stats/$USER.over30d.files.lst (where $USER refers to the user's UGA MyID), contains a list of all the files that this user has in his/her /scratch directory and that have not been accessed in over 30 days. This file provides the full path, the last accessed date, and the size of the files that have not been accessed in over 30 days. Because the /scratch filesystem only updates on-disk file access times every 5 days, the last accessed time reported in that list file is approximate and could be off by up to 5 days. The purging system understands this and will make sure the access time falls within the purge window before deleting the file.

Jerky at 21:58, 31 January 2019

2019-01-31T21:58:52Z

← Older revision		Revision as of 17:58, 31 January 2019
Line 1:		Line 1:
	==SCRATCH Filesystem==		==SCRATCH Filesystem==
	The SCRATCH filesystem (mounted under the /scratch directory) is subject to the 30-day file purge rule. Any file that has not been accessed in over 30 days will be purged. In order to help users identify old files in their /scratch directory, we generate one file per user, every morning. This file, namely /usr/local/var/lustre_stats/$USER.over30d.files.lst (where $USER refers to the user's UGA MyID), contains a list of all the files that this user has in his/her /scratch directory and that have not been accessed in over 30 days. This file provides the full path, the last accessed date, and the size of the files that have not been accessed in over 30 days.~~The~~ /scratch filesystem updates ~~the~~ file access ~~time once in~~ 5 days~~. The~~ last accessed time in ~~the~~ file is approximate and could be off by up to 5 days. The purging system understands this and will make sure the access time falls within the purge window before deleting the file.		The SCRATCH filesystem (mounted under the /scratch directory) is subject to the 30-day file purge rule. Any file that has not been accessed in over 30 days will be purged. In order to help users identify old files in their /scratch directory, we generate one file per user, every morning. This file, namely /usr/local/var/lustre_stats/$USER.over30d.files.lst (where $USER refers to the user's UGA MyID), contains a list of all the files that this user has in his/her /scratch directory and that have not been accessed in over 30 days. This file provides the full path, the last accessed date, and the size of the files that have not been accessed in over 30 days. Because the /scratch filesystem only updates on-disk file access times every 5 days, the last accessed time reported in that list file is approximate and could be off by up to 5 days. The purging system understands this and will make sure the access time falls within the purge window before deleting the file.
	During the purge only files are deleted~~, the directories~~ will be left alone. Please let us know if you have any questions.		During the purge only files are deleted. Directories will be left alone. Please let us know if you have any questions.

Shtsai at 16:45, 31 January 2019

2019-01-31T16:45:34Z

← Older revision		Revision as of 12:45, 31 January 2019
Line 1:		Line 1:
	==SCRATCH Filesystem==		==SCRATCH Filesystem==
	The SCRATCH filesystem (mounted under the /scratch directory) is subject to the 30-day file purge rule. Any file that has not be accessed in over 30 days will be purged. In order to help users identify old files in their /scratch directory, we generate one file per user, every morning. This file, namely /usr/local/var/lustre_stats/$USER.over30d.files.lst (where $USER refers to the user's UGA MyID), contains a list of all the files that this user has in his/her /scratch directory and that have not been accessed in over 30 days. This file provides the full path, the last accessed date, and the size of the files that have not been accessed in over 30 days.The /scratch filesystem updates the file access time once in 5 days. The last accessed time in the file is approximate and could be off by up to 5 days. The purging system understands this and will make sure the access time falls within the purge window before deleting the file.		The SCRATCH filesystem (mounted under the /scratch directory) is subject to the 30-day file purge rule. Any file that has not been accessed in over 30 days will be purged. In order to help users identify old files in their /scratch directory, we generate one file per user, every morning. This file, namely /usr/local/var/lustre_stats/$USER.over30d.files.lst (where $USER refers to the user's UGA MyID), contains a list of all the files that this user has in his/her /scratch directory and that have not been accessed in over 30 days. This file provides the full path, the last accessed date, and the size of the files that have not been accessed in over 30 days.The /scratch filesystem updates the file access time once in 5 days. The last accessed time in the file is approximate and could be off by up to 5 days. The purging system understands this and will make sure the access time falls within the purge window before deleting the file.
	During the purge only files are deleted, the directories will be left alone. Please let us know if you have any questions.		During the purge only files are deleted, the directories will be left alone. Please let us know if you have any questions.

Shtsai at 16:45, 31 January 2019

2019-01-31T16:45:21Z

← Older revision		Revision as of 12:45, 31 January 2019
Line 1:		Line 1:
	==SCRATCH Filesystem==		==SCRATCH Filesystem==
	The SCRATCH filesystem (mounted under the /scratch directory) is subject to the 30-day file purge rule. Any file that has not be accessed in over ~~than~~ 30 days will be purged. In order to help users identify old files in their /scratch directory, we generate one file per user, every morning. This file, namely /usr/local/var/lustre_stats/$USER.over30d.files.lst (where $USER refers to the user's UGA MyID), contains a list of all the files that this user has in his/her /scratch directory and that have not been accessed in over 30 days. This file provides the full path, the last accessed date, and the size of the files that have not been accessed in over 30 days.The /scratch filesystem updates the file access time once in 5 days. The last accessed time in the file is approximate and could be off by up to 5 days. The purging system understands this and will make sure the access time falls within the purge window before deleting the file.		The SCRATCH filesystem (mounted under the /scratch directory) is subject to the 30-day file purge rule. Any file that has not be accessed in over 30 days will be purged. In order to help users identify old files in their /scratch directory, we generate one file per user, every morning. This file, namely /usr/local/var/lustre_stats/$USER.over30d.files.lst (where $USER refers to the user's UGA MyID), contains a list of all the files that this user has in his/her /scratch directory and that have not been accessed in over 30 days. This file provides the full path, the last accessed date, and the size of the files that have not been accessed in over 30 days.The /scratch filesystem updates the file access time once in 5 days. The last accessed time in the file is approximate and could be off by up to 5 days. The purging system understands this and will make sure the access time falls within the purge window before deleting the file.
	During the purge only files are deleted, the directories will be left alone. Please let us know if you have any questions.		During the purge only files are deleted, the directories will be left alone. Please let us know if you have any questions.

Shtsai at 16:44, 31 January 2019

2019-01-31T16:44:22Z

← Older revision		Revision as of 12:44, 31 January 2019
Line 1:		Line 1:
	==SCRATCH Filesystem==		==SCRATCH Filesystem==
	The SCRATCH filesystem (mounted under /scratch directory) is subject to the 30 day file purge rule. Any file that has not be accessed in over than 30 days will be purged. In order to help users identify old ~~file~~ we generate a file~~, one~~ per user, every morning. This file /usr/local/var/lustre_stats/$USER.over30d.files.lst contains a list of all the files that ~~haven't~~ been accessed in over 30 days. This file provides the full path, last accessed date and ~~file~~ size of the files.		The SCRATCH filesystem (mounted under the /scratch directory) is subject to the 30-day file purge rule. Any file that has not be accessed in over than 30 days will be purged. In order to help users identify old files in their /scratch directory, we generate one file per user, every morning. This file, namely /usr/local/var/lustre_stats/$USER.over30d.files.lst (where $USER refers to the user's UGA MyID), contains a list of all the files that this user has in his/her /scratch directory and that have not been accessed in over 30 days. This file provides the full path, the last accessed date, and the size of the files that have not been accessed in over 30 days.The /scratch filesystem updates the file access time once in 5 days. The last accessed time in the file is approximate and could be off by up to 5 days. The purging system understands this and will make sure the access time falls within the purge window before deleting the file.
	The filesystem updates the file access time once in 5 days. The last accessed time in the file is approximate and could be off by up to 5 days. The purging ~~systems~~ understands this and will make sure the access time falls within the purge window before deleting the file.
	During the purge only files are deleted, the directories will be left alone. Please let us know if you have any questions.		During the purge only files are deleted, the directories will be left alone. Please let us know if you have any questions.

Raj76: Created page with "==SCRATCH Filesystem== The SCRATCH filesystem (mounted under /scratch directory) is subject to the 30 day file purge rule. Any file that has not be accessed in over than 30 da..."

2019-01-28T21:33:10Z

Created page with "==SCRATCH Filesystem== The SCRATCH filesystem (mounted under /scratch directory) is subject to the 30 day file purge rule. Any file that has not be accessed in over than 30 da..."

New page

==SCRATCH Filesystem==
The SCRATCH filesystem (mounted under /scratch directory) is subject to the 30 day file purge rule. Any file that has not be accessed in over than 30 days will be purged. In order to help users identify old file we generate a file, one per user, every morning. This file /usr/local/var/lustre_stats/$USER.over30d.files.lst contains a list of all the files that haven't been accessed in over 30 days. This file provides the full path, last accessed date and file size of the files.
The filesystem updates the file access time once in 5 days. The last accessed time in the file is approximate and could be off by up to 5 days. The purging systems understands this and will make sure the access time falls within the purge window before deleting the file.
During the purge only files are deleted, the directories will be left alone. Please let us know if you have any questions.