Georgia Advanced Computing Resource Center

Paul's List

• (DONE) root GECOS field edit
• (DONE) make /etc/resolv.conf like rcluster (otherwise has bogus 192.168 in there)
• (DONE) "mkdir -p /export/rocks/install/contrib/5.4.3/x86_64/RPMS.all"
• (DONE) add "plugins=1" to "main" section of /etc/yum.conf
• (DONE) register shead with UGA RHEL satellite
• (DONE) "yum install yum-downloadonly"
• (DONE) "yum update -y --downloadonly"
• (DONE) "yum -y update"; reboot
• (DONE) "mv /var/cache/yum/rhel-x86_64-server-5/packages/*rpm /export/rocks/install/contrib/5.4.3/x86_64/RPMS.all"
• (DONE) copy /etc/cron.daily/rpm.noversion from rcluster; run it by hand once
• (DONE) install these RHEL RPMs: nmap, dejagnu, gpm-devel, screen
• (DONE) "groupadd -g 1001 rccstaff"
• (DONE) "mkdir -p /usr/tools/bin /usr/tools/lib /usr/tools/sbin"
• (DONE) "chmod -R 0750 /usr/tools; chown -R root:rccstaff /usr/tools"
• (DONE) give shead a 172.16 IP address for storage
• (DONE) mount 3070 /usr/local on shead
• (DONE) "cd /usr/local; mkdir -p bin etc games include lib man sbin share src"
• (DONE) "mkdir -p /usr/local/share/info /usr/local/share/doc"
• (DONE) install novi rpm on zhead (make it first, if needed)
• (DONE) add 'storage' network to Rocks
• (DONE) change /etc/profile.d/ssh-key.sh to make it silent
• (DONE) add gx01-04 and all gxdNN entries to /etc/hosts.local
• (DONE) add "-s local" add to /etc/sysconfig/syslog SYSLOGD_OPTIONS
• (DONE) "rocks report host > /etc/hosts"
• (DONE) decide: choose GE distro which has NUMA "hwloc" support. Chose Son of GE for other reasons.
• (DONE) turn off NFS automounter and disable it
• (DONE) make a root email alias in /etc/aliases for appropriate staff; run "newaliases"
• (DONE) decide: do we want rsh turned on for nodes? no.
• (DONE) decide: install Oracle Java 6 or 7? 6.
• (DONE) decide: make newest kernel for PXE and node installs? apparently not.
• (DONE) what "newaliases" or "postalias" command does postfix need? "newaliases".
• (DONE) remove 'nisplus' from 'automount' and 'alias' /etc/nsswitch.conf lines
• (DONE) service sec-channel stop; chkconfig sec-channel off
• (DONE) service 411 stop; chkconfig 411 off
• (DONE) chkconfig rocks-dmesg off
• (DONE) yum install perl-IO-Zlib tclx-devel
• (DONE) yum remove bluez-libs
• (DONE) add WCOLL, FANOUT and PDSH_RCMD_TYPE variables to pdsh.sh, pdsh.csh

• use novi to populate /export/rocks/install/contrib/5.4.3/x86_64/RPMS from ..../RPMS.all dir
• "cd /export/rocks/install; rocks create distro"
• build and install that GE (turns out it's Son of Grid Engine)
• tweak /etc/profile, /etc/csh.login, /etc/csh.cshrc ala rcluster
• new dot files for skel
• decide: use GNU stow? Yes, when it helps.
• build new pdsh which lacks the pdcp bug that version 2.24 has
• make 32 and 64 bit libs match on hn, other nodes
• get most hn-only libs onto nodes and Rocks XML
• get GE init script onto nodes and into Rocks XML
• decide: what partitions, swap for compute nodes? (login too) (2 hrs to implement)
• decide: run memtest86+ on new nodes pre-go-live? (30 mins)
• decide: "modules" package? how otherwise to handle /etc/profile.d and PATH? ( 4 hrs )
• find or write an "interkill" (6 hrs)
• document how to use /usr/local/src, and how to build and install things (1 hr )
• learn how to extend lifetime of running GE jobs (4 hrs)
• configure BMC/DRACs ( mostly done; 2 hrs? )
• need to put 3070rep somewhere ( .5 hrs )
• mpi-selector in /etc/profile.d ( .5 hrs)
• set up PEs for GE
• decide: do we want the gxdNN IPs in DNS round-robin on headnode? ( 1 hr )
• decide: how to handle e.g. push_users, passwd command on zhead vs. zcluster.rcc (1 hr )
• implement OS backups by cron (.5 hrs)
• check for string "rcluster" in /usr/local/bin/*, /usr/tools/* ( .5 hrs )
• request firewall rules for shead like rcluster has ( 2 hrs )
• compute node: yum install yum-utils

• (POST) decide: how to handle nodes' PXE boot settings and reinstallations (see Rocks User Guide section 6).
• (POST) decide: make a separate Rocks network for IB IP addresses (rack 11)?
• (POST) compute node cron job so node can take self out of queue if problem
• (POST) configure IB on rack11 nodes under RHEL 5, maybe new Rocks appliance type
• (POST) learn how to submit rootly jobs into GE (updates, reboots)
• (POST) cd /export; hg clone http://fyp.rocksclusters.org/hg/rocks-5.4.3
• (much POST) get licenses for PGI compilers and Matlab for zhead

• (NA) decide: continue with pdsh, or use tentakel or "rocks run host"? It has them all!
• (NA) try to reduce used space in rcluster:/usr/local (and/or pcluster)
• (NA) decide: RHEL 5 ships w/gcc 4.1.2 as default. 4.4 is avail. as tech preview. Do we want it? Yes.
• (NA) build "checkinstall", install into /usr/tools, then make RPM of it and install RPM
• (NA) "mv /usr/local /usr/local.dist; mkdir /usr/local, chmod 0755 /usr/local"
• (NA) decide: which versions of perl, gcc, python to have as default?
• (NA) installed perl 5.14.1 and did "install Bundle::CPAN" and Bundle::LWP into /usr/local