IntroductionThe high-performance computing cluster at Case Western Reserve University is used by Red Hen faculty and students for various processing pipelines. Related resources
How to confirm installed binariesTo confirm that a particular utility is already installed, try 'which': Most common unix utilities are already present. If your starting point is a list of Debian packages and you don't know the name of the binary:
How to find and activate modulesA large number of packages are available as modules. To list the common available modules: $ module availFor an exhaustive list, $ module spiderTo load a module, To list loaded modules, A great deal of software is available either immediately or by loading a module. How to determine if a package is presentIf your starting point is a list of Debian packages, it may be helpful to do a Google search for the name of the Redhat rpm package. You may also want to know which version of Redhat you're installing for, so find the current version of the operating system installed on the Case HPC, issue Once you know the name of the package, do a search on the Case HPC to see if it's already installed: Alternatively, use yum to search for packages: Please document your installation process here. Installing GentleFrom Daniel Balagué via Sanjaya Gajurel, tweaked by Pete Broadwell:
This worked in December 2016. How to transfer files in bulkIf you need to transfer a large number of video files, we recommend this method: cat current_queue.txt | parallel --no-notice -j 8 rsync -av --relative --stats --human-readable username@cartago.vrnewsscape.ucla.edu:/sweep/{} /target/directory/ > /log/directory/rsync_Nov_2016.log The file
current_queue.txt looks like this: 2016/2016-11/2016-11-30/2016-11-30_2300_US_KNBC_The_Ellen_DeGeneres_Show.mp4 2016/2016-11/2016-11-30/2016-11-30_2300_US_KABC_Eyewitness_News_3PM.mp4 2016/2016-11/2016-11-30/2016-11-30_2300_US_FOX-News_Special_Report_With_Bret_Baier.mp4 2016/2016-11/2016-11-30/2016-11-30_2300_US_CNN_Situation_Room.mp4 2016/2016-11/2016-11-30/2016-11-30_2200_US_CNN_Situation_Room.mp4 2016/2016-11/2016-11-30/2016-11-30_2100_US_KTTV-FOX_The_Dr_Oz_Show.mp4 2016/2016-11/2016-11-30/2016-11-30_2100_US_CNN_The_Lead_With_Jake_Tapper.mp4 2016/2016-11/2016-11-30/2016-11-30_2000_US_KNBC_Access_Hollywood_Live.mp4 2016/2016-11/2016-11-30/2016-11-30_2000_US_KCAL_KCAL_9_News_at_12PM.mp4 |