Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add the job script needed for the UIUC campus cluster. #800

Open
wants to merge 4 commits into
base: devel
Choose a base branch
from
Open

Add the job script needed for the UIUC campus cluster. #800

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
fb0f044
Add the job script needed for the UIUC campus cluster
Oct 12, 2023
65a21f2
update hpc.md to include UIUC campus cluster information
Oct 12, 2023
a0910e5
trying to fix render problem
Oct 12, 2023
f34123c
editing comments
Oct 12, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 23 additions & 0 deletions doc/content/hpc.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -206,3 +206,26 @@ export NEKRS_HOME=$HOME_DIRECTORY_SYM_LINK/cardinal/install
!listing-end!

!listing scripts/job_summit language=bash caption=Sample job script for Summit id=sum2

## UIUC Campus cluster

[UIUC](https://campuscluster.illinois.edu/)
is a cluster at the University of Illinois at Urbana-Champaign, it is designed to support up to 512 nodes with FDR InfiniBand for applications communications and data transport with a gigabit Ethernet control network. The disk system was selected to support expandability and the GPFS file system.

!listing! language=bash caption=Sample `~/.bashrc` for UIUC Campus cluster id=uiuc1
module purge
module load cmake/3.18.4
module load python
module unload gcc/7.2.0
module load openmpi/4.1.1-gcc-9.2.0


export CC=mpicc
export CXX=mpicxx
export FC=mpif90

# The location of Cardinal on the campus cluster is a shared folder for NOVAK lab
export NEKRS_HOME=/projects/eng/shared/ajnovak2/cardinal_update_moose/cardinal/install
!listing-end!

!listing scripts/job_uiuc.jobscript language=bash caption=Sample job script for UIUC Campus cluster id=uiuc2
39 changes: 39 additions & 0 deletions scripts/job_uiuc.jobscript
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
#!/bin/bash

# Usage:
# 1. Copy to the directory where you have your files
# 2. Update any needed environment variables and input file names in this script
# 3. sbatch job_uiuc.jobscript

#SBATCH --job-name="cardinal"
#SBATCH --output="cardinal-%j.out"
#SBATCH --partition=trial
#SBATCH --nodes=1
#SBATCH --ntasks-per-node=16
#SBATCH --mem=16G
#SBATCH --account=RFST
#SBATCH --export=ALL
#SBATCH -t 03:00:00

module purge
module load cmake/3.18.4
module load python
module unload gcc/7.2.0
module load openmpi/4.1.1-gcc-9.2.0

export CARDINAL_DIR=/projects/eng/shared/ajnovak2/cardinal
export OPENMC_CROSS_SECTIONS=/projects/eng/shared/ajnovak2/cross_sections/endfb-vii.1-hdf5/cross_sections.xml
export NEKRS_HOME=/projects/eng/shared/ajnovak2/cardinal/install

#run openmc
cd /projects/eng/shared/ajnovak2/cardinal/tutorials/lwr_solid/
rm logfile

srun -n 16 $CARDINAL_DIR/cardinal-opt -i openmc.i > logfile


#run NekRS
cd /projects/eng/shared/ajnovak2/cardinal/test/tests/cht/sfr_pincell/
rm logfile

srun -n 16 $CARDINAL_DIR/cardinal-opt -i nek_master.i > logfile