StorageTable

From HPC Wiki
Jump to: navigation, search
Path Typical use Node visibility Deploymenat
hardware
Backed up Purged
(files deleted)
Total space on
cluster, TB
User cost Distributed
file system
Underlying
file system
Performance
characteristics
/scratch Temporary files used during computations Local to compute node only PCI / SATA Never Frequently 328 None No EXT4 High speed, best for frequent random-access I/O
/nscratch Temporary files used during computations All cluster nodes 1GigE Never Infrequently 3.3 None Yes, cluster only XFS Medium speed, low usage contention, good serial I/O
/home Permanent storage, data or programs All cluster nodes 1GigE Daily When user account deleted 7.9 [1]Yes Yes, cluster only XFS Medium speed, high usage contention, good serial I/O
/afs/cad/... Long term permanent storage All nodes all clusters 1GigE Daily When user AFS account deleted 57 [2]Yes Yes, NJIT-wide EXT4 Low/medium speed, low usage contention, good for serial streaming read
TBD Parallel I/O data access TBD, some nodes TBD, InfiniBand? Never Never TBD, 100? TBD Yes, cluster only TBD Extremely fast, suitable for parallel and random I/O tasks