StorageTable
From NJIT-ARCS HPC Wiki

Path | Typical use | Node visibility | Deploymenat hardware |
Backed up | Purged (files deleted) |
Total space on cluster, TB |
User cost | Distributed file system |
Underlying file system |
Performance characteristics |
---|---|---|---|---|---|---|---|---|---|---|
/scratch | Temporary files used during computations | Local to compute node only | PCI / SATA | Never | Frequently | 328 | None | No | EXT4 | High speed, best for frequent random-access I/O |
/nscratch | Temporary files used during computations | All cluster nodes | 1GigE | Never | Infrequently | 3.3 | None | Yes, cluster only | XFS | Medium speed, low usage contention, good serial I/O |
/home | Permanent storage, data or programs | All cluster nodes | 1GigE | Daily | When user account deleted | 7.9 | [1]Yes | Yes, cluster only | XFS | Medium speed, high usage contention, good serial I/O |
/afs/cad/... | Long term permanent storage | All nodes all clusters | 1GigE | Daily | When user AFS account deleted | 57 | [2]Yes | Yes, NJIT-wide | EXT4 | Low/medium speed, low usage contention, good for serial streaming read |
TBD | Parallel I/O data access | TBD, some nodes | TBD, InfiniBand? | Never | Never | TBD, 100? | TBD | Yes, cluster only | TBD | Extremely fast, suitable for parallel and random I/O tasks |