-

This site is deprecated and will be decommissioned shortly. For current information regarding HPC visit our new site: hpc.njit.edu

ParallelFileSystem

From NJIT-ARCS HPC Wiki
Revision as of 21:55, 11 September 2021 by Hpcwiki1 dept.admin (Talk | contribs) (Importing text file)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

A parallel file system (PFS), also known as a clustered file system, is a type of storage system designed to store data across multiple networked servers.

These file systems provide cluster nodes with shared access to data in parallel. They enable high performance by allowing system architects to use various storage technologies and high-speed interconnects. PFS also can scale well as storage needs grow.

A PFS provides for concurrent access by multiple tasks of a parallel application to facilitate high-performance access through simultaneous, coordinated input/output operations between compute nodes and storage nodes.

A PFS breaks up a data set and distributes, or stripes, the blocks to multiple storage drives. Users do not need to know the physical location of the data blocks to retrieve a file. The system uses a global namespace to facilitate data access.