-
This site is deprecated and will be decommissioned shortly. For current information regarding HPC visit our new site: hpc.njit.edu
Difference between pages "ModulesOnLochness" and "NJHPCFEDAuriStorEval"
From NJIT-ARCS HPC Wiki
(Difference between pages)
(Importing text file) |
(Importing text file) |
||
| Line 1: | Line 1: | ||
| − | |||
| − | + | <strong>Objective</strong>: RU, MSU, NJIT technical staffs judge the value that AuriStorFS | |
| + | would likely bring to the NJHPCFED, and later to the Eastern Regional Research | ||
| + | Platform (ERRP). | ||
| − | + | If that value is considered sufficient, proceed with budgeting the purchase of AuriStorFS. | |
| − | + | <ol> | |
| + | <li>Go over in detail the items listed below</li> | ||
| + | <ul> | ||
| + | <li>Designed for wide area network </li> | ||
| + | <li>Single global namespace for all clients. All clients see exactly the same path and ACLs.</li> | ||
| + | <li>Clients for all platforms - Linux, MacOS X, Windows, others</li> | ||
| + | <li>Extremely efficient administration and applications distribution | ||
| + | <ul> | ||
| + | <li>Administration by any authorized Kerberos principal from any AFS client</li> | ||
| + | </ul> | ||
| + | <li>Long history of working well and reliably at many institutions and international corporations</li> | ||
| + | <li>No administrator intervention in making mount points available to all | ||
| + | clients, other than creating the mount point - a single command done from any AFS client</li> | ||
| + | <li>Volume : basic storage unit. Volumes work very well as specific-purpose containers, e.g., software, datasets, | ||
| + | web content, documentation)</li> | ||
| + | <li>Read-only replication of volumes</li> | ||
| + | <li>Scalability - number of clients, volumes, users are readily accommodated</li> | ||
| + | <li>Fine-grained ACLs [https://computing.cs.cmu.edu/help-support/afs-acls.html CMU doc]</li> | ||
| + | <ul> | ||
| + | <li>Directory</li> | ||
| + | <ul> | ||
| + | <li><strong>l</strong> (lookup) List the contents of a directory; does not allow the reading of files</li> | ||
| + | <li><strong>i</strong> (insert) Create new files in a directory or copy new files to a directory</li> | ||
| + | <li><strong>d</strong> (delete) Remove files and sub-directories from a directory</li> | ||
| + | <li><strong>a</strong> (administer) Change a directory's ACL. The owner of a directory can always change | ||
| + | the ACL of a directory and any subdirectories in that directory</li> | ||
| − | + | </ul> | |
| + | <li>File</li> | ||
| + | <ul> | ||
| + | <li><strong>r</strong> (read) Read the contents of any file in the directory</li> | ||
| + | <li><strong>w</strong> (write) Modify the contents of files in a directory and use chmod on them</li> | ||
| + | <li><strong>k</strong> (lock) Allows programs to lock files in a directory</li> | ||
| + | </ul> | ||
| + | <li>Groups of groups supported in AuriStorFS</li> | ||
| + | </ul> | ||
| + | <li>Machine-based ACLs</li> | ||
| + | <li>Native Kerberos integration</li> | ||
| + | <li>Simple enforcement of quotas</li> | ||
| + | <li>To make a volume available, mount it somewhere, using 1 or 2 commands. It then becomes | ||
| + | immediately visible to every client accessing the cell</li> | ||
| + | <li>Reconfigurations with no user impact; AFS client automatically discovers new configuration</li> | ||
| + | <ul> | ||
| + | <li>Move volumes to a different partition, on same or different file server</li> | ||
| + | <li>Change what volume is mounted at which mountpoint (new volume at existing path)</li> | ||
| + | </ul> | ||
| + | <li>On-line backup volumes</li> | ||
| + | <li>Client caching</li> | ||
| + | <ul> | ||
| + | <li>Software is downloaded to local disk, so is local when accessed</li> | ||
| + | </ul> | ||
| + | <li>Collaboration via cells across geographic regions</li> | ||
| + | </ul> | ||
| + | AuriStorFS (https://www.auristor.com/) is a commercial implementation of | ||
| + | OpenAFS with important enhancements in performance, security, capacities, | ||
| + | authorization, per-file ACLs, and administration relative to OpenAFS. | ||
| − | + | [https://www.auristor.com/filesystem/auristor-comparison Filesystem comparison] | |
| − | + | [https://indico.cern.ch/event/531810/contributions/2330922/attachments/1358122/2053923/Auristor_Fact_Sheet.pdf Fact sheet] | |
| − | < | + | <li>Location of database servers and file servers : TBD</li> |
| − | + | ||
| − | + | ||
| − | + | ||
| − | < | + | <li>Public cell - i.e., open to the Internet</li> |
| − | + | <ul> | |
| − | + | <li>Cell name : njhpcfed.rutgers.edu (?)</li> | |
| − | + | <li>Cell alias : njhf (?)</li> | |
| + | <ul> | ||
| + | <li>Instead of, e.g., <em>cd /afs/njhpcfed.rutgers.edu/...</em> : <strong><em>cd /afs/njhf/...</em></strong></li> | ||
| + | </ul> | ||
| + | <li>Path to everything in the njhpcfed.rutgers.edu cell : /afs/njhf/.....</li> | ||
| + | </ul> | ||
| − | </ | + | <li>Find out what startup service AuriStor provides for new cells</li> |
| − | + | <li>ARCS would be willing to provide guidance and technical help in the management of the njhpcfed.rutgers.edu cell</li> | |
| − | < | + | <li>Access various cells, e.g., /afs/grand.central.org, /afs/athena.mit.edu, /afs/cad.njit.edu, ...</li> |
| − | + | <ul> | |
| + | <li>Demonstrate some user and administrative interactions</li> | ||
| + | </ul> | ||
| + | <li>Use cases</li> | ||
| − | + | Works anywhere that "fopen" does, including all of: RW, RW+, R, sequential or random access (as opposed | |
| + | to http/https, which is RO sequential only). | ||
| − | < | + | <ul> |
| − | + | <li>Software</li> | |
| − | + | <li>Scripts</li> | |
| − | + | <li>Data repository</li> | |
| + | <li>Documentation </li> | ||
| + | <li>Web content</li> | ||
| + | </ul> | ||
| − | < | + | <li>AuriStor Licensing</li> |
| − | + | <ul> | |
| − | + | <li>Basic : $21,000/cell/yr</li> | |
| − | + | <ul> | |
| + | <li> Security and bug fixes, support for current operating systems, new | ||
| + | features as they become available, and technical support</li> | ||
| + | <li> Unlimited AuriStor client software for all supported platforms</li> | ||
| + | <li> Unlimited support via email and web 9-5 M-F EST with 4-hour response time</li> | ||
| + | <li> 4 database servers</li> | ||
| + | <li> 4 file servers</li> | ||
| + | <li> 1000 user or machine IDs</li> | ||
| + | </ul> | ||
| + | |||
| + | <li>Optional</li> | ||
| + | <ul> | ||
| + | <li>Additional database server or file server : $2,500/server/yr</li> | ||
| + | <li>On-site consultant : $1.500 for 8 hours, plus travel and hotel</li> | ||
| + | </ul> | ||
| + | </ul> | ||
| − | < | + | <li>Database and file servers hosting and cost</li> |
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | TBD | |
| − | + | </ol> | |
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | </ | + | |
Latest revision as of 16:34, 5 October 2020
Objective: RU, MSU, NJIT technical staffs judge the value that AuriStorFS would likely bring to the NJHPCFED, and later to the Eastern Regional Research Platform (ERRP).
If that value is considered sufficient, proceed with budgeting the purchase of AuriStorFS.
- Go over in detail the items listed below
- Designed for wide area network
- Single global namespace for all clients. All clients see exactly the same path and ACLs.
- Clients for all platforms - Linux, MacOS X, Windows, others
- Extremely efficient administration and applications distribution
- Administration by any authorized Kerberos principal from any AFS client
- Long history of working well and reliably at many institutions and international corporations
- No administrator intervention in making mount points available to all clients, other than creating the mount point - a single command done from any AFS client
- Volume : basic storage unit. Volumes work very well as specific-purpose containers, e.g., software, datasets, web content, documentation)
- Read-only replication of volumes
- Scalability - number of clients, volumes, users are readily accommodated
- Fine-grained ACLs CMU doc
- Directory
- l (lookup) List the contents of a directory; does not allow the reading of files
- i (insert) Create new files in a directory or copy new files to a directory
- d (delete) Remove files and sub-directories from a directory
- a (administer) Change a directory's ACL. The owner of a directory can always change the ACL of a directory and any subdirectories in that directory
- File
- r (read) Read the contents of any file in the directory
- w (write) Modify the contents of files in a directory and use chmod on them
- k (lock) Allows programs to lock files in a directory
- Groups of groups supported in AuriStorFS
- Machine-based ACLs
- Native Kerberos integration
- Simple enforcement of quotas
- To make a volume available, mount it somewhere, using 1 or 2 commands. It then becomes immediately visible to every client accessing the cell
- Reconfigurations with no user impact; AFS client automatically discovers new configuration
- Move volumes to a different partition, on same or different file server
- Change what volume is mounted at which mountpoint (new volume at existing path)
- On-line backup volumes
- Client caching
- Software is downloaded to local disk, so is local when accessed
- Collaboration via cells across geographic regions
- Location of database servers and file servers : TBD
- Public cell - i.e., open to the Internet
- Cell name : njhpcfed.rutgers.edu (?)
- Cell alias : njhf (?)
- Instead of, e.g., cd /afs/njhpcfed.rutgers.edu/... : cd /afs/njhf/...
- Path to everything in the njhpcfed.rutgers.edu cell : /afs/njhf/.....
- Find out what startup service AuriStor provides for new cells
- ARCS would be willing to provide guidance and technical help in the management of the njhpcfed.rutgers.edu cell
- Access various cells, e.g., /afs/grand.central.org, /afs/athena.mit.edu, /afs/cad.njit.edu, ...
- Demonstrate some user and administrative interactions
- Use cases
- Software
- Scripts
- Data repository
- Documentation
- Web content
- AuriStor Licensing
- Basic : $21,000/cell/yr
- Security and bug fixes, support for current operating systems, new features as they become available, and technical support
- Unlimited AuriStor client software for all supported platforms
- Unlimited support via email and web 9-5 M-F EST with 4-hour response time
- 4 database servers
- 4 file servers
- 1000 user or machine IDs
- Optional
- Additional database server or file server : $2,500/server/yr
- On-site consultant : $1.500 for 8 hours, plus travel and hotel
- Database and file servers hosting and cost
AuriStorFS (https://www.auristor.com/) is a commercial implementation of OpenAFS with important enhancements in performance, security, capacities, authorization, per-file ACLs, and administration relative to OpenAFS.
Works anywhere that "fopen" does, including all of: RW, RW+, R, sequential or random access (as opposed to http/https, which is RO sequential only).
TBD
