|
|
| Line 1: |
Line 1: |
| | | | |
| − | <strong>Objective</strong>: RU, MSU, NJIT technical staffs judge the value that AuriStorFS | + | <p> |
| − | would likely bring to the NJHPCFED, and later to the Eastern Regional Research
| + | Hi David, |
| − | Platform (ERRP).
| + | </p> |
| | | | |
| − | If that value is considered sufficient, proceed with budgeting the purchase of AuriStorFS.
| + | <p> |
| | + | I'm partnering with our research computing colleagues at Yale on developing an |
| | + | NSF CC* Cyber Team project that aims to pair students with research computing projects |
| | + | they might be able to support for 4-6 months with a stipend. I'm looking around our |
| | + | area for researchers working on projects (or just ideas for projects) that may be |
| | + | a good fit for providing these stipend-supported students with experience in supporting |
| | + | a research computing project. |
| | + | </p> |
| | | | |
| − | <ol> | + | <p> |
| − | <li>Go over in detail the items listed below</li>
| + | In addition to the project-support experience, these students will receive formal |
| − | <ul>
| + | training in Linux, research computing, programming, software performance tuning, |
| − | <li>Designed for wide area network </li>
| + | machine learning, cloud services, etc. |
| − | <li>Single global namespace for all clients. All clients see exactly the same path and ACLs.</li>
| + | </p> |
| − | <li>Clients for all platforms - Linux, MacOS X, Windows, others</li>
| + | |
| − | <li>Extremely efficient administration and applications distribution
| + | |
| − | <ul>
| + | |
| − | <li>Administration by any authorized Kerberos principal from any AFS client</li>
| + | |
| − | </ul>
| + | |
| − | <li>Long history of working well and reliably at many institutions and international corporations</li>
| + | |
| − | <li>No administrator intervention in making mount points available to all
| + | |
| − | clients, other than creating the mount point - a single command done from any AFS client</li>
| + | |
| − | <li>Volume : basic storage unit. Volumes work very well as specific-purpose containers, e.g., software, datasets,
| + | |
| − | web content, documentation)</li>
| + | |
| − | <li>Read-only replication of volumes</li>
| + | |
| − | <li>Scalability - number of clients, volumes, users are readily accommodated</li>
| + | |
| − | <li>Fine-grained ACLs [https://computing.cs.cmu.edu/help-support/afs-acls.html CMU doc]</li>
| + | |
| − | <ul>
| + | |
| − | <li>Directory</li>
| + | |
| − | <ul>
| + | |
| − | <li><strong>l</strong> (lookup) List the contents of a directory; does not allow the reading of files</li>
| + | |
| − | <li><strong>i</strong> (insert) Create new files in a directory or copy new files to a directory</li>
| + | |
| − | <li><strong>d</strong> (delete) Remove files and sub-directories from a directory</li>
| + | |
| − | <li><strong>a</strong> (administer) Change a directory's ACL. The owner of a directory can always change
| + | |
| − | the ACL of a directory and any subdirectories in that directory</li>
| + | |
| | | | |
| − | </ul>
| + | <p> |
| − | <li>File</li>
| + | Do you know of any researchers at NJIT who may have a suitable student project and |
| − | <ul>
| + | who might be willing to provide a brief description + letter of support? |
| − | <li><strong>r</strong> (read) Read the contents of any file in the directory</li>
| + | </p> |
| − | <li><strong>w</strong> (write) Modify the contents of files in a directory and use chmod on them</li>
| + | |
| − | <li><strong>k</strong> (lock) Allows programs to lock files in a directory</li>
| + | |
| − | </ul>
| + | |
| − | <li>Groups of groups supported in AuriStorFS</li>
| + | |
| − | </ul>
| + | |
| − | <li>Machine-based ACLs</li>
| + | |
| − | <li>Native Kerberos integration</li>
| + | |
| − | <li>Simple enforcement of quotas</li>
| + | |
| − | <li>To make a volume available, mount it somewhere, using 1 or 2 commands. It then becomes
| + | |
| − | immediately visible to every client accessing the cell</li>
| + | |
| − | <li>Reconfigurations with no user impact; AFS client automatically discovers new configuration</li>
| + | |
| − | <ul>
| + | |
| − | <li>Move volumes to a different partition, on same or different file server</li>
| + | |
| − | <li>Change what volume is mounted at which mountpoint (new volume at existing path)</li>
| + | |
| − | </ul>
| + | |
| − | <li>On-line backup volumes</li>
| + | |
| − | <li>Client caching</li>
| + | |
| − | <ul>
| + | |
| − | <li>Software is downloaded to local disk, so is local when accessed</li>
| + | |
| − | </ul>
| + | |
| − | <li>Collaboration via cells across geographic regions</li>
| + | |
| − | </ul>
| + | |
| | | | |
| − | AuriStorFS (https://www.auristor.com/) is a commercial implementation of
| + | <p> |
| − | OpenAFS with important enhancements in performance, security, capacities,
| + | Thanks a lot!<br /> |
| − | authorization, per-file ACLs, and administration relative to OpenAFS.
| + | Galen |
| | + | </p> |
| | | | |
| − | [https://www.auristor.com/filesystem/auristor-comparison Filesystem comparison]
| + | <pre> |
| − | | + | Galen Collier, PhD |
| − | [https://indico.cern.ch/event/531810/contributions/2330922/attachments/1358122/2053923/Auristor_Fact_Sheet.pdf Fact sheet]
| + | Director, Research Support |
| − | | + | Office of Advanced Research Computing (OARC) |
| − | <li>Location of database servers and file servers : TBD</li> | + | Rutgers, The State University of New Jersey |
| − | | + | Busch Campus, CoRE Building, 96 Frelinghuysen Road, Room 621 |
| − | <li>Public cell - i.e., open to the Internet</li>
| + | Piscataway, NJ 08854 |
| − | <ul>
| + | mobile: 970.948.4858 |
| − | <li>Cell name : njhpcfed.rutgers.edu (?)</li>
| + | email: galen.collier@rutgers.edu |
| − | <li>Cell alias : njhf (?)</li>
| + | </pre> |
| − | <ul>
| + | [http://oarc.rutgers.edu OARC] |
| − | <li>Instead of, e.g., <em>cd /afs/njhpcfed.rutgers.edu/...</em> : <strong><em>cd /afs/njhf/...</em></strong></li>
| + | |
| − | </ul>
| + | |
| − | <li>Path to everything in the njhpcfed.rutgers.edu cell : /afs/njhf/.....</li>
| + | |
| − | </ul>
| + | |
| − | | + | |
| − | <li>Find out what startup service AuriStor provides for new cells</li>
| + | |
| − | | + | |
| − | <li>ARCS would be willing to provide guidance and technical help in the management of the njhpcfed.rutgers.edu cell</li>
| + | |
| − | | + | |
| − | <li>Access various cells, e.g., /afs/grand.central.org, /afs/athena.mit.edu, /afs/cad.njit.edu, ...</li>
| + | |
| − | <ul>
| + | |
| − | <li>Demonstrate some user and administrative interactions</li>
| + | |
| − | </ul>
| + | |
| − | <li>Use cases</li>
| + | |
| − | | + | |
| − | Works anywhere that "fopen" does, including all of: RW, RW+, R, sequential or random access (as opposed
| + | |
| − | to http/https, which is RO sequential only).
| + | |
| − | | + | |
| − | <ul>
| + | |
| − | <li>Software</li>
| + | |
| − | <li>Scripts</li>
| + | |
| − | <li>Data repository</li>
| + | |
| − | <li>Documentation </li>
| + | |
| − | <li>Web content</li>
| + | |
| − | </ul>
| + | |
| − | | + | |
| − | <li>AuriStor Licensing</li>
| + | |
| − | <ul>
| + | |
| − | <li>Basic : $21,000/cell/yr</li>
| + | |
| − | <ul>
| + | |
| − | <li> Security and bug fixes, support for current operating systems, new
| + | |
| − | features as they become available, and technical support</li>
| + | |
| − | <li> Unlimited AuriStor client software for all supported platforms</li>
| + | |
| − | <li> Unlimited support via email and web 9-5 M-F EST with 4-hour response time</li>
| + | |
| − | <li> 4 database servers</li>
| + | |
| − | <li> 4 file servers</li>
| + | |
| − | <li> 1000 user or machine IDs</li>
| + | |
| − | </ul>
| + | |
| − |
| + | |
| − | <li>Optional</li>
| + | |
| − | <ul>
| + | |
| − | <li>Additional database server or file server : $2,500/server/yr</li>
| + | |
| − | <li>On-site consultant : $1.500 for 8 hours, plus travel and hotel</li>
| + | |
| − | </ul>
| + | |
| − | </ul>
| + | |
| − | | + | |
| − | <li>Database and file servers hosting and cost</li>
| + | |
| − | | + | |
| − | TBD
| + | |
| − | </ol>
| + | |
I'm partnering with our research computing colleagues at Yale on developing an
NSF CC* Cyber Team project that aims to pair students with research computing projects
they might be able to support for 4-6 months with a stipend. I'm looking around our
area for researchers working on projects (or just ideas for projects) that may be
a good fit for providing these stipend-supported students with experience in supporting
a research computing project.
In addition to the project-support experience, these students will receive formal
training in Linux, research computing, programming, software performance tuning,
machine learning, cloud services, etc.
Do you know of any researchers at NJIT who may have a suitable student project and
who might be willing to provide a brief description + letter of support?
