s3fs-fuse

s3fs-fuse mounts your OSiRIS S3 buckets as a regular filesystem (File System in User Space - FUSE). Using it requires that your system have appropriate packages for FUSE installed: fuse, fuse-libs, or libfuse on Debian based distributions of linux.

On Mac OSX you can use Homebrew to install s3fs and the fuse dependency.

Detailed instructions for installation or compilation are available from the s3fs Github site:
https://github.com/s3fs-fuse/s3fs-fuse

s3fs-fuse does not require any dedicated S3 setup or data format. It can be used in combination with any other S3 compatible client.

The s3fs-fuse mount location must not be mounted on a Spectrum Scale (GPFS) mount, like /mnt/home on MSU’s HPCC.

OSiRIS s3fs bundle

Linux users have the option of using our s3fs bundle. The bundle includes s3fs packaged with AppImage so it will work on any Linux distribution. It also includes a setup script and wrapper script that passes all the correct parameters to s3fuse for mounting. The wrapper will automatically mount all of your buckets or allow you to specify a single one, and it can also create a new bucket for you.

The latest release is available for download from our Github site.

Example s3fs bundle usage:

Download the bundle:

curl -L --output osiris-bundle.tgz \
https://github.com/MI-OSiRIS/osiris-bundle/releases/latest/download/osiris-bundle.tgz

Untar into your home directory:

cd ~ && tar -xvzf osiris-bundle.tgz

Run the setup tool:

~/osiris-bundle/osiris-setup.dist

You will be prompted for your OSiRIS Virtual Organization (aka COU), an S3 userid, and S3 access key / secret. This information is available from OSiRIS COmanage. Look under your User Menu at the upper right for Ceph Credentials and My Profile to determine your credentials and COU.

Mount your buckets. If you have not created any the tool will create one for you:

~/osiris-bundle/osiris-mount

When you are finished unmount:

~/osiris-bundle/osiris-mount -u

Optionally you can specify a bucket and have it created:

~/osiris-bundle/osiris-mount -n mycou-anyname

Buckets should be all lowercase and must be prefixed with your COU (virtual organization) or the request will be denied.

Using s3fs-fuse

Using the OSiRIS bundle is not required to use s3fs-fuse. To setup and use manually:

Setup Credential File - s3fs-fuse can use the same credential format as AWS under ${HOME}/.aws/credentials. You can download a file in this format directly from OSiRIS COmanage or paste your credentials from COmanage into the file:
```
[default]
    aws_access_key_id = 82VA...
    aws_secret_access_key = 665WhlOM...
```
You can have multiple blocks with different names. They can be specified with the -o profile= option to s3fs. If no profile option is specified the 'default' block is used. The setup script in the OSiRIS bundle also will create this file based on your input.

Also be sure your credential file is only readable by you:
```
chmod 0600 ~/.aws/credentials
```
Create a bucket - You must have a bucket to mount. You can use any client to create a bucket. For example, if you have installed the awscli utility:
```
aws s3 --endpoint-url https://rgw.osris.org --profile=default mb s3://yourcou-newbucket
```
Please be sure to prefix your bucket names with the name of your OSiRIS virtual organization (lower case). This is also referred to as 'COU' in the COmanage interface. The AWSCLI utility uses the same credential file setup in the previous step. Other utilities such as s3cmd may require an additional credential file.
Mount your bucket - The following example mounts yourcou-newbucket at /tmp/s3-bucket. Unless you specify the -o allow_other option then only you will be able to access the mounted filesystem (be sure you are aware of the security implications if you allow_other - any user on the system can write to the S3 bucket in this case).
```
s3fs yourcou-newbucket /tmp/s3-bucket  \
    -o profile=default -o use_path_request_style \
    -o url="https://rgw.osris.org"
```
Buckets can also be mounted system wide with fstab. Generally in this case you'll choose to allow everyone to access the filesystem (allow_other) since it will be mounted as root. As noted, be aware of the security implications as there are no enforced restrictions based on file ownership, etc (because it is not really a POSIX filesystem underneath). There are nonetheless some workflows where this may be useful.
```
s3fs#BUCKET /path/to/mountpoint fuse _netdev,allow_other,use_path_request_style,profile=default,url=https://rgw.osris.org 0 0
```

Performance with s3fs-fuse

The following section will provide an overview of expected performance while utlizing a s3fs-fuse mount from the OSiRIS network. These figures are for a single client and reflect limitations of FUSE and the underlying HTTP based S3 protocol. OSiRIS can support large numbers of clients for a higher aggregate throughput.

Regular block size (1M), single thread

	Mean writes - 30MB/s
	Mean reads  - 65MB/s

Regular block size (1M), multi-threaded

	Mean writes - 40MB/s
	Mean reads  - 65MB/s

Small block size (4K), single thread

	Mean writes - 26MB/s
	Mean reads  - 55MB/s

Small block size (4K), multi-threaded

	Mean writes - 31MB/s
	Mean reads  - 55MB/s

References

More detailed instructions for using s3fs-fuse are available on the Github page: https://github.com/s3fs-fuse/s3fs-fuse

For a graphical interface to S3 storage you can use Cyberduck. You can use Cyberduck to create/list/delete buckets, transfer data, and work with bucket ACLs.

The Amazon AWS CLI tools can be used for bucket operations and to transfer data. S3fuse and the AWS util can use the same password credential file. You must use the proper parameters to point the tool at OSiRIS S3 instead of Amazon:
AWS CLI installation

The CLI tool ‘s3cmd’ can also be used to manage buckets, etc: OSiRIS Documentation on s3cmd

s3fs-fuse Using S3 Fuse to mount S3 storage

OSiRIS s3fs bundle

Example s3fs bundle usage:

Using s3fs-fuse

Performance with s3fs-fuse

References