Storage Setting

Storage Default Settings

You can get started quickly through docker or basic installation. Create a MinIO Storage with network access storage (NAS) settings with the default settings through the following command. For detailed storage settings such as distributed mode, refer to the corresponding document.

$ mkdir ~/shared
$ docker run -it -p 9000:9000 --restart always \
        -e "MINIO_ACCESS_KEY=minio" \
        -e "MINIO_SECRET_KEY=miniosecretkey" \
        -v ~/shared:/container/vol minio/minio \
        gateway nas /container/vol

StorageConfig

class matorage.StorageConfig(**kwargs)[source]

Storage connector configuration classes. For MinIO, see this page for more details.

Parameters
  • endpoint (string, require) – S3 object storage endpoint. or If use NAS setting, NAS folder path.

  • access_key (string, optional, defaults to None) – Access key for the object storage endpoint. (Optional if you need anonymous access).

  • secret_key (string, optional, defaults to None) – Secret key for the object storage endpoint. (Optional if you need anonymous access).

  • secure (boolean, optional, defaults to False) – Set this value to True to enable secure (HTTPS) access. (Optional defaults to False unlike the original MinIO).

Examples:

from matorage import StorageConfig
storage_config = StorageConfig(
    endpoint='127.0.0.1:9000',
    access_key='minio',
    secret_key='miniosecretkey'
)
get_datasets()[source]

Get all datasets from endpoint storage

Returns

dict type of item(dataset_name, additional, compressor, attributes)

Return type

list

get_models()[source]

Get all models from endpoint storage

Returns

dict type of item(model_name, additional, compressor, model)

Return type

list

get_optimizers()[source]

Get all optimizers from endpoint storage

Returns

dict type of item(model_name, additional, compressor, optimizer)

Return type

list