Storage Setting¶
Storage Default Settings¶
You can get started quickly through docker or basic installation. Create a MinIO Storage with network access storage (NAS) settings with the default settings through the following command. For detailed storage settings such as distributed mode, refer to the corresponding document.
$ mkdir ~/shared
$ docker run -it -p 9000:9000 --restart always \
-e "MINIO_ACCESS_KEY=minio" \
-e "MINIO_SECRET_KEY=miniosecretkey" \
-v ~/shared:/container/vol minio/minio \
gateway nas /container/vol
StorageConfig¶
-
class
matorage.
StorageConfig
(**kwargs)[source]¶ Storage connector configuration classes. For MinIO, see this page for more details.
- Parameters
endpoint (
string
, require) – S3 object storage endpoint. or If use NAS setting, NAS folder path.access_key (
string
, optional, defaults to None) – Access key for the object storage endpoint. (Optional if you need anonymous access).secret_key (
string
, optional, defaults to None) – Secret key for the object storage endpoint. (Optional if you need anonymous access).secure (
boolean
, optional, defaults to False) – Set this value to True to enable secure (HTTPS) access. (Optional defaults to False unlike the original MinIO).
Examples:
from matorage import StorageConfig storage_config = StorageConfig( endpoint='127.0.0.1:9000', access_key='minio', secret_key='miniosecretkey' )
-
get_datasets
()[source]¶ Get all datasets from endpoint storage
- Returns
dict type of item(dataset_name, additional, compressor, attributes)
- Return type
list