查看中文

• What Is MindSpore Hub
  • Features
• Environment Requirements
  • System Requirements and Software Dependencies
• Installation
  • Installation from source code
  • Installation from pip command
  • Verification
• Quickstart
• Docs
• Community
  • Governance
  • Communication
• Contributing
• Release Notes
• License
• FAQ

What is MindSpore Hub

MindSpore Hub is a pre-trained model application tool of the MindSpore ecosystem, serving as a channel for model developers and application developers.

• Provide model developers with a convenient and fast channel for model release and submission.
• Provide application developers with high-quality pre-trained models, and complete the work of model migration to deployment quickly using model loading and fine-tuning APIs.

Current pre-trained models in MindSpore Hub mainly cover four mainstream task scenarios including image classification, object detection, semantic segmentation and recommendation. You can check more models in MindSpore Hub Website.

Features

• Flexible model loading： Access and experience pre-trained models quickly by searching models of interest on MindSpore Hub Website.
• Easy-to-use transfer learning: Achieve transfer learning in one step via MindSpore's flexbile interface.

Environment Requirements

System Requirements and Software Dependencies

Version	Operating System	Executable File Installation Dependencies	Source Code Compilation and Installation Dependencies
MindSpore Hub master	- Ubuntu 18.04 x86_64 - Ubuntu 18.04 aarch64 - EulerOS 2.8 aarch64 - EulerOS 2.5 x86_64	- Python 3.7.5 - MindSpore master - For details about other dependency items, see setup.py.	Same as the executable file installation dependencies.

• When the network is connected, dependency items in the setup.py file are automatically downloaded during .whl package installation. In other cases, you need to manually install dependency items.

Installation

The Hub depends on MindSprore because the Hub depends on the models repository of MindSpore. Please follow the table below and install the corresponding MindSpore verision from MindSpore download page.

MindSpore Hub	Branch	MindSpore
1.10.0	r1.10	1.10.0
1.9.0	r1.9	1.9.0
1.8.0	r1.8	1.8.0
1.6.0	r1.6	1.6.0
1.5.0	r1.5	1.5.0
1.4.0	r1.4	1.4.0
1.3.0	r1.3	1.3.0
1.2.0	r1.2	1.2.0
1.1.0	r1.1	1.2.0
1.0.1	r1.0.1	1.2.0
1.0.0	r1.0	1.2.0

Installation from source code

1. Download source code from Gitee.

   git clone https://gitee.com/mindspore/hub.git

2. Compile and install in MindSpore Hub directory.

   cd hub
   python setup.py install

Installation from pip command

Install MindSpore Hub using pip command. Please download whl package from MindSpore Hub download page.

pip install mindspore_hub-{version}-py3-none-any.whl

Verification

If you can successfully execute following command, then the installation is completed.

import mindspore_hub as mshub

Quickstart

See the Loading the Model from Hub to implement model loading and fine-tuning.

Docs

For more information about installation guide, tutorials and APIs, please check out the Loading the Model from Hub and Publishing Models using MindSpore Hub.

Community

As one part of MindSpore community, the following information in MindSpore Hub including governance, communication and contributing is consistent with the content in MindSpore community.

Governance

Check out how MindSpore Open Governance works.

Communication

• MindSpore Slack - Communication platform for developers.
• IRC channel at #mindspore (only for meeting minutes logging purpose)
• Video Conference：TBD
• Mailing-list：https://mailweb.mindspore.cn/postorius/lists

Contributing

Welcome contributions. See our Contributor Wiki for more details。

Release Notes

The release notes, see our RELEASE。

License

Apache License 2.0

FAQ

• What to do when SSL: CERTIFICATE_VERIFY_FAILED occurs? When you behind a proxy, it sometimes will have some ssl verification fail problems. You can add the certificate into system to fix this problem. The fastest method is to disable python's ssl verification. Before import mindspore_hub, please add the codes.

import ssl
ssl._create_default_https_context = ssl._create_unverified_context

import mindspore_hub as mshub
model = mshub.load("mindspore/1.6/googlenet_cifar10", num_classes=10)

• What to do when No module named src.* occurs? When you use mindspore_hub.load to load differenet model in the same process, because the model file path needs to be inserted into sys.path. Test results show that Python only looks for src.* in the first inserted path. It's no use to delete the first inserted path. To solve the problem, you can copy all model files to the working directory. The code is as follows:

# mindspore_hub_install_path/load.py
def _copy_all_file_to_target_path(path, target_path):
    if not os.path.exists(target_path):
        os.makedirs(target_path)
    path = os.path.realpath(path)
    target_path = os.path.realpath(target_path)
    for p in os.listdir(path):
        copy_path = os.path.join(path, p)
        target_dir = os.path.join(target_path, p)
        _delete_if_exist(target_dir)
        if os.path.isdir(copy_path):
            _copy_all_file_to_target_path(copy_path, target_dir)
        else:
            shutil.copy(copy_path, target_dir)

def _get_network_from_cache(name, path, *args, **kwargs):
    _copy_all_file_to_target_path(path, os.getcwd())
    config_path = os.path.join(os.getcwd(), HUB_CONFIG_FILE)
    if not os.path.exists(config_path):
        raise ValueError('{} not exists.'.format(config_path))
    ......

Note: Some files of the previous model may be replaced when the next model is loaded. However， necessary model files must exist during model training. Therefore, you must finish training the previous model before the next model loads.