Network error while running make dev.provision command

[ChanWunsam]

Thanks for your great work! I am an programmer in China, and while I was setting up devstack, I received some strange errors what I couldn't find in any issues or other forums.

Executing Steps

While I execute the next five steps in Ubuntu 20.04.5 LTS with 8G memory:

1. download devstack

mkdir /open-edx
cd /open-edx
git clone [email protected]:openedx/devstack.git
cd /open-edx/devstack

2. download make and docker 20.10.21

sudo apt-get update
# make
sudo apt install make # 4.2.1
# docker
# 1. Set up the repository
sudo apt-get remove docker docker-engine docker.io containerd runc
sudo apt-get install \
    ca-certificates \
    curl \
    gnupg \
    lsb-release
sudo mkdir -p /etc/apt/keyrings
curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo gpg --dearmor -o /etc/apt/keyrings/docker.gpg
echo \
  "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.gpg] https://download.docker.com/linux/ubuntu \
  $(lsb_release -cs) stable" | sudo tee /etc/apt/sources.list.d/docker.list > /dev/null
# 2. Install Docker Engine
sudo apt-get install docker-ce docker-ce-cli containerd.io docker-compose-plugin
# 3. Install Docker Compose with old version
sudo apt-get install docker-compose # docker-compose **

3. download python3.8 and vitualenv

# python3.8
sudo apt install software-properties-common
sudo add-apt-repository ppa:deadsnakes/ppa
sudo apt install python3.8
ln -sf /usr/bin/python3.8 /usr/bin/python3 # softlink
ln -sf /usr/bin/python3.8 /usr/bin/python  # softlink
# vitualenv
sudo apt install pip # 21.2.1
pip install virtualenv

4. set up vitual env

cd /open-edx/devstack
virtualenv --python=python3.8 devstack_snapshot_venv -q
source devstack_snapshot_venv/bin/activate

5. setup devstack

make requirements
make dev.clone
make dev.pull
make dev.provision

What's the problem

While executing make dev.provision ，some problems would be shown under Provisioning lms... ：

......

Will provision the following:
   lms ecommerce discovery credentials e2e forum notes

......

MySQL ready.

......

MongoDB ready.

......

Provisioning lms...
+ ./provision-lms.sh
+ apps=(lms studio)
+ studio_port=18010
+ ./load-db.sh edxapp
Loading the edxapp database...
Finished loading the edxapp database!
+ ./load-db.sh edxapp_csmh
Loading the edxapp_csmh database...
Finished loading the edxapp_csmh database!
+ for app in "${apps[@]}"
+ docker-compose up -d lms
edx.devstack.elasticsearch710 is up-to-date
edx.devstack.opensearch12 is up-to-date
e74d6a00773c_edx.devstack.mysql57 is up-to-date
edx.devstack.mongo is up-to-date
edx.devstack.devpi is up-to-date
edx.devstack.memcached is up-to-date
edx.devstack.discovery is up-to-date
Recreating edx.devstack.forum ... done
edx.devstack.lms is up-to-date
+ for app in "${apps[@]}"
+ docker-compose up -d studio
edx.devstack.devpi is up-to-date
edx.devstack.opensearch12 is up-to-date
edx.devstack.elasticsearch710 is up-to-date
e74d6a00773c_edx.devstack.mysql57 is up-to-date
edx.devstack.memcached is up-to-date
edx.devstack.mongo is up-to-date
edx.devstack.discovery is up-to-date
edx.devstack.forum is up-to-date
edx.devstack.lms is up-to-date
edx.devstack.studio is up-to-date
+ docker-compose exec -T lms bash -e -c 'source /edx/app/edxapp/edxapp_env && cd /edx/app/edxapp/edx-platform && NO_PYTHON_UNINSTALL=1 paver install_prereqs'
/edx/app/edxapp/edxapp_env: line 13: manpath: command not found
---> pavelib.prereqs.install_prereqs
---> pavelib.prereqs.install_node_prereqs
Node prereqs unchanged, skipping...
---> pavelib.prereqs.install_python_prereqs
---> pavelib.prereqs.uninstall_python_packages
NO_PYTHON_UNINSTALL is set. No attempts will be made to uninstall old Python libs.
pip install -e .
Looking in indexes: http://edx.devstack.devpi:3141/root/pypi/+simple/, https://pypi.python.org/simple
Obtaining file:///edx/app/edxapp/edx-platform
Requirement already satisfied: setuptools in /edx/app/edxapp/venvs/edxapp/lib/python3.8/site-packages (from Open-edX==0.13) (65.6.0)
Installing collected packages: Open-edX
  Attempting uninstall: Open-edX
    Found existing installation: Open-edX 0.13
    Uninstalling Open-edX-0.13:
      Successfully uninstalled Open-edX-0.13
  Running setup.py develop for Open-edX
Successfully installed Open-edX-0.13
WARNING: You are using pip version 21.2.1; however, version 22.3.1 is available.

pip install -q --disable-pip-version-check --exists-action w -r requirements/edx/development.txt
  ERROR: Command errored out with exit status 128:
   command: git fetch -q --tags
       cwd: /edx/app/edxapp/venvs/edxapp/src/blockstore
  Complete output (1 lines):
  fatal: unable to access 'https://github.com/openedx/blockstore.git/': GnuTLS recv error (-110): The TLS connection was non-properly terminated.
  ----------------------------------------
WARNING: Discarding git+https://github.com/openedx/[email protected]#egg=blockstore==1.2.4. Command errored out with exit status 128: git fetch -q --tags Check the logs for full command output.
^Cmake[1]: *** [Makefile:220: impl-dev.provision] Error 1
Traceback (most recent call last):
  File "scripts/send_metrics.py", line 453, in <module>
    main(sys.argv[1:])
  File "scripts/send_metrics.py", line 435, in main
    conveyed_exit_code = do_wrap(action_args[0])
  File "scripts/send_metrics.py", line 279, in do_wrap
    subprocess_exit_code = run_target(make_target).returncode
  File "scripts/send_metrics.py", line 259, in run_target
    return subprocess.run(["make", "impl-%s" % make_target], check=False)
  File "/usr/lib/python3.8/subprocess.py", line 495, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
  File "/usr/lib/python3.8/subprocess.py", line 1020, in communicate
    self.wait()
  File "/usr/lib/python3.8/subprocess.py", line 1083, in wait
    return self._wait(timeout=timeout)
  File "/usr/lib/python3.8/subprocess.py", line 1806, in _wait
    (pid, sts) = self._try_wait(0)
  File "/usr/lib/python3.8/subprocess.py", line 1764, in _try_wait
    (pid, sts) = os.waitpid(self.pid, wait_flags)
KeyboardInterrupt

I guess there may be two reasons for above issue：

1. /edx/app/edxapp/edxapp_env: line 13: manpath: command not found . However, It's hard to read exapp_env in docker, and subsequent instructss were executed well, so this may be not important;
2. pip install -q --disable-pip-version-check --exists-action w -r requirements/edx/development.txt .

I guess the second one may be the main problem, but I don't sure whether it was a network problem, because I can execute pip install git+https://... right shown below.

sudo apt-get install python-mysql libmysqlclient-dev
pip install git+https://github.com/openedx/[email protected]#egg=blockstore==1.2.4

make dev.provision

and the same problems still existed:

......

pip install -q --disable-pip-version-check --exists-action w -r requirements/edx/development.txt
  ERROR: Command errored out with exit status 128:
   command: git fetch -q --tags
       cwd: /edx/app/edxapp/venvs/edxapp/src/blockstore
  Complete output (1 lines):
  fatal: unable to access 'https://github.com/openedx/blockstore.git/': GnuTLS recv error (-110): The TLS connection was non-properly terminated.
  ----------------------------------------
WARNING: Discarding git+https://github.com/openedx/[email protected]#egg=blockstore==1.2.4. Command errored out with exit status 128:

......