Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add --noarch-build-subdir option #172

Open
wants to merge 10 commits into
base: master
Choose a base branch
from

Commits on Dec 3, 2020

  1. Add --noarch-build-subdir option

    It would be nice to know that we can still build noarch and noarch python on other
    OSes (well, except Windows at present). This allows that.
    
    Also, in combination with --output-dir it allows building locally as would happen on
    c3i. A sample script to glue this together is:
    
    ```
    
    set -e
    FS_STUB=$1
    
    __conda_setup="$(/opt/conda/bin/conda 'shell.bash' 'hook' 2> /dev/null)"
    if [ $? -eq 0 ]; then
        eval "$__conda_setup"
    fi
    
    if [[ $(uname) == Darwin ]]; then
      BUILD_SUBDIR=osx-64
    elif [[ $(uname) =~ M.* ]]; then
      BUILD_SUBDIR=win-64
    else
      BUILD_SUBDIR=linux-64
    fi
    
    mkdir /tmp/$$.c3i-locally
    pushd /tmp/$$.c3i-locally
      conda activate
      cp -rf /opt/r/a/$FS_STUB-feedstock .
      cp -f /opt/r/a/conda_build_config.yaml .
      c3i one-off rdonnelly.$FS_STUB  \
                  $FS_STUB-feedstock  \
                  --config-root-dir=/opt/asrc/automated-build/c3i_configurations/github_public  \
                  --dry-run  \
                  --output-dir $PWD  \
                  --noarch-build-subdir ${BUILD_SUBDIR}  \
                  --no-skip-existing
      mkdir rsync-recipes
      cp -rf *-on-* rsync-recipes/
      mkdir stats
      cmds=$(cat plan.yml | yq -r '.jobs[0].plan[] | select(.task=="build").config.run.args[1]')
      echo $cmds
      conda deactivate
      eval ${cmds}
    popd
    ```
    mingwandroid committed Dec 3, 2020
    Configuration menu
    Copy the full SHA
    ff58d77 View commit details
    Browse the repository at this point in the history
  2. Fix multiple recipe copy problem

    Ended up causing multiple builds inside of conda-build, one without the CBC file
    being considered (we ended up with a meta.yaml and also a recipe/meta.yaml because
    the cp -Rf fallback was incorrect).
    
    Most people wouldn't see this problem as it only happens when shutil.copytree()
    takes exception.
    mingwandroid committed Dec 3, 2020
    Configuration menu
    Copy the full SHA
    6f85bb7 View commit details
    Browse the repository at this point in the history
  3. [WIP] Begin implementing --build-on for one-off mode

    .. for local and docker build support. run_plan_yaml() does the work,
    at the moment, osx builds will get launched via subprocess.check_output()
    and gets called via submit_local()
    
    We need a job loop with dependencies instead and we need to hook this up
    to docker. Is there a good Python interface to docker?
    mingwandroid committed Dec 3, 2020
    Configuration menu
    Copy the full SHA
    fdbb798 View commit details
    Browse the repository at this point in the history
  4. Tidy ups

    mingwandroid committed Dec 3, 2020
    Configuration menu
    Copy the full SHA
    ccc6ef3 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    c5e4482 View commit details
    Browse the repository at this point in the history
  6. More stuff like this

    mingwandroid committed Dec 3, 2020
    Configuration menu
    Copy the full SHA
    9bb837f View commit details
    Browse the repository at this point in the history
  7. WIP

    mingwandroid committed Dec 3, 2020
    Configuration menu
    Copy the full SHA
    27e4daa View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    741c790 View commit details
    Browse the repository at this point in the history
  9. Fix cp fallback

    mingwandroid committed Dec 3, 2020
    Configuration menu
    Copy the full SHA
    5449224 View commit details
    Browse the repository at this point in the history
  10. missing import

    mingwandroid committed Dec 3, 2020
    Configuration menu
    Copy the full SHA
    06a581a View commit details
    Browse the repository at this point in the history