Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature/ecs on ec2 auto scaling #15

Open
wants to merge 26 commits into
base: main
Choose a base branch
from
Open

Feature/ecs on ec2 auto scaling #15

wants to merge 26 commits into from

Commits on May 3, 2024

  1. misc: Update dependencies lock file

    @sashasimkin
    sashasimkin committed May 3, 2024
    Configuration menu
    Copy the full SHA
    e633ccf View commit details
    Browse the repository at this point in the history

  2. fix: Add required "squat analytics" variable for dev env

    @sashasimkin
    sashasimkin committed May 3, 2024
    Configuration menu
    Copy the full SHA
    28ec52f View commit details
    Browse the repository at this point in the history

  3. fix: Fix the code for "ECS on EC2" autoscaling group 

    Enable usage of Launch Template because AWS has deprecated Launch Configuration
Add missing capacity provider settings
Add stub resources for auto-scaling configuration

re. #14, stanfordnmbl/opencap-api#174
    @sashasimkin
    sashasimkin committed May 3, 2024
    Configuration menu
    Copy the full SHA
    b9e8b5e View commit details
    Browse the repository at this point in the history

  4. feat: Add autoscaling based on opencap_trials_pending for module/proc… 

    …essing

Even though the code is there - it's not functional yet because neither dev or prod have autoscaling enabled

re. #14, stanfordnmbl/opencap-api#174
    @sashasimkin
    sashasimkin committed May 3, 2024
    Configuration menu
    Copy the full SHA
    857f225 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. feat: Add IAM role for the ECS tasks running backend to allow instanc… 

    …e un-protection

re. #14
    @sashasimkin
    sashasimkin committed May 9, 2024
    Configuration menu
    Copy the full SHA
    8ed7190 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. fix conflicts

    @antoinefalisse
    antoinefalisse committed May 13, 2024
    Configuration menu
    Copy the full SHA
    6394200 View commit details
    Browse the repository at this point in the history

  2. fix: Use g5.2xlarge instances for processing workers 

    re. stanfordnmbl/opencap-api#174 (comment)
    @sashasimkin
    sashasimkin committed May 13, 2024
    Configuration menu
    Copy the full SHA
    0c06a31 View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. set settings for testing

    @antoinefalisse
    antoinefalisse committed May 15, 2024
    Configuration menu
    Copy the full SHA
    1fbe0e8 View commit details
    Browse the repository at this point in the history

  2. change settings

    @antoinefalisse
    antoinefalisse committed May 15, 2024
    Configuration menu
    Copy the full SHA
    dd4cb0b View commit details
    Browse the repository at this point in the history

  3. fix: LT security group

    @sashasimkin
    sashasimkin committed May 15, 2024
    Configuration menu
    Copy the full SHA
    7fea979 View commit details
    Browse the repository at this point in the history

  4. fix: ECS capacity providers

    @sashasimkin
    sashasimkin committed May 15, 2024
    Configuration menu
    Copy the full SHA
    3087c5b View commit details
    Browse the repository at this point in the history

  5. fixing minor bugs

    @antoinefalisse
    antoinefalisse committed May 15, 2024
    Configuration menu
    Copy the full SHA
    a4b5541 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. fix: More auto-scaling fixes

    @sashasimkin
    sashasimkin committed May 16, 2024
    Configuration menu
    Copy the full SHA
    98b05f0 View commit details
    Browse the repository at this point in the history

  2. misc: set max_size of dev ASG to 0

    @sashasimkin
    sashasimkin committed May 16, 2024
    Configuration menu
    Copy the full SHA
    c6758b5 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. add URL and TOKEN from dev

    @antoinefalisse
    antoinefalisse committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    483ac2c View commit details
    Browse the repository at this point in the history

  2. Merge pull request #16 from stanfordnmbl/feature/ecs-on-ec2-auto-scal… 

    …ing-updates

Add URL and TOKEN from dev
    @antoinefalisse
    antoinefalisse committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    aa237d2 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. add ECS_ENABLE_CONTAINER_METADATA to task definition

    @antoinefalisse
    antoinefalisse committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    b8f958c View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. bring alex changes

    @antoinefalisse
    antoinefalisse committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    3b322d2 View commit details
    Browse the repository at this point in the history

  2. remove mmpose related stuff

    @antoinefalisse
    antoinefalisse committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    c9380ff View commit details
    Browse the repository at this point in the history

  3. fix: Adjust memory reservation again 

    re. !17
    @sashasimkin
    sashasimkin committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    3fed558 View commit details
    Browse the repository at this point in the history

  4. fix: Lower ECS agent reservation 

    re. !17
    @sashasimkin
    sashasimkin committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    80da42c View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2024

  1. fix: Update auto-scaling formula 

    Now the scaling responds to trials-per-target, to be more predictable

See discussion context: https://planeks.slack.com/archives/C04MHHXHWQZ/p1717711621537919

re. !17
    @sashasimkin
    sashasimkin committed Jun 9, 2024
    Configuration menu
    Copy the full SHA
    d4caf3e View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. testing

    @antoinefalisse
    antoinefalisse committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    0eb9e23 View commit details
    Browse the repository at this point in the history

  2. set tasks_running to 1 if 0

    @antoinefalisse
    antoinefalisse committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    fcfb72e View commit details
    Browse the repository at this point in the history

  3. roll back

    @antoinefalisse
    antoinefalisse committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    3511a98 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. fix: Update auto-scaling formula 

    re. !17
    @sashasimkin
    sashasimkin committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    6fc6d53 View commit details
    Browse the repository at this point in the history