Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add experiments notebooks #193

Merged
merged 76 commits into from
Oct 1, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
76 commits
Select commit Hold shift + click to select a range
1841739
small todo
mivanit Jun 17, 2023
42fcb47
WIP notebooks
mivanit Jul 14, 2023
f21f8eb
data and trained model for hallway
mivanit Jul 14, 2023
463b525
merge main
mivanit Sep 4, 2023
46614db
removing duplicate notebook
mivanit Sep 4, 2023
a8886e0
update dataset demo nb
mivanit Sep 4, 2023
2f22ae6
update maze-dataset dep to be from pypi
mivanit Sep 4, 2023
ffd6a34
fixed up dataset cfg refs
mivanit Sep 4, 2023
1acbbc1
fixed gen_dfs kwarg name change
mivanit Sep 4, 2023
6688402
wip direct logit attribution refactor
mivanit Sep 5, 2023
7e66e16
plotting logits
mivanit Sep 5, 2023
61f6f95
logit plots
mivanit Sep 5, 2023
729dc1f
moved plot logits out
mivanit Sep 5, 2023
0d0d652
wip
mivanit Sep 5, 2023
f559458
direct logit attribution logit diff wip
mivanit Sep 5, 2023
05841d1
wip
mivanit Sep 5, 2023
1ec8260
direct logit attribution
mivanit Sep 5, 2023
3e518b6
split up notebook
mivanit Sep 5, 2023
0b3ebb3
minor fixes
mivanit Sep 5, 2023
0e6c181
format, manually fix some imports
mivanit Sep 5, 2023
4151077
added a few different tasks to logit attribution
mivanit Sep 5, 2023
82feee9
moved plot_attention.py
mivanit Sep 5, 2023
14d5010
updated path start notebook still has activation patching
mivanit Sep 5, 2023
be1934c
???
mivanit Sep 5, 2023
a54c5a2
git add .git add .!
mivanit Sep 5, 2023
7ea1c18
wip
mivanit Sep 5, 2023
1519224
bumped maze-dataset dep
mivanit Sep 5, 2023
213f920
format
mivanit Sep 5, 2023
0a536a3
fixed paths in eval_model notebook
mivanit Sep 5, 2023
18036ef
run eval_model, rename wandb conversion nb
mivanit Sep 5, 2023
82868b3
wip
mivanit Sep 6, 2023
1abe25b
better maze plotting
mivanit Sep 6, 2023
5fcfda2
dla report automation, more flexible functions
mivanit Sep 12, 2023
9971ed6
fixed bug in maze attention plots, improved logit plots
mivanit Sep 12, 2023
7c2edb8
wip
mivanit Sep 19, 2023
22b9a85
Merge branch 'main' into add-experiments-notebooks
mivanit Sep 19, 2023
dcd4920
wip
mivanit Sep 22, 2023
ecb1c7d
wip???
mivanit Sep 27, 2023
e2ed0ce
dla for neurons
mivanit Sep 27, 2023
64b1064
viewing weights
mivanit Sep 27, 2023
9124ffa
wip
mivanit Sep 27, 2023
0185eb6
run dla notebook
mivanit Sep 27, 2023
ea6ad15
wip
mivanit Sep 27, 2023
2f1ea5c
exporting embeddings vis
mivanit Sep 27, 2023
6395160
PCA of embeddings
mivanit Sep 28, 2023
478ad56
wip
mivanit Sep 28, 2023
1fe7df4
add pca result options
mivanit Sep 28, 2023
7528e57
Exported embeddings PCA functionality
mivanit Sep 28, 2023
6172b53
log scale for PCA option
mivanit Sep 28, 2023
09219b1
fixing up some tests -- they should all pass
mivanit Sep 28, 2023
d516d05
wip distance correlations
mivanit Sep 28, 2023
5c851d4
wip residual stream structure
mivanit Sep 29, 2023
73a0f00
exporting functions wip
mivanit Sep 29, 2023
a95b49e
refactoring, added correlation info
mivanit Sep 29, 2023
27b2a4d
wip
mivanit Sep 29, 2023
4bad3aa
distance plot
mivanit Sep 29, 2023
9dd4258
wip
mivanit Sep 29, 2023
b9bfe4d
embedding similarity refactor
mivanit Sep 29, 2023
888a407
more refactor, cleanup
mivanit Sep 29, 2023
906e49b
format
mivanit Sep 29, 2023
3437120
update maze-dataset to 0.4.1 (out soon)
mivanit Sep 29, 2023
c973321
update deps
mivanit Sep 29, 2023
1a654e9
added seaborn to deps
mivanit Sep 29, 2023
7c79c64
workflow for multiple python/torch versions
mivanit Sep 30, 2023
fd910f9
workflow for multiple python/torch versions
mivanit Sep 30, 2023
3cc9481
Merge branch 'add-experiments-notebooks' of https://github.com/unders…
mivanit Sep 30, 2023
fb88d89
error in github actions
mivanit Sep 30, 2023
ac47c5c
oops
mivanit Sep 30, 2023
9d671d9
update poetry and torch_cpu source
mivanit Sep 30, 2023
fc7c5d8
im dumb
mivanit Sep 30, 2023
aa32679
wip fixing test
mivanit Sep 30, 2023
074f19c
fixed tokenizer padding issue in tests
mivanit Oct 1, 2023
1add09e
added scipy dep, specified python<3.10
mivanit Oct 1, 2023
9b04206
added scikit-learn dep
mivanit Oct 1, 2023
8975fac
format
mivanit Oct 1, 2023
3493c33
fixed device issues in dla notebook
mivanit Oct 1, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 17 additions & 1 deletion .github/workflows/checks.yml
Original file line number Diff line number Diff line change
Expand Up @@ -36,15 +36,31 @@ jobs:
env:
WANDB_API_KEY: ${{ secrets.WANDB_API_KEY }}
runs-on: ubuntu-latest
strategy:
matrix:
versions:
- python: "3.10"
torch: "1.13.1"
- python: "3.10"
torch: "2.0.1"
- python: "3.11"
torch: "2.0.1"
steps:
- name: Checkout code
uses: actions/checkout@v3

- name: Set up python
uses: actions/setup-python@v4
with:
python-version: ${{ matrix.versions.python }}

- name: Install dependencies
run: |
curl -sSL https://install.python-poetry.org | python3 -
poetry lock --check
poetry install
export CUDA_VISIBLE_DEVICES=0
poetry add torch@${{ matrix.versions.torch }}+cpu --source torch_cpu
poetry install --all-extras

- name: Unit tests
run: make unit
Expand Down
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@ models/
wandb
tests/_temp/**
tests/**/_temp/**
notebooks/data/**

.coverage
htmlcov/
Expand Down
Binary file not shown.
Binary file not shown.
Loading