Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add experiments notebooks #193

Merged
merged 76 commits into from
Oct 1, 2023
Merged

Add experiments notebooks #193

merged 76 commits into from
Oct 1, 2023

Conversation

mivanit
Copy link
Member

@mivanit mivanit commented Sep 4, 2023 •
edited
Loading

see #192

@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

@mivanit mivanit mentioned this pull request Sep 4, 2023
Closed
@mivanit mivanit linked an issue Sep 4, 2023 that may be closed by this pull request
add experiment notebooks #192
Closed
@mivanit
update dataset demo nb
a8886e0
@mivanit
update maze-dataset dep to be from pypi
2f22ae6
@mivanit
fixed up dataset cfg refs
ffd6a34
@mivanit
fixed gen_dfs kwarg name change
1acbbc1
@mivanit
wip direct logit attribution refactor
6688402
@mivanit
plotting logits
7e66e16
@mivanit
logit plots
61f6f95
@mivanit
moved plot logits out
729dc1f
@mivanit
wip
0d0d652
@mivanit
direct logit attribution logit diff wip
f559458 
i have no idea why, but the scaling is wrong. The relationship is clearly linear,
but its different depending on whether it's diff to all other tokens or some random set of tokens
@mivanit
wip
05841d1
@mivanit
direct logit attribution
1ec8260
@mivanit
split up notebook
3e518b6
@mivanit
minor fixes
0b3ebb3
@mivanit
format, manually fix some imports
0e6c181
@mivanit
added a few different tasks to logit attribution
4151077
@mivanit
moved plot_attention.py
82feee9
@mivanit
updated path start notebook still has activation patching
14d5010
@mivanit
???
be1934c
@mivanit
git add .git add .!
a54c5a2
@mivanit
wip
7ea1c18
@mivanit
bumped maze-dataset dep
1519224
@mivanit
log scale for PCA option
6172b53
@mivanit
fixing up some tests -- they should all pass
09219b1
@mivanit
wip distance correlations
d516d05
@mivanit
wip residual stream structure
5c851d4
@mivanit
exporting functions wip
73a0f00
@mivanit
refactoring, added correlation info
a95b49e
@mivanit
wip
27b2a4d
@mivanit
distance plot
4bad3aa
@mivanit
wip
9dd4258
@mivanit
embedding similarity refactor
b9bfe4d
@mivanit
more refactor, cleanup
888a407
@mivanit
format
906e49b
@mivanit
update maze-dataset to 0.4.1 (out soon)
3437120
@mivanit
update deps
c973321
@mivanit
added seaborn to deps
1a654e9
@mivanit
workflow for multiple python/torch versions
7c79c64
@mivanit
workflow for multiple python/torch versions
fd910f9
@mivanit
Merge branch 'add-experiments-notebooks' of https://github.com/unders…
3cc9481 
…tanding-search/maze-transformer into add-experiments-notebooks
@mivanit
error in github actions
fb88d89
@mivanit
oops
ac47c5c
@mivanit
update poetry and torch_cpu source
9d671d9
@mivanit
im dumb
fc7c5d8
@mivanit
wip fixing test
aa32679
@mivanit
fixed tokenizer padding issue in tests
074f19c
@mivanit
added scipy dep, specified python<3.10
1add09e
@mivanit
added scikit-learn dep
9b04206
@mivanit
format
8975fac
@mivanit
fixed device issues in dla notebook
3493c33
@mivanit mivanit merged commit 2b6ee4a into main Oct 1, 2023
4 checks passed
@mivanit mivanit deleted the add-experiments-notebooks branch October 1, 2023 08:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

add experiment notebooks
1 participant
@mivanit