Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DEMO: minGPT on tinygrad #138

Open
wants to merge 33 commits into
base: master
Choose a base branch
from
Open

DEMO: minGPT on tinygrad #138

wants to merge 33 commits into from

Commits on Apr 26, 2024

  1. rename main code folder

    @ziliangpeng
    ziliangpeng committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    bbd2120 View commit details
    Browse the repository at this point in the history

  2. rename a bunch of code ref

    @ziliangpeng
    ziliangpeng committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    149c1b2 View commit details
    Browse the repository at this point in the history

  3. git ignore some files

    @ziliangpeng
    ziliangpeng committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    b47cf06 View commit details
    Browse the repository at this point in the history

  4. Merge pull request #1 from ziliangpeng/v--rename 

    rename minGPT to tinyGPT
    @ziliangpeng
    ziliangpeng committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    5638752 View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2024

  1. use proxy DataLoader

    @ziliangpeng
    ziliangpeng committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    eb3aba3 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #2 from ziliangpeng/v--dataloader 

    split DataLoader
    @ziliangpeng
    ziliangpeng committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    114f2b6 View commit details
    Browse the repository at this point in the history

  3. wip

    @ziliangpeng
    ziliangpeng committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    4698a9f View commit details
    Browse the repository at this point in the history

  4. some more stupid wip

    @ziliangpeng
    ziliangpeng committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    885d3ac View commit details
    Browse the repository at this point in the history

  5. wip

    @ziliangpeng
    ziliangpeng committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    c4abaae View commit details
    Browse the repository at this point in the history

  6. a bersion that almost runs except a few tensor without grad

    @ziliangpeng
    ziliangpeng committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    29bdc7d View commit details
    Browse the repository at this point in the history

  7. a little bit of cleanup

    @ziliangpeng
    ziliangpeng committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    c24d17a View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2024

  1. bring back the dropout

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    2feca7f View commit details
    Browse the repository at this point in the history

  2. print total params count

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    a1bf2b4 View commit details
    Browse the repository at this point in the history

  3. fixed the tinygrad no-grad issue. moving bias as local var

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    63ee708 View commit details
    Browse the repository at this point in the history

  4. cancel decay

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    4283874 View commit details
    Browse the repository at this point in the history

  5. cancel init_w

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    6ee157e View commit details
    Browse the repository at this point in the history

  6. some cleanup

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    b49cbd9 View commit details
    Browse the repository at this point in the history

  7. some cleanup of adder

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    2b1f9ba View commit details
    Browse the repository at this point in the history

  8. add simple NOTE

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    230ceae View commit details
    Browse the repository at this point in the history

  9. cancel clip_grad_norm_

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    9568f28 View commit details
    Browse the repository at this point in the history

  10. super small cleanup

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    2a22fff View commit details
    Browse the repository at this point in the history

  11. tidy import

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    db3301a View commit details
    Browse the repository at this point in the history

  12. fix the no_grad bias issue

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    c447ee0 View commit details
    Browse the repository at this point in the history

  13. bug fix

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    8405765 View commit details
    Browse the repository at this point in the history

  14. more cleanup

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    d81e154 View commit details
    Browse the repository at this point in the history

  15. move comment

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    45c1a51 View commit details
    Browse the repository at this point in the history

  16. nit

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    146dfb5 View commit details
    Browse the repository at this point in the history

  17. Merge pull request #3 from ziliangpeng/tinygradify 

    Tinygradify
    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    cf4549e View commit details
    Browse the repository at this point in the history

  18. update README

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    8d17e92 View commit details
    Browse the repository at this point in the history

  19. organize top level files and metadata

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    5485999 View commit details
    Browse the repository at this point in the history

  20. Merge pull request #4 from ziliangpeng/v--README 

    update README
    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    34f36c8 View commit details
    Browse the repository at this point in the history

  21. awkward typo

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    0db60b7 View commit details
    Browse the repository at this point in the history

  22. hotz

    @ziliangpeng
    ziliangpeng committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    b897968 View commit details
    Browse the repository at this point in the history