Fixed script path

* bump composer

* accounted for bug fix

* changed fsdp_elastic_sharded_enabled to fsdp_sharded_state_dict_enabled in the AsyncEvalCallback

---------

Co-authored-by: Daniel King <[email protected]>

* flagged areas to throw ft errors + added custom exception

* added exceptions for all files

* fixed type of invalid type errors

* fixed merge

* added exceptions for all files

* fixed merge

* added a catch for missing hf url

* expain dataloader catch to all error types

* added tests for custom exceptions

* fixed a couple tests

* fixed some more tests

* addressed comments

* fixed formatting, updated split correction, moved logger setup into helper

* added check for repeating roles

* more strict checking for prompt response type

* removed some cases we don't need

* updated name of unknown conversation type error

* formatting

* Fix multi model eval (#1055)

* resolved merge conflict

* formatted

* added back two imports

* formatting changes

* formatted again

* sorted imports

* diable yapf for exceptions import

* disabled yapf on test dataloader

---------

Co-authored-by: Daniel King <[email protected]>

* Bump version

* Remove triton (#1062)

* Remove github action workflows for version bumps

* Fix cpu test issues

* code quality

* Fix gpu tests

* Fix gpu tests nicely

* Remove z-loss (#1064)

* Remove prefix lm and denoising (#1065)

* Remove hf_prefix_lm

* Remove prefix_lm from mpt modeling

* Remove bidirectional mask

* Remove text denoising dataloading

* Remove adapt tokenizer

* Remove llama attention patch (#1066)

* Remove bidirectional mask in tests

* Fix test_hf_config_override with patch

* Fix comparison in train for hf_t5

* Add back context printing in dataloader.py

* Skip flaky lion8b test (#598)

* relax atol and add retries to reduce flakiness in lion8b timing test

* add eval output logging

* add back tasks

* foo

* add rlhf prompts

* add rlhf prompts

* add rlhf prompts

* add rlhf prompts

* add rlhf prompts

* fix prompt

* fix prompt

* modify mcli

* test

* test

* fix

* fix merge

* wip

* merge

* reset files, wip commit

* rm small changes

* reduce changes

* reduce changes

* .

* wip

* rm batch keys

* revert init device

* linting

* add import

* fix import

* add eval_output_logging to registry

* readd import

* pyright + linting

---------

Co-authored-by: dblalock <[email protected]>
Co-authored-by: Jeremy Dohmann <[email protected]>

…/ bos token id (#1039)

* lint

* lint

* added warning and error message instead of setting the eos and bos token ids

* Update text_data.py

Adding info about the override flags in the error message.

* Update llmfoundry/data/text_data.py

Co-authored-by: Vitaliy Chiley <[email protected]>

* Update llmfoundry/data/text_data.py

Co-authored-by: Vitaliy Chiley <[email protected]>

* adding warning if user does not provide eos or bos token id

* adding warning if user does not provide eos or bos token id

---------

Co-authored-by: Vitaliy Chiley <[email protected]>

* Triton RMS Norm

* fix

* refactor

* Fix test

* no bias

* Update tests/models/test_model.py

Co-authored-by: Daniel King <[email protected]>

* fixes

* Unittest

* fix

* fix2

* fix3

* fix3

---------

Co-authored-by: Daniel King <[email protected]>

* fix vocab size bug

* more tests

…#1079)

* setting loss_fn reduction to None

* fixing a unit test

* add error message

* adding test to check reduction

* adding test to check reduction

* Update llmfoundry/models/mpt/modeling_mpt.py

Co-authored-by: Vitaliy Chiley <[email protected]>

* preserving batch dimension of targets

* minor change

---------

Co-authored-by: Vitaliy Chiley <[email protected]>
Co-authored-by: Daniel King <[email protected]>

* log packing ratio progress

* use tqdm to show progress of packing ratio profiling

* fix pbar

* Update packing.py

* added log to search for

* fix

* good old fashioned progress logging

* Update packing.py

Co-authored-by: Daniel King <[email protected]>

* updating the streaming version in setup.py

* updating constructor call to StreamingDataset

* making allow_unsafe_types and replication configurable through dataset configs

* adding docstring

* [Stage] Megablocks release (#241)

* V1 of MegaBlocks
---------

* fix hf ckptr

* rename

* lint

* lint

---------

Co-authored-by: Abhinav Venigalla <[email protected]>
Co-authored-by: Sasha Doubov <[email protected]>
Co-authored-by: Cheng Li <[email protected]>
Co-authored-by: Ning Wang <[email protected]>
Co-authored-by: Irene Dea <[email protected]>
Co-authored-by: Shashank Rajput <[email protected]>
Co-authored-by: Chuck Tang <[email protected]>
Co-authored-by: Jose Javier <[email protected]>
Co-authored-by: Angel Ruiz <[email protected]>
Co-authored-by: Denny Lee <[email protected]>
Co-authored-by: Jane Zhang <[email protected]>
Co-authored-by: Daniel King <[email protected]>
Co-authored-by: Chuck Tang <[email protected]>
Co-authored-by: Vitaliy Chiley <[email protected]>

https://databricks.atlassian.net/browse/GRT-2812

see [here](mosaicml/llm-foundry-private#245 (comment))
Ran 500 steps, new version did marginally better

This adds support for the other common chat format. We just remap keys and add a new role.

#1108)

* Update dbrx-full-ft.yaml

* fix

This reverts commit 17f8aeb.

#1111 needed to revert #1104 because the #1104 PR caused issues. Removing TODO and marking Jira with wont-do

* start

* still need to migrate fixtures

* wip onboarding tests

* still workin'

* still wip

* maybe done; test out on mcli now

* mcli

* remove calibration error

* migration

* migration

* full migration

* precommit

* fix

* fix pytests

* refactor QA

* update

* restore

* add

* fix

* wip

* update readme

* final pyright

* done

* pass prelimiter into ALL the ICL task datasets

* allow QA task name stil lfor backward compatibility

* fix

* fix test

* add generation length

* remove max_new_tokens

* fix cpu trsts

* try and fix lm eval test

* temp disable lm task eval test

* fix test?

* fix tet

* finish

* fix

* Update scripts/eval/README.md

Co-authored-by: Daniel King <[email protected]>

* fix comments

* fix bug with seq len

* restore mcli

* merge

* fix builder

* add deprecation warning

* add deprecation warning

* merge

* merge

* add logging necessities to nlp.py

* add attention_mask test update

* fix generation_length in tests

* fix bug

* restore yamls

* fix typos

* add deprecation warning for code

* pyright wip

* fix pyright

* fix pyright error again

* fix pyright

* fix pyright

* update version

---------

Co-authored-by: Eitan Turok <[email protected]>
Co-authored-by: Max Marion <[email protected]>
Co-authored-by: Daniel King <[email protected]>
Co-authored-by: Max Marion <[email protected]>