Skip to content

Releases: mlc-ai/xgrammar

Prerelease v0.0.3

14 Oct 10:15
88566f3
Compare
Choose a tag to compare
Prerelease v0.0.3 Pre-release
Pre-release

v0.0.3 introduces these changes:

  1. Introduces TokenizerInfo to uniformly handle various tokenizers, including huggingface tokenizer, tiktoken and mlc-llm tokenizer-cpp.
  2. Introduces GrammarMatcherInitContext, an object that can be used to fast initialize multiple GrammarMatchers. A cache for GrammarMatcherInitContext called GrammarMatcherInitContextCache is introduces as well.
  3. Introduces WebAssembly bindings for web uses.
  4. Documents are refined for clearity.

Several new features and bug fixes are introduced as well.

Prerelease v0.0.2

26 Aug 01:22
1085004
Compare
Choose a tag to compare
Prerelease v0.0.2 Pre-release
Pre-release

The first pre-release version of xgrammar. Ensures basic functionality and provides good performance.