mlc-ai

All

27 repositories

mlc-llm
Public
Universal LLM Deployment Engine with ML Compilation
language-model tvm llm machine-learning-compilation
Python
•
Apache License 2.0
•1.6k•19k•200•9•Updated Nov 13, 2024Nov 13, 2024
web-llm
Public
High-performance In-browser LLM Inference Engine
deep-learning language-model webgpu tvm webml llm chatgpt
TypeScript
•
Apache License 2.0
•877•14k•64•8•Updated Nov 13, 2024Nov 13, 2024
mlc-ai.github.io
Public
HTML
•3•6•0•0•Updated Nov 12, 2024Nov 12, 2024
xgrammar
Public
C++
•
Apache License 2.0
•1•23•1•0•Updated Nov 12, 2024Nov 12, 2024
mlc-python
Public
C++
•
Apache License 2.0
•0•4•0•0•Updated Nov 12, 2024Nov 12, 2024
relax
Public
Python
•
Apache License 2.0
•77•152•12•0•Updated Nov 11, 2024Nov 11, 2024
web-llm-chat
Public
Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.
chat privacy ai nextjs chatbot llama hermes chat-application gemma webgpu
TypeScript
•
Apache License 2.0
•58•371•4•6•Updated Nov 10, 2024Nov 10, 2024
binary-mlc-llm-libs
Public
46•206•20•0•Updated Nov 4, 2024Nov 4, 2024
web-llm-assistant
Public
AI Assistant running within your browser.
chrome-extension agent machine-learning foundation-models large-language-models
TypeScript
•
Apache License 2.0
•6•42•2•0•Updated Oct 29, 2024Oct 29, 2024
web-agent-interface
Public
An interface for AI Agents to interact with various web platforms.
TypeScript
•2•6•0•0•Updated Oct 25, 2024Oct 25, 2024
mlc-en
Public
Python
•
Apache License 2.0
•39•381•0•0•Updated Oct 16, 2024Oct 16, 2024
blog
Public
HTML
•1•1•0•0•Updated Oct 10, 2024Oct 10, 2024
package
Public
Shell
•
Apache License 2.0
•14•12•2•0•Updated Oct 8, 2024Oct 8, 2024
webllm-playground
Public
Run LLMs in the Browser with MLC / WebLLM ✨
TypeScript
•9•5•0•0•Updated Oct 5, 2024Oct 5, 2024
notebooks
Public
Jupyter Notebook
•
Apache License 2.0
•63•189•10•0•Updated Sep 13, 2024Sep 13, 2024
tokenizers-cpp
Public
Universal cross-platform tokenizers binding to HF and sentencepiece
C++
•
Apache License 2.0
•65•273•7•1•Updated Aug 12, 2024Aug 12, 2024
docs
Public
The documents for TVM Unity
Shell
•
Apache License 2.0
•2•11•0•2•Updated Aug 9, 2024Aug 9, 2024
mlc-zh
Public
Python
•
Apache License 2.0
•64•589•3•1•Updated Jun 4, 2024Jun 4, 2024
jekyll-theme-mlc
Public
SCSS
•
Apache License 2.0
•1•0•0•0•Updated May 27, 2024May 27, 2024
llm-perf-bench
Public
Python
•
Apache License 2.0
•12•114•3•2•Updated Apr 22, 2024Apr 22, 2024
web-data
Public
supporting data for web
Apache License 2.0
•5•2•0•0•Updated Apr 16, 2024Apr 16, 2024
web-stable-diffusion
Public
Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.
deep-learning web-assembly webgpu tvm webml stable-diffusion
Jupyter Notebook
•
Apache License 2.0
•228•3.6k•33•2•Updated Mar 12, 2024Mar 12, 2024
env
Public
repo for docker related builds
Shell
•
Apache License 2.0
•0•3•0•0•Updated Jan 21, 2024Jan 21, 2024
text-generation-webui
Public
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
Python
•
GNU Affero General Public License v3.0
•5.3k•3•0•0•Updated Nov 16, 2023Nov 16, 2023
dlight-bench
Public
Python
•
Apache License 2.0
•4•3•0•1•Updated Nov 6, 2023Nov 6, 2023
auditwheel
Public
Auditing and relabeling cross-distribution Linux wheels.
Python
•
Other
•145•0•0•0•Updated Jun 14, 2023Jun 14, 2023
mlc-training
Public
Relax Training APIs Tutorial and Examples
Jupyter Notebook
•3•6•0•0•Updated Apr 17, 2023Apr 17, 2023