Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
ParishadBehnam authored Apr 4, 2024
1 parent 14bd9dc commit df20178
Showing 1 changed file with 3 additions and 4 deletions.
7 changes: 3 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,12 +1,11 @@
# LLM2Vec

*LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders*.
# *LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders*
LLM2Vec is a simple recipe to convert decoder-only LLMs into text encoders. It consists of 3 simple steps: 1) enabling bidirectional attention, 2) training with masked next token prediction, and 3) unsupervised contrastive learning. The model can be further fine-tuned to achieve state-of-the-art performance.

<p align="center">
<img src="https://github.com/McGill-NLP/llm2vec/assets/12207571/48efd48a-431b-4625-8e0f-248a442e3839" width="75%" alt="LLM2Vec_figure1"/>
</p>

## Instrallation
## Installation
To use LLM2Vec, first install the llm2vec package from PyPI.

```bash
Expand Down

0 comments on commit df20178

Please sign in to comment.