-
Notifications
You must be signed in to change notification settings - Fork 2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
sentence embeddings with Sbert. #1405
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This looks like an awesome example! Just filled in a few preliminary nitpicks after a quick first-pass on the content for this tutorial. I guess you may have to do a bit of a grammar check in-place to get things right, but the concepts look good to me!
Some high-level comments though, which are kinda repeated across the tutorial
- Make sure you remove all the
<br>
tags, they don't need to be added explicitly - Make sure your links are all on the same lines, don't break them
- Some places require capitalization. I think putting the text through a grammar checker should remove those errors fairly quickly
Thanks for this, I'm sure folks would love it! Delegating the rest to the able hands of @mattdangerw of course!
Grammar fix
@suvadityamuk Thanks! |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is really great! Thanks so much for the guide.
I left some comments, but they are mainly about readability. Overall the content is quite well explained.
Thanks!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Very nice! LGTM.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please add the generated files!
@fchollet I have just pushed the generated files. |
Thank you for the great contribution! |
@fchollet You are welcome |
this is an example of how to use RoBERTa from keras-nlp in another model and fine-tune it using siamese networks for semantic similarity tasks.
I fine tuned the model with two methods (regression objective and triplet objective).
the paper that this example is based on is sbert
here is a colab gist with the code.