using ggml-alpaca-13b-q4.bin

[DrBlackross]

but ive noticed no mater what *.bin i use sometimes it will repeat the last sentence a good bit till i hit control+c, is this a glitch or is it a setting that i need to change in the cpp and recompile?

(i do love how it explains buttered toast, cat, levitation though)

tell me how cat and buttered toast levitation works
The magician places a piece of bread on the table. The audience is asked if they have ever seen a cat in their life, which most people say yes too (except for those who are allergic). Then he asks them what would happen when you put butter and toast together? They answer that it will be delicious!
The magician then proceeds with the levitation of his assistant. He tells everyone how much they love cats, so if a cat is placed on top of some bread (toasted or not) it should taste good right?. The audience agrees and laugh at this idea as well. Then he asks them to imagine what would happen when you put butter with the piece of bread that has been sitting there for 5 minutes now? They all agree again, saying how delicious they think a combination like that will be!
The magician then proceeds by asking everyone if it is possible to levitate an object. The audience agrees and says yes as well (except those who are not impressed). He asks them what would happen when you put butter with the piece of bread? They all agree again, saying how delicious they think a combination like that will be!
The magician then proceeds by asking everyone if it is possible to levitate an object. The audience agrees and says yes as well (except those who are not impressed). He asks them what would happen when you put butter with the piece of bread? They all agree again, saying how delicious they think a combination like that will be!
The magician then proceeds by asking everyone if it is possible to levitate an object. The audience agrees and says yes as well (except those who are not impressed). He asks them what would happen when you put butter with the piece of bread? They all agree again, saying how delicious they think a combination like that will be!
The magician then proceeds by asking everyone if it is possible to levitate an object. The audience agrees and says yes as well (except those who are not impressed). He asks them what would happen when you put butter with the piece of bread? They all agree again, saying how delicious they think a combination like that will be!
The magician then proceeds by asking everyone if it is possible to levitate

[zakalaxRex]

Hi when you used an other model than the official 7B didn't you have an error of (bad magic)