Llama 3.1 providers

[ha1772007]

What are all llama 3.1 providers for free on gpt4free

[TheFirstNoob]

Hey, thats i use now for discord bot

"meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo": RetryProvider([DDG], shuffle=False),
            "meta-llama/Meta-Llama-3.1-70B-Instruct": RetryProvider([HuggingChat, HuggingFace, Blackbox, DeepInfra, FreeGpt], shuffle=False),
            "meta-llama/Meta-Llama-3.1-405B-Instruct-FP8": RetryProvider([HuggingChat, HuggingFace, Blackbox], shuffle=False),
            "llama-3.1-sonar-large-128k-online": RetryProvider([PerplexityLabs], shuffle=False),
            "llama-3.1-sonar-large-128k-chat": RetryProvider([PerplexityLabs], shuffle=False),

[ha1772007]

PerplexityLab is making error how to fix it

How to fix it can you provide a guide on it

[TheFirstNoob]

i think u need more from import (from g4f libs) some not load

i use

from g4f.client import Client
from g4f.Provider import (
    RetryProvider, Chatgpt4o, FreeChatgpt, DDG, Liaobots, Blackbox, ChatGot, FreeGpt,
    HuggingChat, HuggingFace, PerplexityLabs, Pi, LiteIcoding, AiChatOnline, Pizzagpt,
    FreeNetfly, MagickPenAsk, MagickPenChat, TeachAnything, DeepInfra, ChatgptFree,
    DeepInfraImage
)

[ha1772007]

Can you plz provide the list of providers for gpt-4o or gpt-4o-mini is there any way where i can see the providers of different models

[TheFirstNoob]

@ha1772007 https://github.com/TheFirstNoob/Discord-ChatGPT/blob/main/src/bot.py#L106
Actual on 3.0.2.5. After merge kqlio67 update i send new

[MorkovkAs]

@ha1772007 https://github.com/TheFirstNoob/Discord-ChatGPT/blob/main/src/bot.py#L106 Actual on 3.0.2.5. After merge kqlio67 update i send new

I asked a couple of times with different providers from the list with the gpt-4o parameter what kind of models they are. The results were surprising. Am I doing something wrong or is this the norm?

• What are you and your version?

• I'm ChatGPT, based on the GPT-3.5 architecture. I'm designed to help with a wide range of tasks, from answering questions and providing explanations to offering creative ideas and coding assistance. How can I assist you today?

[TheFirstNoob]

Because 3.5 is a model trained from scratch, and 4 and 4o are its retrained version. Therefore, it can say that it is 3.5. This visual problem has been going on since the appearance of simple gpt4.

Also, the provider would not work if an incorrect model was set (which is not in the database on their website). Therefore, it works out everything clearly.
For example, DDG can also answer that it is 3.5, although in fact it is 4o mini. This is noticeable from its answers and how the perception of the question is built.

[TheFirstNoob]

@MorkovkAs Updated 3.0.2.6 if needed example providers: https://github.com/TheFirstNoob/Discord-ChatGPT/blob/main/src/bot.py#L100

[MorkovkAs]

@TheFirstNoob Great, thank you!

[github-actions]

Bumping this issue because it has been open for 7 days with no activity. Closing automatically in 7 days unless it becomes active again.