NLP Related Features

[Kardbord]

Consolidation of #30, #31, and any other feature ideas with roots in Natural Language Processing (NLP).

Hugging Face (HF) hosts open source models for a number of common NLP tasks that could be made into useful features. It also hosts a variety of datasets. They seem to offer several APIs and products, but I think the most noteworthy for this use case is the Inference API. If I understand it correctly, it allows for querying various models hosted on HF via HTTP requests. Most importantly, it seems to have a free tier plan. 😃

Here's a list of NLP tasks that I think have lots of potential for bot features:

• Image Recognition
• Fill Mask
• Text Generation
• Question Answering
• Conversational
• Summarization
• Translation

Some feature ideas based on the above NLP tasks:

• Conversational chat bot
• Translation between languages
• Summarize user provided text or text from a web page (e.g., wikipedia, dnd.wizards.com)
• Question answering - use a Google/DuckDuckGo search as answer context
• Story telling based on a prompt (text generation)

[Kardbord]

Couldn't find any Go bindings for the Inference API, so I'm developing them in the hfapigo repo.

[Kardbord]

Added story telling in v1.8.0 via the /story-time command.

[Kardbord]

Another thought for an NLP-feature: use zero-shot classification to issue commands to the bot without using slash commands. Behavior would be similar to an AI chat bot.

[Kardbord]

v1.11.0 added a madlib-esque feature via /madlib.