Write Wikipedia tool in WASM

[marcusschiesser]

Context

WASM would be a great technology for writing the same LLM tool once and using it in Python and TS.

However, the problem is that even a simple HTTP fetch is not standardized among WASM runtimes. This would be the minimum requirement for a runtime running LLM tools (tools usually do API calls).

Status

LlamaIndexTS can already use WASM tools; see https://github.com/run-llama/LlamaIndexTS/blob/main/packages/wasm-tools/README.md

Options

How can we do an HTTP fetch?

• https://github.com/extism/extism
• Webassembly components (see https://component-model.bytecodealliance.org/)

Extism looks more mature. (August 2024)

Next step

Try extism to implement a Wikipedia tool

[thucpn]

Extism is very cool for JS and Python. I can:

• First, build Wasm file by using Extism Compiler Tool: https://github.com/extism/js-pdk
• Use Wasm file in Nodejs by using JS SDK: https://www.npmjs.com/package/@extism/extism
• Use Wasm file in Python by using Python SDK: https://github.com/extism/python-sdk

Just one problem, their python-sdk hasn't support using the http plugin. I submit an issue here to ask them:
extism/python-sdk#25