utilizing GPU?

[lonnietc]

Hello,

I am exploring wasm and in particular I am also interested in it being able to use the host GPU. I know that in Chromium browser that wasm can utilize WebGPU and WebGL which is very powerful for browser based LLMs and similar AI research. Also even Chromium Embedded Framework (CEF) is supposed to be able to utilize virtual GPU capabilities across the instances.

Can Hyperlight and/or Hyperlight-wasm take advantage of GPU as well as this would be extremely useful for my purposes?

Thanks and have a great day

[jsturtevant]

We don't currently have anything that would work out of the box but would be possible to use a wasi interface like https://github.com/WebAssembly/wasi-gfx to accomplish this.

There is an example of implementing the wasi-sockets interface here as an example: https://github.com/hyperlight-dev/hyperlight-wasm-sockets-example

[jsturtevant]

Reviewed at the hyperlight community meeting and agreed this is something we would like want to do in the future as we add more wasi support but happy to help anyone that wants to take a try at this.

Also noting that using wasi-gfx would require implementing the host side bindings for Hyperlight-wasm (see sockets example as an example of implementing host side bindings).