Open(ish) hardware GPU cluster for local LLM work?

Hey all!

Is anyone aware of any work being done vis a vis an open or mostly-open hardware stack being used for local LLM work? I know there’s the whole GPU problem, but I’ve got a couple of researchers that are doing highly sensitive image analysis work that needs to be air-gapped and having more trusted hardware stack for the work would be useful to them. If anyone knows of any projects in this space, LMK!

Thanks!

1 Like

Maybe this is at least adjacent to what you’re asking.

1 Like