Single-File GGUF Inference

This is a WiP, far from polished, and only partially functional. Though all the bones are here. Modify and adapt as you see fit. Sorry for any stray slop. I trust you all can take this home. :) God bless <3

First seen by Ansar: 6d ago

Artificial intelligence

Sign in to follow

Timeline

1 recorded

Launch6d ago
Single-File GGUF Inference launched on Show HN
This is a WiP, far from polished, and only partially functional. Though all the bones are here. Modify and adapt as you see fit. Sorry for any stray slop. I trust you all can take this home. :) God bless <3.

Timeline

Single-File GGUF Inference launched on Show HN