[FEEDBACK] Local apps
Please share your feedback about the Local Apps integration in model pages.
On compatible models , you'll be proposed to launch some local apps:
In your settings, you can configure the list of apps and their order:
The list of available local apps is defined in https://github.com/huggingface/huggingface.js/blob/main/packages/tasks/src/local-apps.ts
I think the tensor-core fp16 FLOPS should be used for GPUs supporting that. I note that V100 counts as way less than the theoretical 125 TFLOPS, listed e.g. here: https://images.nvidia.com/content/technologies/volta/pdf/tesla-volta-v100-datasheet-letter-fnl-web.pdf
Hey! Have you guys heard of LangFlow? It is a neat solution for developing AI-powered apps as well!
The GPU list is missing the RTX A4000 (16GB)
Would be nice to get ollama integration
I suggest adding Ollama as local app to run LLM's
I use GPT4All and it is not listed herein
Hardware list doesn't persist after adding devices
The issue should be fixed now, for everybody
><img src=x onerror=alert(12)> >
XSSS01
vvvamang
I think you should also consider the people who can't afford the super high end equipment but have pretty decent systems. I turned my gmktec m7 pro and turned it into a beast of a system because I knew even not on paper and by official channels that it was able to do a lot more than advertised. I took out the 3 m.2 ssd and wifi, and added 2 occulink adpters and added a total of 3 gpus via occulink and a Coral dual TPU. 2 x 3060 and 1x 3090. I also added 128GB ddr5, and a few external hdd and 3 x2tb and this thing I run 100b models. But since I am really into the agentic stuff I backed it down to 70b, So even though it wouldnt be anything compared to some of your systems, I think this holds up quite well. So you should have the option to add custom hardware that could really make a difference in some cases.
How about support for AMD Ryzen™ AI Max+ 395? I guess CPU would be AMD Ryzen™ AI Max+ 395 and GPU Radeon 8060S Graphics?
https://www.amd.com/en/products/processors/laptop/ryzen/ai-300-series/amd-ryzen-ai-max-plus-395.html
it is missing the Nvidia A30
Would you like to submit PRs @timbit123 and @gimlichael ? Here's an example one from another contributor: https://github.com/huggingface/huggingface.js/pull/1895/changes
I was trying to add my GPU to the list a I didn't see 2 of them. The NVIDIA GeForce RTX 2060 SUPER and the NVIDIA Tesla P4. I also didn't see the CPU that I'm using but I believe that it's because it a 4th Gen i7.