[FEEDBACK] Local apps
Please share your feedback about the Local Apps integration in model pages.
On compatible models , you'll be proposed to launch some local apps:
In your settings, you can configure the list of apps and their order:
The list of available local apps is defined in https://github.com/huggingface/huggingface.js/blob/main/packages/tasks/src/local-apps.ts
I think the tensor-core fp16 FLOPS should be used for GPUs supporting that. I note that V100 counts as way less than the theoretical 125 TFLOPS, listed e.g. here: https://images.nvidia.com/content/technologies/volta/pdf/tesla-volta-v100-datasheet-letter-fnl-web.pdf
Hey! Have you guys heard of LangFlow? It is a neat solution for developing AI-powered apps as well!
The GPU list is missing the RTX A4000 (16GB)
Would be nice to get ollama integration
I suggest adding Ollama as local app to run LLM's
I use GPT4All and it is not listed herein
How about support for AMD Ryzen™ AI Max+ 395? I guess CPU would be AMD Ryzen™ AI Max+ 395 and GPU Radeon 8060S Graphics?
https://www.amd.com/en/products/processors/laptop/ryzen/ai-300-series/amd-ryzen-ai-max-plus-395.html
it is missing the Nvidia A30
Would you like to submit PRs @timbit123 and @gimlichael ? Here's an example one from another contributor: https://github.com/huggingface/huggingface.js/pull/1895/changes
I was trying to add my GPU to the list a I didn't see 2 of them. The NVIDIA GeForce RTX 2060 SUPER and the NVIDIA Tesla P4. I also didn't see the CPU that I'm using but I believe that it's because it a 4th Gen i7.
I wanted to add my GPUs, but neither is available on the list. I have the AMD Radeon RX 6900 XT (16GB) and the AMD Radeon Pro W6800 (32GB).
Happy to submit a PR for the Ryzen AI Max 300 series (395 etc that powers the Framework Desktop), but first is it a CPU or a GPU? Or both?
This appears to have been done by someone else. I now see Ryzen AI Max+ 395 in the AMD GPU list. Thank you, whoever added it!
the GPU list is missing RTX 5070 Ti Mobile(for laptops)
And the CPU is missing Intel Core Ultra 9 275hx and others ultra.