sdalemorrey/smallthinker-with-tools-3b-previews
Updated
S. Dale Morrey PRO
sdalemorrey
AI & ML interests
I solve problems and build tools
Recent Activity
replied to
csabakecskemeti's
post
2 days ago
Check out my idea:
LLmaaS - Local LLM as a Service
With LLmaaS, I propose leveraging locally running LLMs as a service, providing a standardized way for websites to access and utilize them for LLM-powered operations directly on the user’s device.
Demo, code, more detailed description.
https://devquasar.com/llmaas/
https://github.com/csabakecskemeti/LLmaaS
https://youtu.be/OOWGr8jcP5Q
Call for contributors
Join me a develop the LLmaaS proxy to make this a generic purpose tool to leverage local LLMs on web. Build in security measures.
I'm looking for help to make the proxy more generic support multiple local LLM services without any change on the HTML side.
Also looking for ideas how to make the HTML par more modular and easy to use.
updated
a model
13 days ago
syntropiq/anah-v2-Q8_0-GGUF
published
a model
13 days ago
syntropiq/anah-v2-Q8_0-GGUF
Organizations
models
8
sdalemorrey/smallthinker-with-tools-3b
Updated
sdalemorrey/LongWriter-llama3.1-8b-Q8_0-GGUF
Updated
•
1
•
1
sdalemorrey/granite-8b-code-instruct-128k-Q8_0-GGUF
Text Generation
•
Updated
•
3
sdalemorrey/Biggie-SmoLlm-0.15B-Base-Q2_K-GGUF
Updated
•
3
sdalemorrey/OpenELM-3B-Instruct-Q8_0-GGUF
Updated
sdalemorrey/Llama-3.1-8B-Lexi-Uncensored-Q4_K_M-GGUF
Updated
•
12
•
1
sdalemorrey/timesfm-200m
Updated
datasets
None public yet