PowerInfer/SmallThinker-3B-Preview
Text Generation
•
Updated
•
129k
•
382
PowerInfer
community
AI & ML interests
We are committed to advancing the field of AGI by pushing the boundaries of local LLM inference efficiency.
Recent Activity
View all activity
PowerInfer's activity
yixinsong
updated
a
model
21 days ago
Eval script
4
#9 opened 22 days ago
by
rawsh
About the training details
5
#5 opened about 1 month ago
by
hiyouga
How to Pair with Larger Models
4
#7 opened about 1 month ago
by
windkkk
Prompt/token adjust to stop "Overthinking" in unnescissary cases
2
#6 opened about 1 month ago
by
fuzzy-mittenz
example use colab?
8
#3 opened about 1 month ago
by
NickyNicky
Update README.md
#4 opened about 1 month ago
by
AISafety
Training: Second Phase
6
#2 opened about 1 month ago
by
tugstugi
[bot] Conversion to Parquet
#1 opened about 2 months ago
by
parquet-converter
[bot] Conversion to Parquet
#1 opened about 1 month ago
by
parquet-converter
Librarian Bot: Add language metadata for dataset
#2 opened about 1 month ago
by
librarian-bot
Evaluation
6
#1 opened about 1 month ago
by
tugstugi
Raincleared
authored
a
paper
3 months ago
Raincleared
authored
a
paper
5 months ago
bobozi
authored
a
paper
7 months ago
yixinsong
authored
3
papers
8 months ago
Turbo Sparse: Achieving LLM SOTA Performance with Minimal Activated Parameters
Paper
•
2406.05955
•
Published
•
24
ReLU$^2$ Wins: Discovering Efficient Activation Functions for Sparse LLMs
Paper
•
2402.03804
•
Published
•
2
PowerInfer-2: Fast Large Language Model Inference on a Smartphone
Paper
•
2406.06282
•
Published
•
37
yzmizeyu
authored
2
papers
8 months ago