1216·
15 hours agoPlease ignore the post if you are not interested.
matti
- 1 Post
- 2 Comments
Joined 5 months ago
Cake day: June 2nd, 2026
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
I’m getting like 10-20tps with some other similar-sized models, but didn’t benchmark qwen yet. Note that they are mixture-of-experts, so they are evaluating only a few billion parameters each time.