Skip to content
Powered by Algolia
Log in
Create account
DEV Community
#
awq
Follow
Hide
Posts
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
llm-compressor for vLLM: The FP8/AWQ Deployment Tradeoff
Jangwook Kim
Jangwook Kim
Jangwook Kim
Follow
Nov 10
llm-compressor for vLLM: The FP8/AWQ Deployment Tradeoff
#
quantization
#
vllm
#
fp8
#
awq
Add Comment
9 min read
Model Distillation & Quantization: Running 8B Parameter Models at a Fraction of Cloud Cost
Muhammad Tahir
Muhammad Tahir
Muhammad Tahir
Follow
Oct 12
Model Distillation & Quantization: Running 8B Parameter Models at a Fraction of Cloud Cost
#
modeldistillation
#
quantization
#
vllm
#
awq
Add Comment
10 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account
‹
›
⌂
移動
⧉
↓
×
≡