Tenary Weight

Three Birds, One Stone: Fast, Accurate-aware and Cost-Efficient Accelerator for Ternary LLM
On-device LLM inference is increasingly important for latency- and privacy-sensitive applications, yet it remains challenging due to …
PDF Cite Project Slides DOI Slide Show
Three Birds, One Stone: Fast, Accurate-aware and Cost-Efficient Accelerator for Ternary LLM