lans_throwawayB to LocalLLaMA@poweruser.forumEnglish · 1 year agoLook ahead decoding offers massive (~1.5x) speedup for inferencelmsys.orgexternal-linkmessage-square4fedilinkarrow-up11arrow-down10cross-posted to: localllama@poweruser.forum
arrow-up11arrow-down1external-linkLook ahead decoding offers massive (~1.5x) speedup for inferencelmsys.orglans_throwawayB to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square4fedilinkcross-posted to: localllama@poweruser.forum