hckrnws

Show HN: Speeding up LLM inference 2x times (possibly)

by kolinko

renonce
1m
kolinko
1m
bravura
1m
kolinko
1m
llama_person
1m
fennecbutt
1m
3abiton
1m
kolinko
1m
Macuyiko
1m
krageon
1m
spencerchubb
1m
kolinko
1m
bigcat12345678
1m
kolinko
1m
bigcat12345678
1m
kolinko
1m
hatthew
1m
kolinko
1m
marmaduke
1m
kolinko
1m
marmaduke
1m
kolinko
1m
jadeaffenjaeger
1m
kolinko
1m
globally_unique
1m
kolinko
1m
dartos
1m
kolinko
1m
dhruvdh
1m
kolinko
1m
indymike
1m
kolinko
1m
0x4139
1m
gsuuon
1m
kolinko
1m
AnthonyMouse
1m
kolinko
1m
yousif_123123
1m
spencerchubb
1m
toisanji
1m
kolinko
1m
toisanji
1m
kanwisher
1m
kolinko
1m
throwaway2562
1m
kolinko
1m
throwaway2562
1m
punnerud
1m
kolinko
1m

Comment was deleted :(

bick_nyers
1m
kolinko
1m
byyoung3
1m
kolinko
1m
anentropic
1m
kolinko
1m
huac
1m
kolinko
1m

Comment was deleted :(

gcy
1m
kolinko
1m
mijoharas
1m
brrrrrm
1m
kolinko
1m
smcleod
1m
kolinko
1m
avereveard
1m
kolinko
1m
wayoverthecloud
1m
kolinko
1m
saurik
1m
uhlo
1m
kolinko
1m
mentos
1m
uhlo
1m
kolinko
1m
coolvision
1m
kolinko
1m
a2code
1m
kolinko
1m
mijoharas
1m
kolinko
1m
addandsubtract
1m
thelastparadise
1m
kolinko
1m
brrrrrm
1m
kolinko
1m
kwikiel
1m
kolinko
1m
brrrrrm
1m
kolinko
1m
xrd
1m
kolinko
1m
Havoc
1m
quadrature
1m
littlestymaar
1m
kolinko
1m
iwontberude
1m
kolinko
1m
littlestymaar
1m
Hugsun
1m
refulgentis
1m
kolinko
1m
refulgentis
1m
kolinko
1m
xrd
1m
observationist
1m
oceanplexian
1m
observationist
1m

Comment was deleted :(

Comment was deleted :(

kolinko
1m
dang
1m
kolinko
1m
queuebert
1m
kolinko
1m
LorenDB
1m
HPsquared
1m

Comment was deleted :(

Samuel_w
1m

Comment was deleted :(

John_da
1m

Crafted by Rajat

Source Code