New discussion

KV cache not used by default

#7 opened about 21 hours ago by
jhy-123

eos early stop

2
#6 opened about 1 month ago by
Serpient

Evaluation detail

2
#5 opened about 1 month ago by
Serpient

Attention computation

1
#4 opened about 1 month ago by
Serpient

Add support for greedy decoding

#3 opened about 1 month ago by
adityastomar

No inference providers?

#1 opened about 1 month ago by
weightsnweights