ColBERT-Zero: To Pre-train Or Not To Pre-train ColBERT models
Paper
• 2602.16609 • Published
• 6
ColBERT-Zero 🐶
First large-scale fully pre-trained ColBERT model using only public data, outperforming GTE-ModernColBERT and GTE-ModernBERT
-
-
lightonai/ColBERT-Zero
Sentence Similarity • 0.1B • Updated • 226 • 18 -
lightonai/ColBERT-Zero-supervised
Sentence Similarity • 0.1B • Updated • 21 • 3 -
lightonai/ColBERT-Zero-unsupervised
Sentence Similarity • 0.1B • Updated • 23 • 1 -
lightonai/ModernColBERT-embed-base
Sentence Similarity • 0.1B • Updated • 18 -
lightonai/ModernColBERT-embed-base-supervised
Sentence Similarity • 0.1B • Updated • 23 -
lightonai/ModernColBERT-embed-base-kd-only
Sentence Similarity • 0.1B • Updated • 25 • 1 -
lightonai/ColBERT-Zero-noprompts
Sentence Similarity • 0.1B • Updated • 26 • 2 -
lightonai/ColBERT-Zero-supervised-noprompts
Sentence Similarity • 0.1B • Updated • 16 -
lightonai/ColBERT-Zero-unsupervised-noprompts
Sentence Similarity • 0.1B • Updated • 24