LLM Embeddings

When Dimensionality Hurts: The Role of LLM Embedding Compression for Noisy Regression Tasks
Demonstrates that compressing LLM embeddings can improve performance on noisy regression tasks like financial prediction by reducing overfitting, suggesting compression acts as a regularization mechanism.
Felix Drinkall, Janet B. Pierrehumbert, Stefan Zohren
PDF Cite DOI