@karpathy - Random note on k-Nearest Neighbor lookups on embeddings: in
Andrej Karpathy✓@karpathy
2023-04-14Random note on k-Nearest Neighbor lookups on embeddings: in my experience much better results can be obtained by training SVMs instead. Not too widely known.
Short example:
https://github.com/karpathy/randomfun/blob/master/knn_vs_…
Works because SVM ranking considers the unique aspects of your query w.r.t. data.