embedding-evaluation

Evaluate custom and HuggingFace text-to-image/zero-shot-image-classification models like CLIP, SigLIP, DFN5B, and EVA-CLIP. Metrics include Zero-shot accuracy, Linear Probe, Image retrieval, and KNN accuracy.

knn-search evaluation-metrics evaluation-framework linear-probing embedding-evaluation zero-shot-retrieval zero-shot-classification model-evaluation-metrics embeddings-extraction zero-shot-image-classification text-to-image-evaluation

UpdatedJan 15, 2025
Jupyter Notebook

VectorBoard /vectorboard

Star50

Open Source Embeddings Optimisation and Eval Framework for RAG/LLM Applications. Documentations athttps://docs.vectorboard.ai/introduction

embeddings hyperparameter-optimization eval hacktoberfest rag embedding-evaluation llms

UpdatedOct 19, 2023
Python

IhabBendidi /sentiment_embeddings

Star13

A scientific benchmark and comparison of the performance of sentiment analysis models in NLP on small to medium datasets

visualization python nlp benchmark sentiment-analysis notebook word2vec keras pytorch lstm colab logistic-regression doc2vec bert twitter-data 3d-visualization textblob sentiment-embeddings embedding-evaluation

UpdatedDec 14, 2020
Jupyter Notebook

aida-ugent /TRACE

Star13

Interactive quality analysis for two-dimensional embeddings

visualization dimensionality-reduction visual-analytics scatterplot embedding-evaluation

UpdatedOct 14, 2025
JavaScript

kuhumcst /Danish-Similarity-Dataset

Star8

Gold standard resource for evaluation of Danish word embedding models.

UpdatedMay 22, 2020

eXascaleInfolab /GraphEmbEval

Star6

Graph (network) embeddings evaluation framework via classification, gram martix construction for links prediction

embedding-evaluation graph-embeddings-evaluation feature-accuracy-evaluation

UpdatedOct 10, 2019
Python

stannida /skill-embeddings

Star2

Repository for the Master Thesis "Encoding semantic information about skills in the domain of human resources" in the University of Koblenz-Landau in cooperation with talentsconnect AG.

embeddings thesis-project embedding-evaluation attract-repel

UpdatedNov 22, 2021
Jupyter Notebook

mailio /mailio-ai

Star1

Privacy-first semantic search engine for Mailio’s encrypted email system

email semantic-search embedding-evaluation agentic-ai

UpdatedNov 23, 2025
Jupyter Notebook

RubenBranco /embeval

Star1

A framework for word embedding evaluation automation and visualization.

word-embeddings glue data-visualization semantic-similarity embedding-evaluation

UpdatedDec 8, 2022
Python

dalisson /pairwise_cosine_distance_pytorch

Star1

Simple function that computes pairwaise cosine distance between several vectors at once, pytorch can only compute beween two vectors at a time, which is time consuming and inneficient when you have multiple vectors.

python deep-learning metrics pytorch cosine-similarity pytorch-implementation embedding-evaluation

UpdatedMar 24, 2020
Python

aron-radvanyi /GENERATIVE_AI_Embedding_Metrics_Calculator

Star1

This is a repository for a Jupyter based tool to calculate Greedy Matching, Vector Extrema and Average Embedding evaluation metrics for generative AI chatbots

nlp machine-learning natural-language-processing ai deep-learning word2vec chatbot question-answering chatbot-application embedding evaluation-metrics embedding-evaluation chatbot-evaluation generative-ai embedding-metrics