small-language-model

Star

Here are 26 public repositories matching this topic...

Language:All

Filter by language

All26 Python17 Jupyter Notebook3 Kotlin1 TypeScript1

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

microsoft /PhiCookBook

Star3.6k

This is a Phi Family of SLMs book for getting started with Phi Models. Phi a family of open sourced AI models developed by Microsoft. Phi models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks

cookbook slm language-model phi3 phi3-vision phi3-testing small-language-model phi-4 phi4 phi4-mini phi4-multimodal phi-4-mini phi-4-multimodal

UpdatedNov 27, 2025
Jupyter Notebook

LoserCheems /WonderfulMatrices

Star43

Wonderful Matrices to Build Small Language Models

python nlp machine-learning natural-language-processing deep-learning pytorch transformer feedforward-neural-network language-model attention-mechanism attention-is-all-you-need mixture-of-experts pytorch-transformers foundation-models small-language-models small-language-model dynamic-mask-attention cross-domain-mixture-of-experts

UpdatedFeb 15, 2025
Python

DarrylBayliss /Simon-Says-Android

Star22

An Android App recreating the Simon Says game. Uses MediaPipe to run an LLM on device

android kotlin clean-architecture slm kotlin-coroutines android-clean-architecture jetpack-compose mediapipe kotlin-concurency efficientnetv2 jetpack-navigation-compose llm generative-ai llm-inference mediapipe-classifier small-language-model gemma3 gemma3-1b-it gemma3-1b

UpdatedSep 18, 2025
Kotlin

CycloneBoy /slm_sql

Star21

SLM-SQL: An Exploration of Small Language Models for Text-to-SQL

text-to-sql nl2sql small-language-model grpo

UpdatedAug 12, 2025

pittisl /Sparse-Activation

Star7

Code for paper "Achieving Sparse Activation in Small Language Models"

attribution compute-efficient-ml small-language-model sparse-activation

UpdatedSep 2, 2024
Python

Mehrdadghassabi /Gaokerena-R

Star4

Enhancing Reasoning Skills in Small Persian Medical Language Models Can Outperform Large-Scale Data Training

healthcare-ai medical-language-model small-language-model reasoning-ai

UpdatedNov 29, 2025
Jupyter Notebook

lohar-animesh-27112001 /Decorder-Only-Transformer-Model

Star3

TinyGPT - 9M Parameters

small-language-model

UpdatedNov 27, 2025
Python

bunyaminergen /Qwen2.5-Coder-1.5B-Instruct-Reasoning

Star3

This repository provides everything you need to perform Supervised Fine-Tuning (SFT) of the Qwen2.5-Coder-1.5B-Instruct model—or any of its larger variants (7B, 14B, 32B)—on the Qwen Models, using the nvidia/OpenCodeReasoning dataset.

fine-tuning llm qwen small-language-model reasoning-language-models

UpdatedApr 28, 2025
Python

AtomMind-Ai /AtomMind

Star1

AtomMind is a lightweight Small Scientific Language Model (Sslm) for reasoning across Math, Physics, Chemistry, and Biology using domain experts, symbolic reasoning, and optimization modules. It supports optional memory and self-monitoring to improve problem-solving and accuracy.

python nlp machine-learning natural-language-processing ai pytorch slm ai-agents small-language-models small-language-model

UpdatedNov 24, 2025
Python

ai-in-pm /A.D.A.M.---SLM

Star1

Applied Decision Architecture Matrix - Small Language Model

ai slm self-contained no-api-key small-language-model local-slm no-frontier-llm private-slm

UpdatedJul 25, 2025
Python

russellgeum /SLM-Pruning-Quantization

Star1

Pruning, Quantization recipe for Small Language Model

deep-learning pruning quantization small-language-model

UpdatedAug 4, 2024

vepr-ua /slm-rag-experimentation

Star1

GraphRAG-powered Small Language Model for experimentation and statistical analysis Q&A

experimentation slm retrieval-augmented-generation small-language-model product-experimentation

UpdatedNov 2, 2025
Python

alankrantas /just-another-ai-assistant-huggingface-transformers-js

Star1

A HuggingFace Transformer.js Demo Running Generative AI Model in Web Browser

ai reactjs artificial-intelligence slm huggingface huggingface-transformers ai-assistant llm generative-ai large-language-model transformerjs small-language-model

UpdatedNov 24, 2025
TypeScript

BhavanasiG /AI-Days-SLM-Demo

Star0

A Streamlit demo using an SLM (Phi) and RAG to showcase how an AI can help users with learning functionality on a website

slm retrieval-augmented-generation rag-chatbot small-language-model

UpdatedOct 9, 2025
Python

Qomplainerz /companionem-linguae

Star0

An small language model in early stages of development

language-model small-language-model

UpdatedOct 12, 2025
Python

FaNa-AI /SLM

Star0

A small-scale language model implementation using GPT2 for text generation in Persian and English. This project is designed for fast experimentation, minimal setup, and bilingual prompt generation.

transformers text-generation language-modeling slm tokenization fine-tuning gpt2 hugging-face masked-language-modeling small-language-model causal-language-model

UpdatedJul 24, 2025
Jupyter Notebook

richengguy /calc.ai

Star0

Transformer-based Calculator

machine-learning transformers small-language-model

UpdatedMay 25, 2025
Python

and2049 /mamba-slm-hybrid-optimizer

Star0

Small Language Model Implementation based on Mamba (SSM) architecture. Muon optimizer to the 2D weight matrices while using the stable AdamW optimizer for all other parameters.

machine-learning ai artificial-intelligence slm language-model mamba generative-ai small-language-models mamba-state-space-models small-language-model