Natural language processing

Star

Natural language processing (NLP) is a field of computer science that studies how computers and humans interact. In the 1950s, Alan Turing published an article that proposed a measure of intelligence, now called the Turing test. More modern techniques, such as deep learning, have produced results in the fields of language modeling, parsing, and natural-language tasks.

Here are 38,538 public repositories matching this topic...

Language:All

Filter by language

All38,538 Python15,418 Jupyter Notebook14,289 JavaScript1,310 HTML1,229 Java688 TypeScript548 R245 Go214 C++208 Rust207

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

huggingface /transformers

Star154k

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

audio python nlp machine-learning natural-language-processing deep-learning pytorch transformer speech-recognition glm pretrained-models hacktoberfest gemma vlm pytorch-transformers model-hub llm qwen deepseek

UpdatedDec 16, 2025
Python

hiyouga /LLaMA-Factory

Star64.1k

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

nlp agent ai transformers moe llama gpt lora quantization gemma fine-tuning peft large-language-models llm rlhf instruction-tuning qlora qwen deepseek llama3

UpdatedDec 16, 2025
Python

microsoft /AI-For-Beginners

Star44.4k

12 Weeks, 24 Lessons, AI for All!

nlp machine-learning ai computer-vision deep-learning cnn artificial-intelligence gan rnn microsoft-for-beginners

UpdatedDec 12, 2025
Jupyter Notebook

apachecn /ailearning

Star41.9k

AiLearning：数据分析+机器学习实战+线性代数+PyTorch+NLTK+TF2

python nlp svm scikit-learn sklearn regression logistic dnn lstm pca rnn deeplearning kmeans adaboost apriori fp-growth svd naivebayes mahchine-leaning recommendedsystem

UpdatedNov 12, 2024
Python

google-research /bert

Star39.7k

TensorFlow code and pre-trained models for BERT

nlp natural-language-processing google tensorflow natural-language-understanding

UpdatedJul 23, 2024
Python

hankcs /HanLP

Star36k

Natural Language Processing for the next decade. Tokenization, Part-of-Speech Tagging, Named Entity Recognition, Syntactic & Semantic Dependency Parsing, Document Classification

nlp natural-language-processing text-classification hanlp named-entity-recognition dependency-parser pos-tagging semantic-parsing

UpdatedNov 15, 2025
Python

explosion /spaCy

Star33k

💫 Industrial-strength Natural Language Processing (NLP) in Python

python nlp data-science machine-learning natural-language-processing ai deep-learning neural-network text-classification cython artificial-intelligence spacy named-entity-recognition neural-networks nlp-library tokenization entity-linking

UpdatedNov 27, 2025
Python

666ghj /BettaFish

Star32.9k

微舆：人人可用的多Agent舆情分析助手，打破信息茧房，还原舆情原貌，预测未来走向，辅助决策！从0实现，不依赖任何框架。

nlp sentiment-analysis python3 data-analysis deep-search multi-agent-system agent-framework public-opinion-analysis llms deep-research

UpdatedDec 16, 2025
Python

ashishpatel26 /500-AI-Machine-learning-Deep-learning-Computer-vision-NLP-Projects-with-code

Star30k

500 AI Machine learning Deep learning Computer vision NLP Projects with code

python nlp data-science machine-learning awesome computer-vision deep-learning artificial-intelligence nlp-projects machine-learning-projects artificial-intelligence-projects computer-vision-project deep-learning-project

UpdatedAug 1, 2025

stanford-oval /storm

Star27.7k

An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

nlp naacl report-generation knowledge-curation large-language-models retrieval-augmented-generation agentic-rag emnlp2024 deep-research

UpdatedSep 30, 2025
Python

deepset-ai /haystack

Star23.6k

AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

python nlp agent machine-learning information-retrieval ai transformers orchestration pytorch gemini question-answering summarization agents semantic-search rag gpt-4 large-language-models llm generative-ai retrieval-augmented-generation

UpdatedDec 16, 2025
MDX

lukasmasuch /best-of-ml-python

Star22.9k

🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.

python nlp data-science machine-learning deep-learning tensorflow scikit-learn keras ml data-visualization pytorch transformer data-analysis gpt automl jax data-visualizations gpt-3 chatgpt

UpdatedDec 11, 2025

HqWu-HITCS /Awesome-Chinese-LLM

Star21.9k

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

nlp chinese llama awesome-lists llm chatglm

UpdatedMay 19, 2025

microsoft /unilm

Star21.9k

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

nlp kosmos deepnet multimodal bitnet pre-trained-model unilm minilm layoutlm beit document-ai layoutxlm trocr foundation-models llm beit-3 xlm-e mllm kosmos-1 textdiffuser

UpdatedDec 15, 2025
Python

huggingface /datasets

Star21k

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

nlp machine-learning natural-language-processing ai computer-vision deep-learning tensorflow numpy speech pandas pytorch artificial-intelligence datasets huggingface llm dataset-hub

UpdatedDec 16, 2025
Python

RasaHQ /rasa

Star20.9k

💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants