Natural language processing

Star

Natural language processing (NLP) is a field of computer science that studies how computers and humans interact. In the 1950s, Alan Turing published an article that proposed a measure of intelligence, now called the Turing test. More modern techniques, such as deep learning, have produced results in the fields of language modeling, parsing, and natural-language tasks.

Here are 41,211 public repositories matching this topic...

Language:All

Filter by language

All41,211 Python16,826 Jupyter Notebook14,950 JavaScript1,408 HTML1,329 Java695 TypeScript662 R253 Rust243 Go228 C++221

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

huggingface /transformers

Star157k

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

audio python nlp machine-learning natural-language-processing deep-learning pytorch transformer speech-recognition glm pretrained-models hacktoberfest gemma vlm pytorch-transformers model-hub llm qwen deepseek

UpdatedFeb 20, 2026
Python

hiyouga /LlamaFactory

Star67.4k

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

nlp agent ai transformers moe llama gpt lora quantization gemma fine-tuning peft large-language-models llm rlhf instruction-tuning qlora qwen deepseek llama3

UpdatedFeb 12, 2026
Python

microsoft /AI-For-Beginners

Star45.4k

12 Weeks, 24 Lessons, AI for All!

nlp machine-learning ai computer-vision deep-learning cnn artificial-intelligence gan rnn microsoft-for-beginners

UpdatedFeb 19, 2026
Jupyter Notebook

apachecn /ailearning

Star42k

AiLearning：数据分析+机器学习实战+线性代数+PyTorch+NLTK+TF2

python nlp svm scikit-learn sklearn regression logistic dnn lstm pca rnn deeplearning kmeans adaboost apriori fp-growth svd naivebayes mahchine-leaning recommendedsystem

UpdatedNov 12, 2024
Python

google-research /bert

Star39.9k

TensorFlow code and pre-trained models for BERT

nlp natural-language-processing google tensorflow natural-language-understanding

UpdatedJul 23, 2024
Python

hankcs /HanLP

Star36.1k

中文分词词性标注命名实体识别依存句法分析成分句法分析语义依存分析语义角色标注指代消解风格转换语义相似度新词发现关键词短语提取自动摘要文本分类聚类拼音简繁转换自然语言处理

nlp natural-language-processing text-classification hanlp named-entity-recognition dependency-parser pos-tagging semantic-parsing

UpdatedNov 15, 2025
Python

666ghj /BettaFish

Star35.6k

微舆：人人可用的多Agent舆情分析助手，打破信息茧房，还原舆情原貌，预测未来走向，辅助决策！从0实现，不依赖任何框架。

nlp sentiment-analysis python3 data-analysis deep-search multi-agent-system agent-framework public-opinion-analysis llms deep-research

UpdatedFeb 11, 2026
Python

google /langextract

Star33.3k

A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

python nlp gemini structured-data gemini-api information-extration large-language-models llm gemini-pro gemini-ai gemini-flash

UpdatedFeb 18, 2026
Python

explosion /spaCy

Star33.2k

💫 Industrial-strength Natural Language Processing (NLP) in Python

python nlp data-science machine-learning natural-language-processing ai deep-learning neural-network text-classification cython artificial-intelligence spacy named-entity-recognition neural-networks nlp-library tokenization entity-linking

UpdatedNov 27, 2025
Python

ashishpatel26 /500-AI-Machine-learning-Deep-learning-Computer-vision-NLP-Projects-with-code

Star31.8k

500 AI Machine learning Deep learning Computer vision NLP Projects with code

python nlp data-science machine-learning awesome computer-vision deep-learning artificial-intelligence nlp-projects machine-learning-projects artificial-intelligence-projects computer-vision-project deep-learning-project

UpdatedAug 1, 2025

stanford-oval /storm

Star27.9k

An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

nlp naacl report-generation knowledge-curation large-language-models retrieval-augmented-generation agentic-rag emnlp2024 deep-research

UpdatedSep 30, 2025
Python

deepset-ai /haystack

Star24.2k

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

python nlp agent machine-learning information-retrieval ai transformers orchestration pytorch gemini question-answering summarization agents semantic-search rag gpt-4 large-language-models llm generative-ai retrieval-augmented-generation

UpdatedFeb 20, 2026
MDX

lukasmasuch /best-of-ml-python

Star23.2k

🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.

python nlp data-science machine-learning deep-learning tensorflow scikit-learn keras ml data-visualization pytorch transformer data-analysis gpt automl jax data-visualizations gpt-3 chatgpt

UpdatedFeb 19, 2026

HqWu-HITCS /Awesome-Chinese-LLM

Star22.2k

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

nlp chinese llama awesome-lists llm chatglm

UpdatedMay 19, 2025

microsoft /unilm

Star22k

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

nlp kosmos deepnet multimodal bitnet pre-trained-model unilm minilm layoutlm beit document-ai layoutxlm trocr foundation-models llm beit-3 xlm-e mllm kosmos-1 textdiffuser

UpdatedJan 23, 2026
Python

huggingface /datasets

Star21.2k

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

nlp machine-learning natural-language-processing ai computer-vision deep-learning tensorflow numpy speech pandas pytorch artificial-intelligence datasets huggingface llm dataset-hub

UpdatedFeb 18, 2026
Python

RasaHQ /rasa

Star21.1k

💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants