Natural language processing

Star

Natural language processing (NLP) is a field of computer science that studies how computers and humans interact. In the 1950s, Alan Turing published an article that proposed a measure of intelligence, now called the Turing test. More modern techniques, such as deep learning, have produced results in the fields of language modeling, parsing, and natural-language tasks.

Here are 34,907 public repositories matching this topic...

Language:All

Filter by language

All34,907 Python13,690 Jupyter Notebook13,210 JavaScript1,168 HTML1,109 Java668 TypeScript417 R238 Go202 C++201 Rust187

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

huggingface /transformers

Star147k

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

audio python nlp machine-learning natural-language-processing deep-learning pytorch transformer speech-recognition glm pretrained-models hacktoberfest gemma vlm pytorch-transformers model-hub llm qwen deepseek

UpdatedJul 18, 2025
Python

hiyouga /LLaMA-Factory

Star54.6k

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

nlp agent ai transformers moe llama gpt lora quantization gemma fine-tuning peft large-language-models llm rlhf instruction-tuning qlora qwen deepseek llama3

UpdatedJul 18, 2025
Python

apachecn /ailearning

Star41.1k

AiLearning：数据分析+机器学习实战+线性代数+PyTorch+NLTK+TF2

python nlp svm scikit-learn sklearn regression logistic dnn lstm pca rnn deeplearning kmeans adaboost apriori fp-growth svd naivebayes mahchine-leaning recommendedsystem

UpdatedNov 12, 2024
Python

google-research /bert

Star39.3k

TensorFlow code and pre-trained models for BERT

nlp natural-language-processing google tensorflow natural-language-understanding

UpdatedJul 23, 2024
Python

microsoft /AI-For-Beginners

Star39k

12 Weeks, 24 Lessons, AI for All!

nlp machine-learning ai computer-vision deep-learning cnn artificial-intelligence gan rnn microsoft-for-beginners

UpdatedJun 25, 2025
Jupyter Notebook

hankcs /HanLP

Star35.4k

中文分词词性标注命名实体识别依存句法分析成分句法分析语义依存分析语义角色标注指代消解风格转换语义相似度新词发现关键词短语提取自动摘要文本分类聚类拼音简繁转换自然语言处理

nlp natural-language-processing text-classification hanlp named-entity-recognition dependency-parser pos-tagging semantic-parsing

UpdatedMay 15, 2025
Python

explosion /spaCy

Star32k

💫 Industrial-strength Natural Language Processing (NLP) in Python

python nlp data-science machine-learning natural-language-processing ai deep-learning neural-network text-classification cython artificial-intelligence spacy named-entity-recognition neural-networks nlp-library tokenization entity-linking

UpdatedMay 28, 2025
Python

stanford-oval /storm

Star26.8k

An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

nlp naacl report-generation knowledge-curation large-language-models retrieval-augmented-generation agentic-rag emnlp2024 deep-research

UpdatedJun 27, 2025
Python

ashishpatel26 /500-AI-Machine-learning-Deep-learning-Computer-vision-NLP-Projects-with-code

Star25.4k

500 AI Machine learning Deep learning Computer vision NLP Projects with code

python nlp data-science machine-learning awesome computer-vision deep-learning artificial-intelligence nlp-projects machine-learning-projects artificial-intelligence-projects computer-vision-project deep-learning-project

UpdatedJul 26, 2024

lukasmasuch /best-of-ml-python

Star21.6k

🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.

python nlp data-science machine-learning deep-learning tensorflow scikit-learn keras ml data-visualization pytorch transformer data-analysis gpt automl jax data-visualizations gpt-3 chatgpt

UpdatedJul 17, 2025

deepset-ai /haystack

Star21.6k

AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

python nlp agent machine-learning information-retrieval ai transformers orchestration pytorch gemini question-answering summarization agents semantic-search rag gpt-4 large-language-models llm generative-ai retrieval-augmented-generation

UpdatedJul 18, 2025
Python

microsoft /unilm

Star21.6k

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

nlp kosmos deepnet multimodal bitnet pre-trained-model unilm minilm layoutlm beit document-ai layoutxlm trocr foundation-models llm beit-3 xlm-e mllm kosmos-1 textdiffuser

UpdatedJul 3, 2025
Python

HqWu-HITCS /Awesome-Chinese-LLM

Star20.7k

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

nlp chinese llama awesome-lists llm chatglm

UpdatedMay 19, 2025

RasaHQ /rasa

Star20.4k

💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants