Movatterモバイル変換

[0]ホーム
URL:

Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

 Sign up
Appearance settings

pgml chat with history + additional functionality#1047

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Merged
santiatpml merged 14 commits intomasterfromsanti-pgml-chat-multi-turn
Oct 24, 2023
Merged
Show file tree
Hide file tree
Changes fromall commits
Commits
Show all changes
14 commits
Select commitHold shift + click to select a range
b15e14b
Reasonably working version
santiadavaniSep 14, 2023
aff4d9b
Reasonably working version 2
santiadavaniSep 15, 2023
3f960c4
moved instructions to system prompt
santiadavaniSep 15, 2023
2a0fe01
Minor updates
santiadavaniSep 15, 2023
fc551d4
GPT4 instead of GPT-3.5
santiadavaniSep 15, 2023
cc5da68
Working GPT-4 version without memory
santiadavaniSep 15, 2023
df9850b
multi-turn multi-user working version
santiadavaniSep 21, 2023
cdf2e65
Added parent message id to handle user/assistant message dependency
santiadavaniSep 25, 2023
377feba
Use pgml sdk from test pypi
santiadavaniSep 25, 2023
60f0ea4
Updated readme with all command line options
santiadavaniSep 25, 2023
99a8388
Changed the default chat history to 0
santiadavaniSep 25, 2023
05509d0
Changed the default programming language to SQL
santiadavaniSep 25, 2023
27576be
pgml 0.9.4 from pypi
santiadavaniOct 24, 2023
f73dc7c
pgml-chat 0.2.0 pushed to pypi
santiadavaniOct 24, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 1 addition & 9 deletionspgml-apps/pgml-chat/.env.template
View file
Open in desktop
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,6 @@
OPENAI_API_KEY=<OPENAI_API_KEY>
DATABASE_URL=<POSTGRES_DATABASE_URL starts with postgres://>
MODEL=hkunlp/instructor-xl
MODEL_PARAMS={"instruction": "Represent the Wikipedia document for retrieval: "}
QUERY_PARAMS={"instruction": "Represent the Wikipedia question for retrieving supporting documents: "}
SYSTEM_PROMPT="You are an assistant to answer questions about an open source software named PostgresML. Your name is PgBot. You are based out of San Francisco, California."
BASE_PROMPT="Given relevant parts of a document and a question, create a final answer.\
Include a SQL query in the answer wherever possible. \
Use the following portion of a long document to see if any of the text is relevant to answer the question.\
\nReturn any relevant text verbatim.\n{context}\nQuestion: {question}\n \
If the context is empty then ask for clarification and suggest user to send an email to team@postgresml.org or join PostgresML [Discord](https://discord.gg/DmyJP3qJ7U)."

SLACK_BOT_TOKEN=<SLACK_BOT_TOKEN>
SLACK_APP_TOKEN=<SLACK_APP_TOKEN>
DISCORD_BOT_TOKEN=<DISCORD_BOT_TOKEN>
5 changes: 4 additions & 1 deletionpgml-apps/pgml-chat/.gitignore
View file
Open in desktop
Original file line numberDiff line numberDiff line change
Expand Up@@ -157,4 +157,7 @@ cython_debug/
# be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore
# and can be added to the global gitignore or merged into this file. For a more nuclear
# option (not recommended) you can uncomment the following to ignore the entire idea folder.
#.idea/
#.idea/

pgml_chat/pgml_playground.py
pgml_chat/llama2.py
38 changes: 18 additions & 20 deletionspgml-apps/pgml-chat/README.md
View file
Open in desktop
Original file line numberDiff line numberDiff line change
Expand Up@@ -34,23 +34,16 @@ wget https://raw.githubusercontent.com/postgresml/postgresml/master/pgml-apps/pg
```bash
OPENAI_API_KEY=<OPENAI_API_KEY>
DATABASE_URL=<POSTGRES_DATABASE_URL starts with postgres://>
MODEL=hkunlp/instructor-xl
MODEL_PARAMS={"instruction": "Represent the Wikipedia document for retrieval: "}
QUERY_PARAMS={"instruction": "Represent the Wikipedia question for retrieving supporting documents: "}
SYSTEM_PROMPT="You are an assistant to answer questions about an open source software named PostgresML. Your name is PgBot. You are based out of San Francisco, California."
BASE_PROMPT="Given relevant parts of a document and a question, create a final answer.\
Include a SQL query in the answer wherever possible. \
Use the following portion of a long document to see if any of the text is relevant to answer the question.\
\nReturn any relevant text verbatim.\n{context}\nQuestion: {question}\n \
If the context is empty then ask for clarification and suggest user to send an email to team@postgresml.org or join PostgresML [Discord](https://discord.gg/DmyJP3qJ7U)."
```

# Usage
You can get help on the command line interface by running:

```bash
(pgml-bot-builder-py3.9) pgml-chat % pgml-chat --help
usage: pgml-chat [-h] --collection_name COLLECTION_NAME [--root_dir ROOT_DIR] [--stage {ingest,chat}] [--chat_interface {cli,slack}]
(pgml-bot-builder-py3.9) pgml-chat % pgml-chat % pgml-chat --help
usage: pgml-chat [-h] --collection_name COLLECTION_NAME [--root_dir ROOT_DIR] [--stage {ingest,chat}] [--chat_interface {cli,slack,discord}]
[--chat_history CHAT_HISTORY] [--bot_name BOT_NAME] [--bot_language BOT_LANGUAGE] [--bot_topic BOT_TOPIC]
[--bot_topic_primary_language BOT_TOPIC_PRIMARY_LANGUAGE] [--bot_persona BOT_PERSONA]

PostgresML Chatbot Builder

Expand All@@ -61,8 +54,19 @@ optional arguments:
--root_dir ROOT_DIR Input folder to scan for markdown files. Required for ingest stage. Not required for chat stage (default: None)
--stage {ingest,chat}
Stage to run (default: chat)
--chat_interface {cli,slack,discord}
--chat_interface {cli,slack,discord}
Chat interface to use (default: cli)
--chat_history CHAT_HISTORY
Number of messages from history used for generating response (default: 1)
--bot_name BOT_NAME Name of the bot (default: PgBot)
--bot_language BOT_LANGUAGE
Language of the bot (default: English)
--bot_topic BOT_TOPIC
Topic of the bot (default: PostgresML)
--bot_topic_primary_language BOT_TOPIC_PRIMARY_LANGUAGE
Primary programming language of the topic (default: )
--bot_persona BOT_PERSONA
Persona of the bot (default: Engineer)
```
## Ingest
In this step, we ingest documents, chunk documents, generate embeddings and index these embeddings for fast query.
Expand DownExpand Up@@ -161,14 +165,8 @@ pip install .



# Options
You can control the behavior of the chatbot by setting the following environment variables:
- `SYSTEM_PROMPT`: This is the prompt that is used to initialize the chatbot. You can customize this prompt to change the behavior of the chatbot. For example, you can change the name of the chatbot or the location of the chatbot.
- `BASE_PROMPT`: This is the prompt that is used to generate responses to user queries. You can customize this prompt to change the behavior of the chatbot.
- `MODEL`: This is the open source embedding model used to generate embeddings for the documents. You can change this to use a different model.

# Roadmap
- ~~`hyerbot --chat_interface {cli, slack, discord}`thatsupports Slack,andDiscord.~~
- ~~Use a collection for chat historythatcan be retrievedandused to generate responses.~~
- Support for file formats like rst, html, pdf, docx, etc.
- Support for open source models in addition to OpenAI for chat completion.
- Support for multi-turn converstaions using converstaion buffer.Use a collection for chat history that can be retrieved and used to generate responses.
- Support for multi-turn converstaions using converstaion buffer.
2 changes: 2 additions & 0 deletionspgml-apps/pgml-chat/pgml_chat/.gitignore
View file
Open in desktop
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
pgml_playground.py
llama2.py
Loading
[8]ページ先頭
©2009-2025 Movatter.jp