Uh oh!
There was an error while loading.Please reload this page.
- Notifications
You must be signed in to change notification settings - Fork1.9k
An interactive graph to explore Scrapegraph-ai#1005
-
Hey, all I've always wanted to contribute to open-source projects. But at the very begining I found it a bit too difficult to navigate them and wrap my head around on the main flow and the main "logical" components. That is why I started working on a project to help people like me, who are visual learners. The project generates an interactive diagram starting from the highest level of abstraction and allows you to dive deeper into interesting components. Here is the diagram's starting point: graph LR Graph_Orchestration_Core["Graph Orchestration Core"] Graph_Definition_Setup["Graph Definition & Setup"] Web_Content_Fetching["Web Content Fetching"] Data_Transformation_Nodes["Data Transformation Nodes"] LLM_Processing_Nodes["LLM Processing Nodes"] External_Data_Integration["External Data Integration"] Code_Correction_Validation["Code Correction & Validation"] Graph_Definition_Setup -- "configures and initializes" --> Graph_Orchestration_Core Graph_Orchestration_Core -- "orchestrates and activates" --> Web_Content_Fetching External_Data_Integration -- "provides initial URLs/search results to" --> Web_Content_Fetching Web_Content_Fetching -- "provides raw content to" --> Data_Transformation_Nodes Graph_Orchestration_Core -- "orchestrates and activates" --> Data_Transformation_Nodes Data_Transformation_Nodes -- "prepares and structures data for" --> LLM_Processing_Nodes Graph_Orchestration_Core -- "orchestrates and activates" --> LLM_Processing_Nodes External_Data_Integration -- "enriches context for" --> LLM_Processing_Nodes LLM_Processing_Nodes -- "submits generated code to" --> Code_Correction_Validation Code_Correction_Validation -- "provides feedback/corrected code to" --> LLM_Processing_Nodes click Graph_Orchestration_Core href "https://github.com/CodeBoarding/GeneratedOnBoardings/blob/main/Scrapegraph-ai/Graph_Orchestration_Core.md" "Details" click Graph_Definition_Setup href "https://github.com/CodeBoarding/GeneratedOnBoardings/blob/main/Scrapegraph-ai/Graph_Definition_Setup.md" "Details" click Web_Content_Fetching href "https://github.com/CodeBoarding/GeneratedOnBoardings/blob/main/Scrapegraph-ai/Web_Content_Fetching.md" "Details" click Data_Transformation_Nodes href "https://github.com/CodeBoarding/GeneratedOnBoardings/blob/main/Scrapegraph-ai/Data_Transformation_Nodes.md" "Details" click LLM_Processing_Nodes href "https://github.com/CodeBoarding/GeneratedOnBoardings/blob/main/Scrapegraph-ai/LLM_Processing_Nodes.md" "Details" click External_Data_Integration href "https://github.com/CodeBoarding/GeneratedOnBoardings/blob/main/Scrapegraph-ai/External_Data_Integration.md" "Details" click Code_Correction_Validation href "https://github.com/CodeBoarding/GeneratedOnBoardings/blob/main/Scrapegraph-ai/Code_Correction_Validation.md" "Details"The generation tool is based on Static Analysis and LLMs and is fully open-source:https://github.com/CodeBoarding/CodeBoarding You can see the full diagram with explanations and related source code here:https://github.com/CodeBoarding/GeneratedOnBoardings/blob/main/Scrapegraph-ai/on_boarding.md Any feedback is appreciated! Would love to hear your opinion on diagrams as an exploration tooling and diagram first documentation! |
BetaWas this translation helpful?Give feedback.