Uh oh!
There was an error while loading.Please reload this page.
- Notifications
You must be signed in to change notification settings - Fork1.9k
-
I would like to get the html of the web page that ScrapeGraphAI received as a response. I want to compare its content vs what I receive when I use a browser. |
BetaWas this translation helpful?Give feedback.
All reactions
Replies: 1 comment
-
Hello@Tony20221! I'm here to help you out with any bugs, questions, or contributions you have. If you need assistance, feel free to ask. To get and save the raw HTML of the web page that ScrapeGraphAI received, you can use the # Import the functionfromscrape_doimportscrape_do_fetch# Define your parameterstoken='your_api_token'target_url='http://example.com'use_proxy=False# or True if you want to use a proxygeoCode=None# or specify a country code if neededsuper_proxy=False# or True if you want to use Residential & Mobile Proxy Networks# Fetch the raw HTMLraw_html=scrape_do_fetch(token,target_url,use_proxy,geoCode,super_proxy)# Save the raw HTML to a filewithopen('webpage.html','w',encoding='utf-8')asfile:file.write(raw_html) This code will fetch the raw HTML of the specified web page and save it to a file named To continue talking toDosu, mention@dosu. Help Dosu learn! Give it feedback:Great Response |Irrelevant Answer |Incorrect Sources |Too Verbose |Hallucination |Other |
BetaWas this translation helpful?Give feedback.