Repository files navigation

We invite you to explore ourblog for more details.

Before building the application, you’ll need to set up a basic Python environment. Follow these steps to get started:

1. Install Python 3 on your system.
2. Install the required dependencies by running:

python -m pip install -r requirements.txt

1. Create an account atCrawlbase and log in.
2. After registration, you will receive 5,000 free requests.
3. Locate and copy your Crawling APINormal requests token.

Before running the examples, make sure to replace every instance of:

1. "<Normal requests token>" with yourCrawling API Normal requests token.
2. "<JavaScript requests token>" with yourCrawling API JavaScript requests token.

• To run the example from the"Example 1: Basic Page" section:

python basic_page.py

• To run the example from the"Example 2: JavaScript Page" section:

python javascript_page.py

• To run the example from the"Example 3: Basic Page Using Crawling API" section:

python basic_page_using_crawling_api.py

🛡 DisclaimerThis repository is for educational purposes only. Please make sure you comply with the Terms of Service of any website you scrape. Use this responsibly and only where permitted.

Copyright 2025 Crawlbase