Movatterモバイル変換

[0]ホーム
URL:

Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

 Sign up
Appearance settings

Web scraping API for building AI applications.

License

NotificationsYou must be signed in to change notification settings

mike-gee/webtranspose

Repository files navigation

Web Transpose. Simple APIs to get data from the internet.

Web Crawler & AI Web Scraper APIs for building new web experiences.

pip install webtranspose

XLicenseLicense

Introduction ·Installation ·Docs


Introduction

In the near future,nobody will open websites. Instead, we will be directly served the information we are seeking. New web experiences will combine the information from many websites into a single, unified experience.

Web Transpose is a collection of API tools that allow building these new web experiences simple.

Crawl

importwebtransposeaswebtimportosos.environ['WEBTRANSPOSE_API_KEY']="YOUR WEBT API KEY"crawl=webt.Crawl("https://www.example.com",max_pages=100,render_js=True,)awaitcrawl.crawl()# crawl.queue_crawl() for async

Scrape

importwebtransposeaswebtimportosos.environ['WEBTRANSPOSE_API_KEY']="YOUR WEBT API KEY"schema= {"Merchant Name":"string","Title of Product":"string","Product Photo URL":"string",}scraper=webt.Scraper(schema,render_js=True, )out_json=scraper.scrape("https://www.example.com")

Web Search (AI SERP API)

importwebtransposeaswebtimportosos.environ['WEBTRANSPOSE_API_KEY']="YOUR WEBT API KEY"results=webt.search("what caused the fourth great ninja war?")# results.keys()# ['results']# AI Filterresults=webt.search_filter("Paul Graham's Blog")# results.keys()# ['results', 'filtered_results']

Installation

Non-Python Users:📄 API Docs.

This repo contains a locallite installation of Web Transpose. This is a good option if you want to run Web Transpose locally on your machine for quick use cases.

pip install webtranspose

However, if you wish to leverage the full tools of Web Transpose and use in production, you should add your API key to add thefull version.

os.environ["WEBTRANSPOSE_API_KEY"]="YOUR_API_KEY_HERE"

Enterprise Support

Web Transpose serves enterprises small and large. We partner with companies for the long term with hands-on support and custom solutions.

Please email me directly atmike@webtranspose.com for enquiries.

Releases

No releases published

Packages

No packages published

Contributors2

  •  
  •  
[8]ページ先頭
©2009-2025 Movatter.jp