Movatterモバイル変換


[0]ホーム

URL:


Skip to content
DEV Community
Log in Create account

DEV Community

Cover image for Let's Build a Web Scraper with Cypress!
Brett Cassette
Brett Cassette

Posted on

     

Let's Build a Web Scraper with Cypress!

Check out the Free Lesson on Egghead.io

What would you build if you had a web scraper?

  • Maybe your fitness tracker has no public API?
  • Or you want to always outprice your competitors?
  • Maybe you want to correlate and visualize data from multiple, disconnected platforms?
  • Want to automate common tasks on an external site?

Or maybe you're like me, and the website that lists all your open mic comedy events doesn't have any ability to search, filter, or show event locations on a map.

So how do we ingest this data for fun and profit?

Cypress to the Rescue

Cypress is a blazing-fast end-to-end testing framework. Since it can interact with any webpage, we can also use it to automate interactions with external sites!

Build it along with me in this free lesson on Egghead.io!

Check out the Free Lesson on Egghead.io

Top comments(2)

Subscribe
pic
Create template

Templates let you quickly answer FAQs or store snippets for re-use.

Dismiss
CollapseExpand
 
venkatcoderbloom profile image
Venkatesh vellingiri
Full stack developer, Open source enthusiast
  • Email
  • Location
    Coimbatore, India
  • Education
    B.E Computer Science
  • Work
    Software Engineer at SquashApps
  • Joined

Hi Brett,
I enjoyed scrapping of data using cypress.

I scrapped a web application which contains a list of data. Is it possible for me to use that in node.js API for processsing.

CollapseExpand
 
cubiclebuddha profile image
Cubicle Buddha
TypeScript nut + head writer at CubicleBuddha.com (other loves are cats, my wife, comic books, and VGs)
  • Location
    SE Pennsylvania
  • Work
    lead dev by day, head writer at CubicleBuddha.com in the night
  • Joined

Cypress is the best. Once it came out I was so happy to stop using CasperJS and Slimer. I don’t know if I could do (enterprise grade) UI development without Cypress.

Are you sure you want to hide this comment? It will become hidden in your post, but will still be visible via the comment'spermalink.

For further actions, you may consider blocking this person and/orreporting abuse

  • Location
    New York City
  • Work
    People Optimizer
  • Joined

Trending onDEV CommunityHot

DEV Community

We're a place where coders share, stay up-to-date and grow their careers.

Log in Create account

[8]ページ先頭

©2009-2025 Movatter.jp