- Notifications
You must be signed in to change notification settings - Fork0
alexiscolin/egghead-scraping
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
Really simple Egghead video downloader (thanksPuppeteer).
It scrapes every Egghead courses' lessons, create a folder into the download folder and get each video.Curently working with Github auth.
V2 - Replacement of Yield generator function for Array.map in order to parallelize download !
Because Puppeteer scrape the Egghead website thanks to their website DOM structure, it may be impossible to get videos course anymore if they change that structure
- Clone the repo,
- Change the id, psw and download folder path variables inside the
src/env.jsfile. - Choose the course you want to scrape, copy the course url (eg:https://egghead.io/courses/build-a-desktop-application-with-electron).
- Enter the cloned repo folder, thenrun the magic command
yarn get <myCourseURL>. Chromium starts, parses the course and downloads every video.
After the last download, Puppeteer will shut down the browser.
# Exemple -> change the url below by the one you wantyarn get https://egghead.io/courses/build-a-desktop-application-with-electronget every lessons that are not in course