Repository files navigation

An all in one Instagram scraper and analyzer for finding and visualizing clusters from people you are following.

• Interactive example with mock data

• Other example assets

This project runs on Node.js and does the scraping via a headless chromium instance. It's tested with Node v18.4.0 on Windows 10 & 11.

• Download Node

npm install

npm run start

After that you will be presented a GUI onlocalhost:3000/ for configuration.

• Only sending a certain amount of requests per hour.
• Saving sessions to avoid logging in every time
• Persistent storing of scraped data.
• Scraping with an alt account
  • Automatically removing private accounts for re-scraping with the main account
• Configuring of node + link size
• Configuring of forces
• Mouse hover highlighting
• Node Drag + Drop
• Zoom + Drag
• Colorful nodes. (Needs more performance)
• 2FA support

• Puppeteer is used for scraping
• Express.js for config and page hosting
• d3.js for graph generation

• Why not use a pre made plugin for scraping?
  • Normally, Instagram only provides a list of ~20 people you are following, and you have to do a follow-up request for getting the next 20. This is of course not viable for scraping more than a thousand accounts. My workaround for this, a little (probably) bug in the Instagram private API isn't supported by any plugin I could find, so I decided on doing it like this.

• Marvin M. -Initial work -M123-dev

See also the list ofcontributors whoparticipated in this project.

This project is in no way affiliated with, authorized, maintained or endorsed by Instagram or any of its affiliates or subsidiaries. This is an independent and unofficial project.

Please note that this is a research project. I am by no means responsible for any usage of this tool. Use it on your behalf. I'm also not responsible if your accounts get banned due to the extensive use of this tool. Use at your own risk.

Copyright 2022 Marvin Möltgen

Licensed under the Apache License, Version 2.0 (the "License");you may not use this file except in compliance with the License.You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, softwaredistributed under the License is distributed on an "AS IS" BASIS,WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.See the License for the specific language governing permissions andlimitations under the License.

See theLICENSE.md file for more details.