Repository files navigation

All code was written in Python 3.7.9. Please seerequirements.txt for dependencies.

beautifulsoup4==4.12.0pandas==1.2.3praw==7.7.0requests==2.28.1snscrape==0.3.4tqdm==4.56.2numpy==1.24.2scikit-learn==1.2.2torch==2.0.0+cu117torchaudio==2.0.1+cu117torchvision==0.15.1+cu117transformers==4.27.3

This file calls functions defined in the other files to create a dataset (this is not the final dataset that we will be using for sentiment analysis, just a preliminary proof of concept).

This is the example dataset created using create_dataset.py.

This file uses the pretrained FinBERT model on the example dataset.

This file contains functions to scrape S and P 500 stock tickers and names from Wikipedia, scrape news headlines for any S and P 500 stock from Yahoo Finance, and scrape news headlines for any S and P 500 stock from MarketWatch.

This file contains functions to scrape titles and top comments of top posts from a specified subreddit on Reddit. Note that it requires you to have a file called info.txt saved in the same directory, with the first line of this file being your Reddit API client ID, the second line being your Reddit API client secret, and the third and final line of this file being your Reddit API user agent.

This project is licensed under the MIT License - see theLICENSE file for details.