Repository files navigation

System that is able to automatically detect whether a web page contains spam or not based on its URL.

The dataset can be found in this project folder under the nameurl_spam.csv. You can load it into the code directly from the link:

https://raw.githubusercontent.com/4GeeksAcademy/NLP-project-tutorial/main/url_spam.csv

Or download it and add it by hand in your repository.

Transformed the data to make it compatible with the model we want to train.Segmented the URLs into parts according to their punctuation marks, remove stopwords, lemmatize, and so on.

Make sure to conveniently split the dataset intotrain andtest.

Start solving the problem by implementing an SVM with the default parameters. Trained it and analyzed its results.

After training the SVM, I optimized its hyperparameters using a grid search or a random search.

Store the model in the corresponding folder.