Repository files navigation

This repo includes datasets, model training scripts, and model evaluation scripts used in paper --Mining Entity Synonyms with Efficient Neural Set Generation.

Details about SynSetMine model can be accessedhere, and this implementation is based on the PyTorch library.

The documents would be availablehere.

Simply clone this repository via

git clone https://github.com/mickeystroller/SynSetMine-pytorch.gitcd SynSetMine-pytorch

Check whether the below dependencies are satisfied. If not, simply install them via

pip install -r requirements_full.txt

You can train SynSetMine model and test its performance using commands inrun.sh

chmod +x run.sh./run.sh

By default, we will run on NYT dataset. You can uncomment the code inrun.sh to run on the other two datasets.

Model snapshots will be saved in./snapshots/ directory. Logs will be saved in./runs/ directory, and final results will be stored in./results/ directory.

We save three pre-trained models, one for each dataset in./snapshots/ directory. You can load them directly for prediction via:

chmod +x predict.sh./predict.sh

• Python 3 with NumPy
• PyTorch > 0.4.0
• sklearn
• tensorboardX (to display/log information while model running)
• gensim (to load embedding files)
• tqdm (to display information while model running)
• networkx (to calculate one particular evaluation metric)

If you find this code useful for your research, please cite the following paper in your publication:

@inproceedings{Shen2019SynSetMine,  title={Mining Entity Synonyms with Efficient Neural Set Generation},  author={Jiaming Shen and Ruiilang Lv and Xiang Ren and Michelle Vanni and Brian Sadler and Jiawei Han},  booktitle={AAAI},  year={2019}}