English word embeddings

Heatmap of ICA-transformed word embeddings

Cross-lingual embeddings

Heatmaps of ICA-transformed word embeddings

Spiky shape of embedding distributions

Scatter plots of ICA-transformed word embeddings

Code and Data

Citation

@inproceedings{DBLP:conf/emnlp/YamagiwaOS23,  author       = {Hiroaki Yamagiwa and                  Momose Oyama and                  Hidetoshi Shimodaira},  editor       = {Houda Bouamor and                  Juan Pino and                  Kalika Bali},  title        = {Discovering Universal Geometry in Embeddings with {ICA}},  booktitle    = {Proceedings of the 2023 Conference on Empirical Methods in Natural                  Language Processing, {EMNLP} 2023, Singapore, December 6-10, 2023},  pages        = {4647--4675},  publisher    = {Association for Computational Linguistics},  year         = {2023},  url          = {https://aclanthology.org/2023.emnlp-main.283},  timestamp    = {Wed, 13 Dec 2023 17:20:20 +0100},  biburl       = {https://dblp.org/rec/conf/emnlp/YamagiwaOS23.bib},  bibsource    = {dblp computer science bibliography, https://dblp.org}}