Sotopia: an Open-ended Social Learning Environment

News

Introduction

@inproceedings{zhou2024sotopia,title ={SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents},author ={Zhou*, Xuhui and Zhu*, Hao and Mathur, Leena and Zhang, Ruohong and Qi, Zhengyang and Yu, Haofei and Morency, Louis-Philippe and Bisk, Yonatan and Fried, Daniel and Neubig, Graham and Sap, Maarten},journal ={ICLR},year ={2024},url ={https://openreview.net/forum?id=mM7VurbA4r},}

Help

Important

If you are trying to develop on top of Sotopia, we highly recommend to follow thedevelopment guide.

Get started

Install locally

Note

You can of course use any other package manager to install the dependencies (e.g. pip, conda, etc.). But we strongly recommend using uv, especially for the development of Sotopia.

Warning

We recommend you using docker for setting up the redis server. Other installation methods have been shown to be error-prone.

conda env config varsset OPENAI_API_KEY=your_key

Easy Sample Server

importasynciofromsotopia.samplersimportUniformSamplerfromsotopia.serverimportrun_async_serverasyncio.run(run_async_server(model_dict={"env":"gpt-4","agent1":"gpt-4o-mini","agent2":"gpt-4o-mini",        },sampler=UniformSampler(),    ))

Warning

You won't be able to run the server locally if you don't have any datasets installed.

python examples/minimalist_demo.py