For the refinement of protein and nucleic acid structures, high-quality geometric restraint libraries are available. Unfortunately, for other compounds, such as physiological ligands, lead compounds, substrate analogs, etc., the situation is not as favorable. As a result, the structures of small molecules found in complexes with biomacromolecules are often less reliable than those of the surrounding amino or nucleic acids. Here, we briefly review the use of geometric restraints in structure refinement (be it against X-ray crystallographic or NMR-derived data) and simulation. In addition, we discuss methods to generate both restraint libraries and (idealized) coordinates for small molecules and provide some practical advice.