Its castle was built as early as the 9th century; the first mention of Horstmar is as early as the early 11th century. The city of Horstmar was built to the south of this castle. During theThirty Years' War the castle was destroyed by order of the Hessian lieutenantCarl von Rabenhaupt.