Position everything in data coordiates rather than Axes coordinates. While the code annotate() is not the primary goal of this example, it's slightly simpler to follow if we keep everything in data coordinates, which is what all the commands (plot, text, annotate) are by default in.The output is basically unchanged, with the exception of making the point marker and the textbox edge dark grey so that the black annotation line stands out more.