Responsive interaction with matplotlib figures is currently limited as any interactive element must be drawn as part of the figure, e.g. widgets.Cursor implements a cross hair cursor and requires ...