How to add a box displaying the cursor values?

This is done the same way as adding text to the plot as explained in the section below.

This will work even if the cursor is not checked in Plot->Layout->Cursor. The current mouse position in the active curve will be used.