An arrow is a stroke property.
Stroke properties can be set in Window>Stroke and reset the arrow head to none.
However, strokes shouldn't remain selected, especially arrows - I don't think it should anyway.
Try resetting your Illustrator Preferences, restart Illustrator and hold down CTRL ALT SHIFT or on a Mac it's CMD OPT SHIFT.