That is not what that feature does, it just is the time your comment is publically shown.

Users have 2 hours to edit comments, and the button was gone within 1 hour.