That behavior wouldn't be clear to me as a user unless it were spelled out like you just did. My expectation when I see "Not Now" is that there will be a "Sometime Later". I would recommend changing your language here.