I don’t think I’ve known of a “designated tourist area” in Japan. I lived there for a month in some town that I doubt there’d be any foreign tourist and nobody harassed me and my friends. We were even helped by the locals and police when one of my friends lost their wallet, and they were super patient about it too.