You can not visit them or interact with them in any way. The only thing having neighbors do is to help you get additional rewards on the Party Boat, and there a couple of buildings you can only build with neighbors (not money), such as the nightclub. There are also things you can buy if you have a couple neighbors, but you can't buy them without neighbors. But no, you can't visit them or interact with them.