You will spawn not too far away from the mainland’s shore. If you travel to the north, you will encounter a desert with a significant number of desert temples and other structures. Here are the coordinates of the two temples in this area: 223 69 106, -416 75 -997. Both of them keep a lot of nice loot:
There is also a nice village with a blacksmith at 677 72 -333 that contains the following items:
A witch hut can be located at 794 65 68, which is a really cool-looking swampy area with a lot of room for building.