Where is the P stone and how do i get into the desert fortress

I used the boots and obsidian crown and enchanted monkey staff to fire loads of fireballs. Then when he came near me I teleported and jumped around!

You can buy it in the forge for 5 million candies once you visit the castle.