No stone on embark

Well you can't tunnel off the side of the map because the edge tile is never diggable, so that's out anyway. So it turns out you can turn an edge tile into fortifications which will drain water. First smooth it, then carve fortifications. (Thanks Nakedible!)

However, for those who consider this cheating or who are using a non-infinite water source, the only way is, indeed, a pump stack. This, while time consuming, isn't as terrible as you might think. (You'll probably have to do this later to bring magma up from the deeps, anyway.) The wiki has a description of optimal pump stack construction.

This will allow you to build a stack of mechanically operated pumps without putting extra machinery on each level. You only have to power one of the pumps in the stack. (Assuming that power source provides enough power for the whole stack.) Combine this with the (somewhat cheating) dwarven water-wheel reactor and you have a relatively painless pumping solution.

I like to put two gears between the power source and the pump stack and attach a lever to the gear nearest the pump stack. This allows me to turn the whole thing off if chaos ensues for any reason or I need to do maintenance to the system.

The alternative is of course a genuine water wheel setup or windmill setups, but these options will force you to be more choosy about where you locate the construction. Any axles or gears that lead from your power source to the pump stack consume power!

You might want to try building a smaller pump stack before going for one that spans 50 levels or more. Keep in mind it's very easy to flood your fortress with Fun!

The problem is that you don't make rock things at the Metalsmith's Forge. To build it out of rock, go to your Mason's Workshop and add a floodgate(l). This will only construct a general rock floodgate though. To make sure that it's made out of Alunite, you should see this question.