In general, if the outputs are floating, you can connect the outputs of a power supply in series for a summed voltage. If they're not floating you can't (if both negative output terminals are referenced to ground, when you try to connect the positive of one to the negative of the other you'd be shorting it out). If you're talking about "wall-warts", if there's no ground pin on the wall plug and they're double insulated, they should be floating output. With 2x 9V supplies floating, you can reference any part of it to your circuit's ground, so you could configure it as +18V, -18V or +/-9V.
Good for breadboarding etc. Don't put too much filter capacitance in the circuit you wish to run. You don't need as much as in a linear supply and you can make the thing misbehave if there's too much capacitive load.
Connecting in parallel for extra current handling is a lot more difficult unless they're specifically designed to share the load.