As said, the first and the second weapon are one bundle, and the third and fourth weapons are another bundle. You will start with the bundle where your current equipped weapon is in. When you have equipped your third weapon, the second bundle will be equipped.
Example:
- Weapon: Shotgun
- Weapon: Pistol
- Weapon: Sniper rifle
- Weapon: Rocket launcher
You've got equipped your rocket launcher and activate gunzerking you'll take your sniper rifle and you'll have your sniper rifle and your rocket launcher equipped. If you’ve got equipped your shotgun, you’ll take the pistol as second weapon. You can change your weapon bundle like you change the weapons without gunzerking, as far as I know it’s impossible to just change just one weapon when you have all the 4 weapons slots equipped.
Using the PC version at least, you can press two number keys, like 1 then 3, you will equip the first gun in your left hand and the second in your right hand (so Right: Shotgun, Left: Sniper, in this case). I don't know if there's a way to do this on console, though.
Edit 2:
Found some interesting facts on the GearboxSoftware Forum:
From top to bottom in your inventory, weapons 1 and 2 gunzerk with each other, and weapons 3 and 4. If you only have 3 weapons, then the weapon you are holding will stay on the right, equipping the weapon 2 if you're using weapon 1, vice versa, and weapon 1 if you're using weapon 3. Switching weapon will switch your right weapon, but your left weapon won't switch.
Best Answer
Nothing. They are there for the achievement. That's literally all they do. Nothing else to say about them.