The Elder Scrolls V: Skyrim – How to Befriend a Newly Bought Horse

There are a few ways you can remove the bounty over your head

Declare Thaneship If you are the Thane of a hold, you can declare this to the guard. This will immediately clear your bounty, but can only be done once per hold. This only applies to bounties less than 3,000 gold.

Pay your bounty If you pay your bounty, you will be immediately transported outside the nearest town jail, and all stolen items in your possession will be seized. Thieves Guild members have an additional option to pay a much lower fine, if they so choose. This additional option will allow you to keep stolen items.

Bribe guard Thieves Guild members have the option to bribe the guard. The amount of gold required to bribe a guard is usually much larger than the bounty for small crimes, but less than one for murder and doing so will raise the Speech skill, immediately clear your bounty and avoid having items confiscated. To do this however, you have to do five jobs in the region and complete the special task. The Bribe Guards Speech perk also grants you this option. Note, the bounty cleared is only for the crime you were recently caught doing. If you had some previous bounty as well, this won't get cleared.

Persuade guard Occasionally another option will appear if you have a low bounty. You can attempt to persuade the guard that you are not worth the effort of dealing with, due to your low bounty, and should be allowed to go free. Success is dependent on the Speech skill. If successful, you will raise Speech, but will not clear your bounty. If your speech is 75 or higher, this option will always be present (given that the guard has not been persuaded already). If you wish to persuade the guard again, wait 2 days and the option will be available again.

Go to jail If you cannot pay your bounty, you will be sent to the nearest town jail. You are able to keep one lockpick in your jail cell, which can be used to try to escape from prison. Escaping from jail can be much easier than in Oblivion with an option to pick the door or a loose grate on the floor which is much easier. There are also other methods to escape, such as pushing down a crumbling wall. You can also pickpocket the jail key from a passing guard to escape the cell. However, it is still difficult to recover your equipment.

To serve your sentence, simply sleep in the bed in your cell, and you'll sleep through your entire sentence. Depending upon the length of your sentence, your progress towards one or more skill advancements will be reset to zero. Unlike Oblivion, you will not lose any past skill increases; instead, it will take longer to obtain the next skill increase(s).

If the guards don't give you a chance to submit and go to jail or pay your bounty make sure that you sheath your weapon. The guards should then stop attacking and should hopefully hear your out :) If they don't you can try this:

Using a strong enough Calm spell will stop the guards from attacking, though speaking to them results in an arrest attempt. Another method is to punch an innocent person, keep your fists raised and then try to yield again.

Source

From what I see here it looks like 18 are learned without requiring dragon souls, though I'm extrapolating a bit since I haven't reached the end of the main quest yet, myself.

Fuzzy math:

Animal Allegiance     3 Souls    
Aura Whisper          3 Souls    
Become Ethereal       3 Souls
Call Dragon           0 Souls* 
*I'm making the assumption that this works a bit like Unrelenting Force
Call of Valor         0 Souls
Clear Skies           0 Souls
Disarm                3 Souls
Dismay                3 Souls
Dragonrend            0 Souls
Elemental Fury        3 Souls
Fire Breath           2 Souls
Frost Breath          3 Souls
Ice Form              3 Souls
Kyne's Peace          3 Souls
Marked for Death      3 Souls
Slow Time             3 Souls
Storm Call            3 Souls
Throw Voice           3 Souls
Unrelenting Force     1 Soul
Whirlwind Sprint      2 Souls

So...3+3+3+0+0+0+3+3+0+3+2+3+3+3+3+3+3+3+1+2 = 44