If the drip becomes a flood, it's not the cost of the water you should be concerned with; it's the water damage.
You say the leak seems to be coming from the valve itself, and your reasoning makes sense; if the toilet's dry it means the valve is turned off, so it's probably not any fitting beyond the valve stem. This means that the shutoff valve gasket, or the valve itself, has worn out or corroded and needs replacing. This happens over time; just like the flapper valves in the toilet and other elements of your plumbing, the shutoff valves corrode with acidic water, calcify in hard water, deteriorate in highly chlorinated water, and just plain wear out from use and water flow of any type over the years.
This is definitely something that nobody would think less of you for if you called in a plumber. However, it is DIY-able. You'll need to shut off the water to the whole house (there should be a shutoff valve near your water meter, wherever that is, and you may need a special tool to turn it off), then bleed the remaining water out of the interior lines (easy as turning on the faucet on the sink to cold, or flushing the toilet a couple times). With a bucket or pan under the valve to catch any remaining water in the line, disconnect the toilet from the valve and open the shutoff valve, letting any remaining water drain out of the line and valve. If this is a first-floor bathroom, there may be quite a bit to drain as the upstairs supply pipes will drain out as well. You can help it drain faster by opening a couple of faucets upstairs (providing a vent for the pipe stack similar to what you have in drain pipes). If it never seems to stop, you probably didn't completely shut off the outside valve.
Once the line is drained, you can work with the valve. The first thing to check is the fitting between the valve and toilet, since you have that apart anyway. Check the gaskets/washers on either side of the fitting. Some are compression fittings, and work by sealing a copper or nylon line against a ball inside the fitting; it won't work well if the end of the line or the ball has deep gouges, scratches, or is generally deteriorated. Most toilet lines are steel-braided rubber with threaded fittings, and usually can be easily replaced if necessary.
The next thing to check, and much more likely to be the problem, are the gasket washers in the shutoff itself. There may be one or two depending on the valve's design; one to seal off the supply line, and another to make the valve stem watertight. The valve stem should be going through a fitting screwed into the valve housing; unscrew that with a crescent wrench and you can take the whole thing out. You can usually also unscrew the handle from the stem and completely disassemble the valve stem. Clean off any calcium deposits from the washers, and inspect them for extreme wear or other deterioration. You can buy a bag of these washers for a couple bucks at your local hardware store. Reassemble the valve with the new washers, close the valve completely, and re-pressurize your house plumbing (make sure to turn off all the faucets you opened to drain the lines) to see if that did the trick.
If that didn't stop the leak, or the valve stem or body appears highly corroded and/or calcified, it may be time to replace the whole thing. With the house shutoff closed again and the lines drained, look at the valve's connection to the wall pipe. There should be either a compression fitting or a threaded NPT connection between the two, and in that case removing it simply takes your crescent wrench and some elbow grease. Some valves, however, are soldered directly on. If this is the case, I personally would stop and call a pro, but if you're handy with a soldering torch you can get the valve off yourself (careful you don't set the wall behind your toilet on fire). Then, simply take it to your local hardware store and buy a replacement with the same fittings; it should cost you about five to seven bucks. If the valve was threaded onto the wall pipe, get some Teflon tape as well. Use at least four wraps of the tape around the threads of the wall pipe (put it on in a clockwise direction, and stretch it a little to get it to mold to the threads), screw the valve firmly back on to the pipe, then re-pressurize the house again with the new valve closed (and all other faucets off) to check for leaks. If there are none, connect the toilet supply hose, open the shutoff, and make sure it still doesn't leak during and after the toilet fill-up.
If it STILL leaks, call a pro; you may have missed something, or done some damage in removing various parts.
It seems as if you have an obstruction that may be floating around in the pipe or valve. Sometimes it obstructs sometimes it flows clear. I would start with changing the water valve. If this is the old style "gate" valve there are several things that can clog the line. I would replace it with a 1/4 turn ball valve. That will give you much better flow than a gate valve. You will need to shut down the water probably at the main. The old valve is probably soldered, but you could cut it off and use a compression type valve instead. "Sharkbite" is one such supplier. Although I have never used their compression valve, I have used their end caps and found them to work well.
If you can have someone hold a bucket under the pipe once you cut off the valve and then a second person turns on the water main to fill the bucket to purge the line of any debris. With cast iron pipes it is common to get clogs from rust build up. The rust may not pass the small opening in the old gate valve when you first purged the line.. Although you did not mention what type of pipes you have, if it's copper than you won't normally find rust obstructions..
Best Answer
I cannot answer whether it needs replacing, but I can tell you why this happens.
It happens because it gets cold and water condenses on it.
Whenever you flush your toilet, cold water runs through and cools it off. Then the hot, humid air around it condenses water on it, making it moist. Because this happens so often, it will be moist a lot of the time, and thus corrodes.
Why this doesn't happen other places: The toilet is the one thing that uses most cold water. Your shower and sink uses more warm water, and not as much, and thus aren't as exposed to this phenomenon.
Unless it leaks I think you can leave it on.