Getting the flavor of honey without the sweetness

What comes to mind immediately is to experiment with different varieties. Honeys vary a lot in sweetness and strength of flavor.

From About.com

• Acacia honey is very sweet with a clean, pure, classic honey flavor.
• Alfalfa is a light honey but with a nice mild spicy note and floral aroma.
• Blueberry honey has a slight tang and a fruity flavor.
• Buckwheat is tasty on toast, but its strong and spicy flavor makes it perfect for marinades.
• Clover is the classic honey - light, sweet, floral.
• Coffee honey tends to be quite dark, with a rich, deep flavor that matches its color.
• Eucalyptus honey has just a hint of menthol flavor in it, making it perfect for stirring into tea.
• Fireweed honey has a markedly complex flavor and a slightly buttery texture. Like buckwheat honey, it can stand up to meats, marinades, glazes, and grilling
• Heather is pungent and almost bitter, in a good way. It's great with smoky things, or on wholesome baked goods.
• Linden honey is quite delicate and has a fresh, woodsy aroma perfect with tea
• Orange Blossom is widely available but watch out, much of the orange blossom honey on the market is artificially flavored. Real orange blossom honey is mild and citrus-scented.
• Palmetto is a mild honey with balanced sweetness.
• Sage is a lot like palmetto honey - mild, sweet, flexible.
• Sourwood is caramel-like and buttery and delicious on toast, biscuits, muffins, and any other vehicle you can think of.
• Tupelo honey is somehow sweeter than other honeys, but with a lovely balanced mild flavor.
• Wildflower honey is light and fruity yet richly flavored at the same time.

Based on that, perhaps heather honey would be a good place to start.