Energy Recovery Ventilation (ERV) You may want to consider either spot ERV or whole house ERV.
These devices both exhaust and intake fresh air, doing some energy exchange to reduce the impact on your air when the temperature differences between inside and outside are great.
Some ERV discussions here
As a spot unit, you could just run the unit in your office. The Panasonic unit I've read about has automatic controls, but I would supplement them with a countdown timer to limit use even further as necessary.
Leviton 12 Hour countdown timer
The divided wall cap means only 1 penetration is needed and it incorporates a pre filter for the incoming air.
Declaration: No financial interest in Panasonic or Leviton. I have used (personally) and installed (for customers) Panasonic fans and Leviton switches.
The appliance typically comes with a screen, that should be installed in the end of the exhaust pipe. The screens are commonly made from Polyvinyl Chloride (PVC), or Acrylonitrile butadiene styrene (ABS), but could be any heat and corrosion resistant material.
I'm not sure you'd be able to pick one of these up at the local home center or hardware store, but you could always check. Through a quick google search, I was able to locate a product that should fit your needs...
Diamond Vent Screens
Our patent-pending Diamond Vent Screens are specially designed from robust, long lasting ABS plastic to let these varmints know homeowners aren’t interested in having them over for a visit. Designed with furnace and water heater exhaust pipes in mind, our screens keep birds, squirrels, chipmunks where they belong – outside.
I've never used, and don't recommend, or endorse this specific product. It's simply the first product I came across when searching.
A screen like this will prevent birds, leaves, and rodents from entering (or leaving if they already live in the pipe/furnace). Unfortunately, there isn't much you can do to prevent insects. Anything that would block small things like insects, would also restrict the air flow and cause more problems than it solves.
Best Answer
HVAC systems don't exchange air with the outside unless you specifically add an air exchanger. In older houses, this wasn't necessary because they leaked enough that you always got new fresh air coming in somewhere. With newer houses and recently fully renovated ones, the houses can indeed be sealed up so air tight that an air exchanger is necessary.
Based on your response, what it sounds like you have is an old house, recently renovated to be made air tight, with existing duct work and a furnace.
Based on that, you don't need a new HVAC system, you need an add on air-exchanger, such as this:
Ducting will need to be added to the outside to allow this machine to suck in outside air and blow out inside air. This kind of device is, IMO, best installed connected to air return of your existing furnace so that fresh air can be injected, heated, and distributed thru the house.