Bioshock Infinite PC – How to Fix HUD/UI Freeze and Stutter?

No I'm afraid you can't. There is no such option in any of the menus, not even in the PC version. I searched around a bit, but for this game this isn't an option.

Also, if you read some articles you'll understand why. Just a small excerpt:

The thing is — and this is possibly a spoiler — you’ll use your face-ripping, flesh-melting, eye-pecking weapons and powers to take out white supremacists. That’s game violence put to good use.

You should be able to change and keep the FOV by doing the following:

1. First go to C:\Users\ (username) \Documents\My Games\BioShock Infinite\XGame\Config
2. Open XUserOptions.ini with any text editor, and then look for the line that starts with "MaxUserFOVOffsetPercent" then tweak the value to your liking.
3. Save the file (make sure you are saving it as an .ini file and not as a .txt file).
4. Right click the .ini file and click on "Properties". Under attributes tick "Read-only" and then press "Apply".

This should allow you to change the FOV and keep it. The downside it rather large though since the game cannot modify the .ini file this may cause problems.