My solution depends on the usage of the BS4XP plugin while using a custom theme, e.g. from Bootswatch. Download the theme CSS file, open it with your prefered editor (I love Brackets!) and search for "glyphicons". Delete
every the definition that has this term in the classname of the @font-face completely. The icons will still appear as they are loaded from the plugin resources, so don't bother. Implement your theme (add it to your own theme or use it as page resource) and: here you are! No crappy icons but the default ones in combination with your custom theme!
(I updated this post due to two other posts regarding @font-face declarations that were posted today on 4/7/2014 by Brad and Paul)
You can see a live demo of that achievement when you look at my bookmarks collection. This app uses BS4XP and the theme "Cosmo" from the Bootswatch page.