You can now remove the Bing icon from Microsoft Edge with a simple toggle. Hiding the Bing icon does limit the Sidebar, however, as it will only be available if you set the Sidebar to always be shown.