If you really feel seeing a windows taskbar is a detriment to your gaming experience our suggestion as stated in the game guide under Game Requirements is to use "Borderless Gaming" which has many of the benefits of windowed and fullscreen mode combined. The latest version of this program can be found
HERE