Hi, I just recently started struggling with this problem, and I think I found the solution for you! This isn't really Photoshop giving you problems, more like windows trying to be too helpful without enough user controls. You have to use a registry edit. There are tutorials on how to get to it and how to change settings. Caution: This may have side effects since its a Windows wide change (such as pages or programs not panning anymore). However this seems like a easy toggle on off thing so if you don't like it, change it back to 0, restart, and you should be fine.
HKEY_CURRENT_USER, Software\Microsoft\Wisp\Touch PanningDisabled=1