I solved the problem... apparently using the button to perform the action I needed, will indeed require me to click on it twice and then only perform the pan action. So I removed it and added an Image and added gesture recognizer to it.
Here is the updated code...
The code for the Image -
kate winslet titanic dresses.
winsletTitanicjack
KATE WINSLET
with Kate Winslet,
kate winslet titanic. kate
Here is the updated code...
The code for the Image -