Only send button click event if it used the primary button

Only send button click event if it used the primary button #22