Maybe next time you just reply 'Ok crikey yeah I am gayer than Larry Grayson at a Michael Barrymore party'.... and then if they react badly just say 'I was joking FFS' and if they react well move the subject on...