Are bowlers informing the batsman or umpire that they are bowling googly or outswinger or inswinger or reverse swinger? Batsmen are taking risk by switching the sides and, many times, they fail in executing such shots and in result getting themselves out. There is nothing unfair in switching sides.