The OED suggests this parlour game was also known as…

cross-questions and crooked answers: a game of questions and answers in which a ludicrous effect is produced by connecting questions and answers which have nothing to do with one another; as e.g. the question of one’s neighbour on the right with the answer given to another question by one’s neighbour on the left.