The dual character of invariance under transformations and definability by some operations has been used in classical works by, for example, Galois and Klein. Following Tarski, philosophers of logic have claimed that logical notions themselves could be characterized in terms of invariance. In this article, we generalize a correspondence due to Krasner between invariance under groups of permutations and definability in L∞∞L∞∞${\mathcal{L}}_{\infty \infty }$ so as to cover the cases (quantifiers, logics without equality) that are of interest in the logicality debates, getting McGee's theorem about quantifiers invariant under all permutations and definability in pure L∞∞L∞∞${\mathcal{L}}_{\infty \infty }$ as a particular case. We also prove some optimality results along the way, regarding the kinds of relations which are needed so that every subgroup of the full permutation group is characterizable as a group of automorphisms.