Let be a group acting on a set . A subset (finite or infinite) is called -quasi-invariant, where is a non-negative integer, if for every . In previous work of the authors a bound was obtained, in terms of , on the size of the symmetric difference between a -quasi-invariant subset and the -invariant subset of closest to it. However, apart from the cases , this bound gave little information about the structure of a -quasi-invariant subset. In this paper a classification of -quasi-invariant subsets is given. Besides the generic examples (subsets of which have a symmetric difference of size at most with some -invariant subset) there are basically five explicitly determined possibilities.