The type of litter might definitely be the problem... Jazzi refused to use the litter box for several days when I changed they type of litter when they were kittens.

Also, I am sure you have hear this, particularly from me, but don't use clumping clay litter for kittens. The one time I tried it, my guys ate it and were sick for a week.