I have 16 silent ones but when I try to send spies to another players castle, it shows that I do not have any Silent Ones. WHY??

Please Help!!