We don't yet know what they're capable of, after all. And it would make sense for them to sow as much doubt as possible.

[A frustrated sigh.]

At the moment, I'm suspecting a large group. Both the resources they've displayed and the fact that they were able to abduct us from such varying locations, even across multiple worlds, makes me doubt this is the work of a few individuals.