As far as I know everyone but Osomatsu and Francis is were from different worlds. And I'm not totally sure they're from the same place, but they already knew eachother.

[Maybe that's why most of them were arguing constantly. Maybe that's why everyone was ready to kill.]