Twelve traveller families who clubbed together to buy a field to turn into a permanent site have had their plans turned down.