An appeal for a new glamping site at the Earsham Mill estate on the Norfolk-Suffolk border near Bungay has been dismissed.