A cannabis factory with an annual turnover of £6 million a year has been shut down after huge quantities of compost were seen being delivered.