Since I only have 5 workers, I almost never have any of them bastards idle, they aint union.
But for players who get a solid workforce and then have nothing for them to do, I think we should impliment a system where workers can ‘garrison’ the taverns and farms. For example, you can ‘put’ idle workers in your farm or tavern, and while in there they increase productivity of that building. Max 2 or three workers per. There is no cooldown to put them in or take them out.
Example: Tavern 1 produces 1000 gold an hour. For every worker garrisoned, this value increases by 200. Tavern 1: with 3/3 workers in it will produce 1600 gold an hour.
Similar deal with food for farms, although cant make it too high or it will obviously favor the p2p players who drop $$$ for mass workers. Minor balancing will be required, but I think it will be much easier to balance this system for all levels of players than some of the ideas suggested here