It's a good question because we have seen that the 3-person quorum of the Privy Council that went to Balmoral to advise the Queen on prorogation was, if legal, a Conservative Establishment stitch-up.

However, in this case the controversy would be much greater and more open. Limiting the Queen's advice to Ree-Smogg and two stooges, to the exclusion of the Leader of Her Majesty's Most Loyal Opposition, would cause such a noise that the very position of the monarch would be called in question. Other advisors (they exist in the upper echelons of the Civil Service and at the Palace) might well suggest that the Queen think mightily carefully before doing the muppet's bidding.

Things are going to slide, slide in all directions
Won't be nothing
Nothing you can measure anymore
L. Cohen