I like this idea, in particular because with a soft brush used as a mask you could have something like a control point but with an arbitrary shape rather than a circle, and a chroma/luma sampling point other than the center of that circle.
There are other feature requests that talk about modifying the shape of the control points, an eyedropper for the brush tool would be a good solution for those higher-voted feature requests.