It depends on the block you are using, but you often get smoother modulation if you use the modulation input (which is often audio), rather than trying to modulate the control input.  It depends very much on which block you use though.