A 100K pot is on the high side and will give the results you report. A 25K or less pot is best.

You could have a techie friend change the pot for you.

I could change the pot, but I also need to use the pedal with the Axe-Fx for which it was designed for. The Boss FV500L is a little bit more linear but on the opposite side. I guess there’s no option but to buy the Ernie Ball Vp Jr. if I want better sweep.