agree with this 100%. they aren't useless nor are they underpowered. people just tend to use swords more often because they're easier to use.
removing the recoil would just encourage dagger spam and you'll be trapped, heck this happens even now and is incredibly annoying.