Mine does the same. Sometimes feels like clutch drag - happens more in the heat (although not much of that in Scotland 🙄) I’ve just put it down to the tolerances the components are working to. Fine if we were talking a brand new bike but mine is a grand old 23yrs so I would expect a few things...