Is it bad when I can tell the difference in response time in a USB mouse vs. a serial mouse?

Is there even a difference, or am I hallucinating?