Being disabled isn't a monolith. We have different disabilities that impact us differently. Motion controls and gyro is absolutely a double edged sword, but for many of us, it can be an accessibility issues.
Like, for example, in my case, many of these gimmicks are serious problems with my neurological conditions that make it extremely difficult to play, notably and specifically with motion/gyro controls, which causes confusion in my brain using them while trying to use the controls, making it a miserable and difficult experience for me.
I also have other disabilities (not being able to tell depth or spatial reasoning, left/right and directional issues, auditory issues where I mishear things on the opposite side, and among other problems) that also impact my enjoyment of video games too. Many times, these games also use gimmicks that cause problems with me on these issues.
So yes, it can be an accessibility issue.
Also I don't want to assume anything, but I do need to say this: please do not use another disabled person's experience to try and downplay another disabled persons experience with accessibility problems. It comes off ableist and furthermore, you're downplaying the fact that other people struggle with something caused by barriers due to their disabilities. Acting like one disabled person represents everyone in the disability community is not a good idea for various reasons. In fact, makes trying to discuss about these problems incredibly difficult.