r/Android • • 2d ago

Setting up Android accessibility for a recently paralyzed friend to use Gemini and Claude by voice — four technical problems, plus looking for general guidance.

My friend was recently paralyzed in a cycling accident, and I'm helping him set up his Android phone so he can interact with the world hands-free, through both Google Gemini and Anthropic's Claude by voice. He needs both apps for different reasons. He's a developer, and most of his programming work happens in Claude, while he uses Gemini more for general interaction and researching health-related questions. So losing access to either one is a real loss of capability for him, not just a preference.

I've hit four recurring technical problems and I'm hoping someone here has solved one or more of them.

One, starting Voice Access hands-free. He's currently in a hospital room with a lot of ambient noise, and Voice Access keeps picking up background sound when left listening continuously. I know how to stop a listening session, but I haven't found a reliable way for him to start one using only his voice, with no hand or button input.

Two, handing off from Voice Access to the AI app. Once Voice Access helps him open Gemini or Claude, I need it to stop listening so his speech goes to the app's conversation mode instead of being interpreted as device commands. Right now the two seem to compete.

Three, launching Claude with a wake word. Gemini works fine as a voice-activated assistant, but Claude doesn't. Android lets me set Claude as the default digital assistant app, but there's no keyword or activation phrase that actually triggers it the way Gemini's does.

"Four, using Gemini as a bridge to launch Claude. As a workaround, I'm wondering if Gemini could be used to launch a home-screen shortcut straight into Claude's voice mode, bypassing Voice Access and the missing wake word entirely. Has anyone tried this or got it working?

Separately, if anyone can point me to a solid guide, video, or community resource on setting up Android accessibility for someone who's recently become paralyzed, generally, I'd really appreciate it. This is new territory for me and I'd rather learn from people who've done it properly than figure it out by trial and error.

Any tips, settings, or tools would mean a lot — trying to make this as frictionless as possible for him while he's dealing with so much else.

24 Upvotes

8 comments sorted by

6

u/LostRun6292 1d ago

I actually participated in several accessibility groups there is one Google app that you control your device with your eyes

5

u/kitsumed ShizuCallRecorder Developer 1d ago

I really wish I could help. I know some open source app that can replace the Assistant and start other app but I do not think/see thoses solve any of the given problem you have.

Its weird the wake word is not working reliably in noisy area, on today ages, we have very good way to perform audio isolation so its strange your assistant app would not use them. Unless the noise is REALLY loud.

I'm still gonna link the app I quickly found: https://github.com/obstino-org/facecontrol

https://play.google.com/store/apps/details?id=com.google.android.apps.vision.switches https://github.com/yashab-cyber/opendroid https://github.com/google/project-gameface

I will also mention my own app, personally it does help with a disability of mine. Could make it easier to notes call since he can't move. https://github.com/kitsumed/ShizuCallRecorder

•

u/CultureByte 15h ago

Thanks very much. I was not aware of this. Will certainly give it a shot!

3

u/Far_Reserve9938 1d ago edited 14h ago

Is he permanently paralyzed or its temporary ?

There are apps on Android that use accessibility and are fine tuned for disabled people. Stock Android accessibility features, just as Android, looks good on paper but then when you use it you realize that they never tested it in real life.

Switchify for instance worked well.

•

u/CultureByte 15h ago

Thank you. It’s hard to tell right now as the rehab may change things but as of now, there’s not a lot of hope.

I had the same experience with Android accessibility. Very hard to use

•

u/Far_Reserve9938 14h ago

i may not know him personally but i'm truely sorry. i do bicycling too in town and have seen my load of crazy drivers.

Some say that it's better on IOS side, i heard others say that both sucks... If he is in for long term, it will definitely be worthwhile to get a friend to lend him an iphone for a few days so he can check by himself.