See
Live hazard warnings spoken as you move: “Chair ahead, left.” Detection runs locally, so it stays fast and private.
Hands-free AI for blind and low-vision people
Talk to the bracelet on your wrist. The phone on your chest watches the way ahead. GuideEye warns you, remembers for you, and pays only after your spoken yes.
Free and open source · Android, macOS, Windows, Linux and the web
In your ear
No screen to aim, no buttons to find. Pick one and hear how the conversation goes.
Try an example
“What’s in front of me?”
Chair ahead, slightly left. The doorway is clear beyond it.
Detected on device
Chair · ahead, left
Processed locally. No video stored.
What it does
Today’s vision apps make you aim a phone and tap buttons — then forget everything the moment you close them. GuideEye works the other way round.
Live hazard warnings spoken as you move: “Chair ahead, left.” Detection runs locally, so it stays fast and private.
Ask later: “Where did I leave my keys?” GuideEye links what it sees into a graph — keys on the counter, counter next to the kettle — so it can answer from the connections, not just the words.
Say “Buy me a coffee.” It reads the item and price aloud, then pays only after you say yes.
The bracelet listens and speaks, the phone stays clipped to your chest. Your hands stay free for your cane, your dog, your day.
A bridge between deaf and blind people: sign language voiced aloud, and speech shown as large captions.
GuideEye is an accessibility layer that plugs into AI wearables — starting with the Vexo bracelet.
How it works
Safety-critical detection runs locally and privately. Reasoning and natural voice use the cloud.
Speak to the Vexo bracelet on your wrist. A chest-clipped phone camera watches the way ahead.
Hazards are spotted on-device in real time. An AI agent handles questions, graph memory and requests.
You hear a clear spoken reply. For anything that matters, like paying, it waits for your “yes”.
Live demo
Your camera, your voice, the real GuideEye service. Turn the camera on, then ask a question out loud or type it.
The demo needs the local service. From the project folder, run:
python -m uvicorn backend.app.main:app --port 8000
Then open this page at http://localhost:8000 — opening the file directly will not work, because the browser blocks it from reaching the service.
Camera is off
Vibration: one long buzz means left, two mean right, three mean turn around. A turn you have reached repeats its buzz.
Microphone off
Hi, I’m GuideEye. The microphone is on — just ask what’s in front of you, where you are, or to pay for something.
Confirm?
To try paying by code, show the camera this demo payment code on another screen and say “Guide, pay this”.
Bridge runs by itself: point the camera at the person signing, and just talk.
They signed
—
No sign in view
You said
What you say appears here in large text.
American Sign Language, read on this device. Signs with movement: Yes (a fist nodding), No (index and middle finger snapping onto the thumb), Hello (a flat hand waving), Thank you (a flat hand moving down from the chin), Please (a flat hand circling), Sorry (a fist circling), Help (a thumbs-up fist lifted), Stop (a flat hand pushed forward). SOS, the Signal for Help: show your palm with the thumb folded in, then close your fingers over the thumb. Still handshapes: I love you, OK, Peace, Water, Call me, You. The whole ASL alphabet is in Fingerspelling mode (J and Z need motion and are not read). Your speech is shown as text and as ASL fingerspelling. Alphabet images: Wikimedia Commons, public domain.
People GuideEye may message for you. Say “Guide, tell Mom where I am”. Nothing is sent until you say yes.
Text notes and the connections between them — keys on the counter, counter next to the kettle. No photos, video or audio are ever saved.
Long-term memory off · everything stays on this machine
Not checked yet
Double-tap the band so its light blinks blue, then check the connection.
Not set yet. Then you can say “Take me home”.
Camera frames go to the GuideEye service on your own computer. When you ask a question, that single frame is also sent to Google Gemini for the answer. Directions send your location to OpenStreetMap services. Speech is recognised by your browser. Nothing is recorded. Payments are test-mode only.
Built for trust
An assistant you can’t see has to earn your confidence. GuideEye is designed around three promises.
No raw video or audio is stored.
Money never moves without a spoken yes.
When it isn’t sure, it says so instead of guessing.
Please note: GuideEye is a prototype. It does not replace a white cane, guide dog, orientation training or emergency services.
Get the app
We’ll detect this device and put the right build first. You can always choose another platform.
Checking your device…
This takes less than a second.
Phone + Vexo bracelet
Apple silicon + Intel
Windows 10 and later
Debian, Ubuntu + others
Works in any modern browser · No installation needed
GuideEye 0.1.0 · Early hackathon prototype. Desktop builds are unsigned, so your operating system may ask you to confirm before opening.