Is there a way a blind person can use a mobile phone without oral instructions?

Icon Usability ( Source; https://www.nngroup.com/ )

While going through this usability article, I thought of a possibility about mobile usage for blind people. Based on this I asked a question to ChatGPT. And here's the answer along with the question and suggestion for an application I have in mind! 


Yes, a blind person can use a mobile phone without oral instructions, although the most common and accessible method currently involves screen readers, which do provide audio feedback. Here's a breakdown of the methods available for blind users to navigate and use mobile phones, specifically for tasks like shopping:

I asked this question out of curiosity to Chat GPT and here's the answer from the generative application. Well, I had an intention about asking. It was about a simple interface which will make them read and understand a webpage or shopping site without using another devise or voice output. 

One aspect I like was "Raised Stickers". Well, these are physical stickers which can be applied on the power button or other button to help a blind navigate. It's similar to the a raised line on the letter F on the keyboard. 

Now, my idea for innovation is around the concept of using another screen which can be placed on top of the normal mobile screen, which will automatically covert the text to braile and for the place of buttons such as buy now or shop now, the new button sensitive plastic sheet will raise that portion. 

In short, the innovation would be about the plastic sheet which will be fixed on the normal screen. So, the technical aspect of such a device could be used in many areas too. Probably as a safety measure when the back lighting on the button fails and it's pitch dark to see the buttons. 

I think, what I'm talking here is pure sci-fiction stuff or something which is already in the market or probably on the building phase. 

1. Screen Readers (Primary Method)

VoiceOver (iOS) and TalkBack (Android) are built-in screen readers that read aloud the contents of the screen and respond to gestures. They are the primary tools used by blind individuals for navigating mobile phones.

Gestures: Users can swipe and tap in specific ways (e.g., double-tapping to select, swiping left/right to move between items) without needing visual input.

Shopping Apps: Many shopping apps are designed to be compatible with screen readers, ensuring a smooth browsing and purchasing experience with audio cues.

2. Braille Displays and Keyboards

Braille Displays: Some blind users prefer braille displays, which are external devices that connect to a smartphone via Bluetooth. They translate screen content into braille, allowing for silent navigation without audio instructions.

Compatibility: Both iOS and Android support braille displays through their screen readers (e.g., VoiceOver’s braille support).

Braille Keyboards: These allow users to input information and navigate using braille, which can be a fast and efficient way to interact with the phone.

3. Tactile Feedback and Vibration

Vibration Feedback: Some phones and apps use vibrations to indicate certain actions or selections, providing non-visual and non-auditory cues for blind users.

Gesture-Based Navigation: By learning specific gestures, a blind user can navigate menus, select items, and complete tasks like shopping without needing audio feedback.

4. Voice Assistants (Alternative Method)

While not silent, voice assistants like Siri, Google Assistant, and Alexa can be used for hands-free navigation, including shopping. These assistants can be trained to respond to specific commands without the need for manual interaction.

For example, a blind user might say, “Add milk to my cart” or “Check out” without needing to navigate through menus manually.

5. Tactile Icons and Customization

Raised Stickers: Users can apply raised stickers or braille labels on physical buttons or parts of the phone (if available) to help them locate important features like the volume buttons or home screen.

Customized Home Screen Layouts: Some users customize the layout of their home screen, grouping apps in a way that can be memorized and accessed without needing to see the screen.

Current Approach for Shopping:

Screen Reader Compatibility: Shopping apps (like Amazon, Walmart, or eBay) are optimized for screen readers. Users navigate by swiping and listening to descriptions of items, and they can double-tap to select and add to cart.

Voice Commands: Many shopping apps also support voice commands, allowing a blind user to search for items, check prices, and make purchases using voice.

Braille Display Use: For those who prefer braille, they can navigate shopping apps using a connected braille display to read product descriptions and complete transactions.

Overall, while most blind users rely on audio feedback from screen readers, the use of braille displays and tactile feedback offers an alternative for those who prefer a non-auditory experience.