Have you ever struggled to see something in the dark, or to read a small print, or to recognize a familiar face? If you have, you are not alone. Many people face these challenges every day, and they can affect their quality of life and independence. But what if there was a way to enhance your vision with the power of artificial intelligence?
iPhone users follow these tips.
The app that narrates the world for you
Seeing AI is an app that uses artificial intelligence to lend a hand when it’s hard to see things around you. Microsoft recently expanded the app from only iOS to Android. It’s now available on the Google Play Store and works across 18 languages, with plans to expand to 36 languages next year.
Note: if you have an iPhone 12 or later, there is a similar built in feature that is called ‘Point and Speak’. You’ll need to have iOS 17 or later installed on your iPhone, and your iPhone model must have a LiDAR sensor.
The new Android version of the Seeing AI app has the latest generative AI features that were previously available only on iOS. These features are:
- More detailed photo descriptions: You can get more than just a brief summary of the photos on the Scene channel. By tapping ‘more info,’ you can generate a rich description that tells you more about what is in the image.
- Interactive document scanning: You can not only listen to the scanned document but also talk to Seeing AI to get more information. You can ask questions about the document, such as what is on a menu, how much an item is on a receipt, or what is the main idea of an article.
Credit: Microsoft
MORE: THESE HIGH TECH GLASSES WILL SUBTITLE REAL LIFE CONVERSATIONS
An overview of the app
Seeing AI lets you hear a description of what the camera sees or what the photo shows. You can switch between different channels to get focused information:
- Images in other apps: Recognize any photo by sharing it with Seeing AI.
- Scenes: Get a summary of the scene captured and tap ‘more info’ to get a detailed description. You can also touch the screen to hear where different objects are.
- People: Recognize your friends and the people around you.
- Products: Find out the name and details of products by scanning their barcodes. You will hear beeps to guide you.
- Currency: Identify different currency notes.
- Colors: Know the color of objects or clothes.
- Handwriting: Hear handwritten text such as greeting cards (only in some languages).
- Documents: Scan printed pages and hear the content and layout. You can also talk to Seeing AI to ask questions about the document.
- Light: Hear a tone that changes with the brightness of the environment.
- Short Text: Hear any text as soon as the camera sees it.
Credit: Microsoft
MORE: ARE APPLE AIRPODS AN ALTERNATIVE TO PRICEY HEARINGS AIDS?
The technology behind the app
Seeing AI uses advanced machine learning and computer vision techniques to analyze the images captured by your camera and generate natural language descriptions. The app also uses text-to-speech and sound effects to create an immersive and intuitive experience. You can customize the app’s settings to suit your preferences, such as choosing the voice, speed, and volume of the narration.
MORE: ASK KURT: UNFORGETTABLE TRICKS TO CONTROL YOUR IPHONE WITH VOICE COMMANDS AND TOUCH
Who can benefit from the app?
Seeing AI is designed to assist people who are blind or have low vision, but anyone can use it to enhance their visual perception. Whether you want to read a book, shop for groceries, navigate a new place, or just have fun, Seeing AI can be your smart companion. The app supports 18 languages now and is adding more later in the coming year. It’s free to download, and you can find it in the Google Play Store.
Credit: Microsoft
Kurt’s key takeaways
Seeing AI is a remarkable example of how artificial intelligence can improve our lives and empower us to do more. It’s also a testament to Microsoft’s commitment to accessibility and inclusion for everyone. If you have an Android device, you should definitely give it a try and see how it can help you see better than your own eyes.
How do you think artificial intelligence can improve the lives of people with disabilities? Let us know what you think in the comments below.
FOR MORE OF MY TECH TIPS & SECURITY ALERTS, SUBSCRIBE TO MY FREE CYBERGUY REPORT NEWSLETTER HERE
Answers to the most asked CyberGuy questions: