image001Seba — a Personal Museum Guide

Web Application

Seba Visitor GuideHow to use the App.

 

image001PrototypeA web app implements a personal guide to the Asian art collection at the Princeton University Art Museum.

To try out the Prototype app offsite, you will need a PC (or another phone) to simulate the exhibits at the museum.  Select one of exhibits below by clicking on it; it will expand and represent the exhibit at the museum.  Currently, there are only ten exhibits for the Prototype.

Next, on your mobile phone, navigate to this site and click on “Prototype”.  On the app, press and hold the yellow button labeled “Press to Scan”, frame the text description under the exhibit image while keeping the button pressed.  Release the button when the text is framed.  This tells the app that you wish to discuss that exhibit.  The app will audibly describe the exhibit.  On iOS, you may need to press the “Press to hear” button below the description.

You can ask questions verbally by pressing and holding the “Press to Talk” button.  Release the button when you are done speaking.

Exhibit1 Exhibit2Exhibit3 Exhibit4Exhibit5Exhibit6Exhibit7Exhibit8Exhibit9Exhibit10

Details

Introductionread about what it is.

Project PlanWhat next

ArchitectureHow it works

Tests

Text recognitionScan image for text

AudioRecord and play back speech

Text to SpeechMultilanguage, but needs translation API

Speech to TextMultilanguage