Videos

This demo shows two things.  First, it shows how Gabriel can use much more sophisticated computer vision (based on convolutional neural nets) than the much simpler computer vision algorithms used in demos such as Lego and Ping-Pong.    Second, it shows how different kinds of wearable devices (Google Glass and Microsoft

In our talks on Gabriel, we have often mentioned assembly of IKEA kits as an example of how step by step guidance and prompt detection of errors could be valuable.   This video shows a Gabriel application to assemble a genuine IKEA kit (a table lamp) purchased off the shelf at

Unsolicited by us, this video was made by a startup company VIZR Tech to illustrate the potential of wearable cognitive assistance in medical training. The video provides background to explain relevant concepts to the company's target audience.  The company already uses Google Glass (with the camera blocked) in medical training,

This demo shows how cloudlets can improve the scalability of video analytics and how they can be used to enforce privacy policies based on face recognition.   The demo also illustrates use of the OpenFace face recognition system that we have created.   RTFace combines OpenFace with face tracking across frames to

This demo shows the difference between using a cloud and a cloudlet for an application where the impact of latency is easily perceivable by users.  We have created an Android application called "FaceSwap" that is available in the Google Play Store.   A back end VM image for an Amazon cloud

Creating object detectors for wearable cognitive assistance is difficult.  TPOD is a web-based system that we have created to simplify the creation of training data sets for object detectors based on deep convolutional neural networks.   This demo shows an early version of TPOD.

Can a legacy application for training be modified to use Gabriel?  This demo shows how a Drawing Assistant created by researchers at INRIA in France has been modified to use a wearable device (Google Glass).  In its original form, a user would receive instruction to improve his drawing skills on

This conceptually simple demo has proved to be especially popular because it brings out the importance of low latency.   A person wearing Google Glass plays ping-pong with a human opponent.    The video stream from the Glass device is streamed to a cloudlet and analyzed on each frame to detect the

This is the world's very first wearable cognitive assistance application!   We chose a deliberately simplified task (assembling 2D lego) since it was our first attempt.  The demo seems easy, but the code to implement it reliably was challenging (especially with flexible user actions and under different lighting conditions).