Smartphone Software Retina


Biologically inspired software retina with a gaze control mechanism


Overview

Smartphone application of a real-time video feed of the retina transformed video frames for highly compressed imaging with an attention based gaze control mechanism.

Breakdown

Existing biologically inspired software retinas are available but are limited to desktop applications. Exploration of a portable software retina is required to produce an automated software retina that records different points of interest captured by the video camera. The mobile software retina must also allow for a live preview of the retinal transformed images for viewing the field-of-view and biological vision. The mobile software retina is an initial stage to gather large retinal imaging data sets required for training in deep neural networks for image analysis / classifications.

The problem statement is broken down into three main objectives / requirements which ensures that a fully functional smartphone software retina is created.

  1. The first objective is the successful creation of a smartphone application that produces a live preview of the retinal image transforms of each frame captured by the smartphone video camera.
  2. The second objective is the creation of the gaze control mechanism to find good points of interest with minimal affect on the computational performance of the smartphone software retina, while still allowing for the exploration of the scene captured by the video camera.
  3. The third objective is the implementation of an effective recording mechanism which is able to store the retinal transformed imaging data for each video frame.