The configurable machine vision engine delivers both visual outputs of how it is analyzing what it sees(so one can understand the algorithms behind vision) and text outputs over a serial link that describe what it has found (useful to send to a micro-controller that can control a robot). Users or machines can also interact with the JeVois smart camera, change its settings, or listen for text-based vision outputs over serial link (both hardware serial and serial-over-USB are supported).
The kit comes with three major modes including a demo/development mode, a text-only mode, and a pre-processing mode which outputs video intended for machine consumption (edge maps or image crops around key features). This pre-processed video can then be further processed by the host computer, for example, using a massive deep neural network running on a cluster of high-power GPUs to recognize the three most interesting objects that the smart camera has detected. Text outputs can be used in this mode too.
While the host computer only has to run a standard video camera software, the camera does all the work, including image capture, vision processing and display results. In fact, the JeVois smart camera can work as a standalone computer, with no USB video streaming. Users could simply stream commands to an Arduino board over the serial port and power the camera via its mini-USB connector.
Get started in machine vision at jevois.org