Search
Menu
Cognex Corp. - Smart Sensor 3-24 GIF LB

DARPA Taps Teams to Develop Neuromorphic Imagers

Facebook X LinkedIn Email
DARPA has announced three teams of researchers led by Raytheon, BAE Systems, and Northrop Grumman to develop event-based infrared camera technologies under the Fast Event-Based Neuromorphic Camera and Electronics (FENCE) system.

Event-based, or neuromorphic, cameras are an emerging class of sensors with demonstrated advantages relative to traditional imagers. The systems operate asynchronously and only transmit information about pixels that have changed, meaning that they produce significantly less data and operate with much lower latency and power.

“Neuromorphic refers to silicon circuits that mimic brain operation — they offer sparse output, low latency, and high energy efficiency,” said Whitney Mason, program manager leading the FENCE program. “Event-based cameras operate under these same principles when dealing with sparse scenes, but currently lack advanced ‘intelligence’ to perform more difficult perception and control tasks.”

Today’s state-of-the-art cameras work well with scenes that have few changes to track and sample imagery. However, the systems have a difficult time with cluttered and dynamic scenes, which limits their use in military applications.

The FENCE project seeks to address those shortcomings by developing and demonstrating a low-latency, low-power, event-based IR focal plane array (FPA) and a new class of digital signal processing and learning algorithms to enable intelligent sensors that can handle more dynamic and complex scenes. The three teams will work to develop an asynchronous read-out integrated circuit (ROIC) with low latency, as well as a processing layer that integrates with the ROIC to identify relevant spatial and temporal signals. Together the ROIC and processing layer will enable an integrated FENCE sensor to operate on less than 1.5 W.

“The goal is to develop a ‘smart’ sensor that can intelligently reduce the amount of information that is transmitted from the camera, narrowing down the data for consideration to only the most relevant pixels,” Mason said.

The technology could aid military applications such as autonomous vehicles, robotics, IR search and tracking, and others. To ensure broad applicability, the researchers will also focus on developing a single solution that is flexible and adaptable so it can be used across various mission spaces.
Hamamatsu Corp. - Earth Innovations MR 2/24


Published: July 2021
Glossary
neuromorphic
Neuromorphic refers to the design and development of computing systems or devices that are inspired by the structure and functioning of the human brain and nervous system. The term is derived from "neuro," meaning relating to the nervous system, and "morphic," referring to form or structure. Neuromorphic computing aims to mimic the parallel processing, connectivity, and energy efficiency observed in biological neural networks. Key characteristics of neuromorphic systems include: Parallel...
machine vision
Machine vision, also known as computer vision or computer sight, refers to the technology that enables machines, typically computers, to interpret and understand visual information from the world, much like the human visual system. It involves the development and application of algorithms and systems that allow machines to acquire, process, analyze, and make decisions based on visual data. Key aspects of machine vision include: Image acquisition: Machine vision systems use various...
artificial intelligence
The ability of a machine to perform certain complex functions normally associated with human intelligence, such as judgment, pattern recognition, understanding, learning, planning, and problem solving.
BusinessDARPAdefenseImagingcamerasneuromorphicevent-basedAmericasSensors & Detectorsmachine visionartificial intelligenceAIalgorithmsmilitaryspaceRaytheonNorthrop GrummanBAE Systemslight speed

We use cookies to improve user experience and analyze our website traffic as stated in our Privacy Policy. By using this website, you agree to the use of cookies unless you have disabled them.