Page 39 - september22_082722.indd
P. 39

TAP TIMES       -39-                                   SEPTEMBER 2022


                     New chip (from 38)                         on different tasks. They found that it’s

                                                                99% accurate in letter recognition from
        The memory technology that NeuRRAM                      the MNIST dataset, 85.7% accurate on
        used is resistive random-access memory                  image classification from the CIFAR-10
        (RRAM).                                                 dataset, 84.7% accurate on Google speech
                                                                command recognition and showed a 70%
        Non-volatile memory                                     reduction in image-reconstruction error on
        It is a type of non-volatile memory—                    a Bayesian image recovery task.
        memory that retains data even once pow-
        er is off — that has emerged in commer-                 From hardware to software
        cial products.                                          “Efficiency, versatility, and accuracy are all
                                                                important aspects for broader adoption of
        RRAM can store large AI models in a small               the technology,” said Wan. “But to realize
        area footprint, and consume very little                 them all at once is not simple. Co-optimiz-
        power, making them perfect for small-size               ing the full stack from hardware to soft-
        and low-power edge devices.                             ware is the key.”

        Even though the concept of CIM chips is                 Right now, NeuRRAM is a physical proof-
        well established, and the idea of imple-                of-concept but needs more development
        menting AI computing in RRAM isn’t                      before it’s ready to be translated into ac-
        new, “this is one of the first instances                tual edge devices.
        to integrate a lot of memory right onto
        the neural network chip and present all                 But this combined efficiency, accuracy, and
        benchmark results through hardware mea-                 ability to do different tasks showcases the
        surements,” said Wong, who is a co-senior               chip’s potential.
        author of the Nature paper.
                                                                Simple to complex tasks
        The architecture of NeuRRAM allows the                  “Maybe today it is used to do simple AI
        chip to perform analog in-memory compu-                 tasks such as keyword spotting or human
        tation at low power and in a compact-area               detection, but tomorrow it could enable a
        footprint.                                              whole different user experience. Imagine
                                                                real-time video analytics combined with
        Designed with UC San Diego                              speech recognition all within a tiny device,”
        It was designed in collaboration with the               said Wan.
        lab of Gert Cauwenberghs at the Universi-
        ty of California, San Diego, who pioneered              “To realize this, we need to continue im-
        low-power neuromorphic hardware design.                 proving the design and scaling RRAM to
                                                                more advanced technology nodes.”
        The architecture also enables reconfigu-
        rability in dataflow directions, supports               “This work opens up several avenues of
        various AI workload mapping strategies,                 future research on RRAM device engineer-
        and can work with different kinds of AI                 ing, and programming models and neural
        algorithms – all without sacrificing AI com-            network design for compute-in-memory, to
        putation accuracy.                                      make this technology scalable and usable
                                                                by software developers”, said Priyanka

        To show the accuracy of NeuRRAM’s AI                    Raina, a co-author and assistant professor.
        abilities, the team tested how it functioned                                               stanford.edu
   34   35   36   37   38   39   40