[go: up one dir, main page]

GB201611857D0 - An artificial neural network - Google Patents

An artificial neural network

Info

Publication number
GB201611857D0
GB201611857D0 GBGB1611857.2A GB201611857A GB201611857D0 GB 201611857 D0 GB201611857 D0 GB 201611857D0 GB 201611857 A GB201611857 A GB 201611857A GB 201611857 D0 GB201611857 D0 GB 201611857D0
Authority
GB
United Kingdom
Prior art keywords
neural network
artificial neural
artificial
network
neural
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GBGB1611857.2A
Other versions
GB2552014A (en
GB2552014B (en
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ARM Ltd
Original Assignee
ARM Ltd
Advanced Risc Machines Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ARM Ltd, Advanced Risc Machines Ltd filed Critical ARM Ltd
Priority to GB1611857.2A priority Critical patent/GB2552014B/en
Publication of GB201611857D0 publication Critical patent/GB201611857D0/en
Priority to US16/315,991 priority patent/US11334788B2/en
Priority to KR1020197000717A priority patent/KR102489258B1/en
Priority to PCT/GB2017/051734 priority patent/WO2018007783A1/en
Priority to CN201780042139.4A priority patent/CN109416760B/en
Publication of GB2552014A publication Critical patent/GB2552014A/en
Application granted granted Critical
Publication of GB2552014B publication Critical patent/GB2552014B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/06Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G06N3/065Analogue means
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/06Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0499Feedforward networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11CSTATIC STORES
    • G11C11/00Digital stores characterised by the use of particular electric or magnetic storage elements; Storage elements therefor
    • G11C11/54Digital stores characterised by the use of particular electric or magnetic storage elements; Storage elements therefor using elements simulating biological cells, e.g. neuron
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11CSTATIC STORES
    • G11C13/00Digital stores characterised by the use of storage elements not covered by groups G11C11/00, G11C23/00, or G11C25/00
    • G11C13/0002Digital stores characterised by the use of storage elements not covered by groups G11C11/00, G11C23/00, or G11C25/00 using resistive RAM [RRAM] elements

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Evolutionary Computation (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • Neurology (AREA)
  • Computer Hardware Design (AREA)
  • Semiconductor Memories (AREA)
GB1611857.2A 2016-07-07 2016-07-07 Reconfigurable artificial neural networks comprising programmable non-volatile memory elements Active GB2552014B (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
GB1611857.2A GB2552014B (en) 2016-07-07 2016-07-07 Reconfigurable artificial neural networks comprising programmable non-volatile memory elements
US16/315,991 US11334788B2 (en) 2016-07-07 2017-06-14 Neural network including memory elements implemented at nodes
KR1020197000717A KR102489258B1 (en) 2016-07-07 2017-06-14 artificial neural network
PCT/GB2017/051734 WO2018007783A1 (en) 2016-07-07 2017-06-14 An artificial neural network
CN201780042139.4A CN109416760B (en) 2016-07-07 2017-06-14 Artificial neural networks

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB1611857.2A GB2552014B (en) 2016-07-07 2016-07-07 Reconfigurable artificial neural networks comprising programmable non-volatile memory elements

Publications (3)

Publication Number Publication Date
GB201611857D0 true GB201611857D0 (en) 2016-08-24
GB2552014A GB2552014A (en) 2018-01-10
GB2552014B GB2552014B (en) 2020-05-13

Family

ID=56890846

Family Applications (1)

Application Number Title Priority Date Filing Date
GB1611857.2A Active GB2552014B (en) 2016-07-07 2016-07-07 Reconfigurable artificial neural networks comprising programmable non-volatile memory elements

Country Status (5)

Country Link
US (1) US11334788B2 (en)
KR (1) KR102489258B1 (en)
CN (1) CN109416760B (en)
GB (1) GB2552014B (en)
WO (1) WO2018007783A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108977897A (en) * 2018-06-07 2018-12-11 浙江天悟智能技术有限公司 Melt-spinning process control method based on the inherent plasticity echo state network in part
CN109325588A (en) * 2018-11-14 2019-02-12 南京邮电大学 A Weight Operation Module Based on Memristor Matrix
CN111353122A (en) * 2018-12-24 2020-06-30 旺宏电子股份有限公司 Memory storage device capable of internal product operation and operation method thereof

Families Citing this family (63)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2552014B (en) 2016-07-07 2020-05-13 Advanced Risc Mach Ltd Reconfigurable artificial neural networks comprising programmable non-volatile memory elements
US10128438B2 (en) 2016-09-09 2018-11-13 Arm Limited CEM switching device
US10103327B2 (en) 2016-09-14 2018-10-16 Arm Limited CEM switching device
US10121967B2 (en) 2016-11-29 2018-11-06 Arm Limited CEM switching device
US10922608B2 (en) * 2017-03-08 2021-02-16 Arm Ltd Spiking neural network
US11461620B2 (en) * 2017-07-05 2022-10-04 Samsung Electronics Co., Ltd. Multi-bit, SoC-compatible neuromorphic weight cell using ferroelectric FETs
CA3020884A1 (en) * 2018-01-24 2019-07-24 Wai Kit Ricky Fok Parallel residual neural network architechture and system and method for trainning a residual neural network
US11636316B2 (en) * 2018-01-31 2023-04-25 Cerfe Labs, Inc. Correlated electron switch elements for brain-based computing
US11783167B1 (en) 2018-04-20 2023-10-10 Perceive Corporation Data transfer for non-dot product computations on neural network inference circuit
US11210586B1 (en) * 2018-04-20 2021-12-28 Perceive Corporation Weight value decoder of neural network inference circuit
US11341397B1 (en) 2018-04-20 2022-05-24 Perceive Corporation Computation of neural network node
US11222257B1 (en) 2018-04-20 2022-01-11 Perceive Corporation Non-dot product computations on neural network inference circuit
US11481612B1 (en) 2018-04-20 2022-10-25 Perceive Corporation Storage of input values across multiple cores of neural network inference circuit
US11049013B1 (en) 2018-04-20 2021-06-29 Perceive Corporation Encoding of weight values stored on neural network inference circuit
US12093696B1 (en) 2018-04-20 2024-09-17 Perceive Corporation Bus for transporting output values of a neural network layer to cores specified by configuration data
US11586910B1 (en) 2018-04-20 2023-02-21 Perceive Corporation Write cache for neural network inference circuit
US11568227B1 (en) 2018-04-20 2023-01-31 Perceive Corporation Neural network inference circuit read controller with multiple operational modes
US10977338B1 (en) 2018-04-20 2021-04-13 Perceive Corporation Reduced-area circuit for dot product computation
US11640522B2 (en) 2018-12-13 2023-05-02 Tybalt, Llc Computational efficiency improvements for artificial neural networks
US10528643B1 (en) 2018-08-01 2020-01-07 Sandisk Technologies Llc Vector-matrix multiplication using non-volatile memory cells
US10534840B1 (en) 2018-08-08 2020-01-14 Sandisk Technologies Llc Multiplication using non-volatile memory cells
WO2020033645A1 (en) * 2018-08-09 2020-02-13 D5Ai Llc Companion analysis network in deep learning
JP2020035502A (en) * 2018-08-28 2020-03-05 キオクシア株式会社 Semiconductor integrated circuit
US10861551B2 (en) 2018-12-28 2020-12-08 Micron Technology, Inc. Memory cells configured to generate weighted inputs for neural networks
US11347297B1 (en) 2019-01-23 2022-05-31 Perceive Corporation Neural network inference circuit employing dynamic memory sleep
US11599771B2 (en) 2019-01-29 2023-03-07 Hewlett Packard Enterprise Development Lp Recurrent neural networks with diagonal and programming fluctuation to find energy global minima
CN109903162B (en) * 2019-03-01 2021-05-04 山东大学 A ReRAM that accelerates random selection of blockchain MCMC and its working method
US11941533B1 (en) 2019-05-21 2024-03-26 Perceive Corporation Compiler for performing zero-channel removal
TWI744899B (en) * 2019-05-22 2021-11-01 力旺電子股份有限公司 Control circuit for multiply accumulate circuit of neural network system
US11886987B2 (en) 2019-06-25 2024-01-30 Arm Limited Non-volatile memory-based compact mixed-signal multiply-accumulate engine
US11393546B2 (en) * 2019-07-19 2022-07-19 Silicon Storage Technology, Inc. Testing circuitry and methods for analog neural memory in artificial neural network
CN110515454B (en) * 2019-07-24 2021-07-06 电子科技大学 A neural network architecture electronic skin based on memory computing
KR102704121B1 (en) 2019-07-30 2024-09-05 김준성 Device and method for controlling gradual resistance changes of synaptic elements
US11183238B2 (en) * 2019-08-28 2021-11-23 International Business Machines Corporation Suppressing outlier drift coefficients while programming phase change memory synapses
EP3798898A1 (en) * 2019-09-30 2021-03-31 Anyline GmbH Computer-implemented method for optical character recognition
US11537436B2 (en) * 2019-10-02 2022-12-27 Qualcomm Incorporated Method of configuring a memory block allocation of a machine learning network
CN110807519B (en) * 2019-11-07 2023-01-17 清华大学 Parallel acceleration method, processor, and device for memristor-based neural network
KR102782076B1 (en) * 2019-12-13 2025-03-18 삼성전자주식회사 Three-dimensional neuromorphic device including switching element and resistive element
CN111191776A (en) * 2019-12-19 2020-05-22 浙江大学 Storage calculation array, storage calculation module and data calculation method
CN111106839A (en) * 2019-12-19 2020-05-05 北京邮电大学 Polarization code decoding method and device based on neural network
US11663455B2 (en) * 2020-02-12 2023-05-30 Ememory Technology Inc. Resistive random-access memory cell and associated cell array structure
CN111207875B (en) * 2020-02-25 2021-06-25 青岛理工大学 EMG signal-torque matching method based on multi-granularity parallel CNN model
US11544037B2 (en) 2020-04-30 2023-01-03 International Business Machines Corporation Low area multiply and accumulate unit
KR20220011056A (en) * 2020-07-20 2022-01-27 삼성전자주식회사 Processing apparatus and electronic system having the same
CN113962375A (en) * 2020-07-20 2022-01-21 三星电子株式会社 Processing device and electronic device having the same
CN112215855B (en) * 2020-10-20 2024-04-12 清华大学 Method and electronic device for determining image connected area based on memristor array
US11972137B2 (en) 2020-11-02 2024-04-30 Deepx Co., Ltd. System and memory for artificial neural network (ANN) optimization using ANN data locality
KR20220059409A (en) * 2020-11-02 2022-05-10 주식회사 딥엑스 Memory apparatus for artificial neural network
KR102891586B1 (en) 2020-11-02 2025-11-26 주식회사 딥엑스 A memory controller controlling a data transfer based on an artificial neural network model
US11922051B2 (en) 2020-11-02 2024-03-05 Deepx Co., Ltd. Memory controller, processor and system for artificial neural network
US11696518B2 (en) 2020-11-20 2023-07-04 International Business Machines Corporation Hybrid non-volatile memory cell
US12159214B1 (en) 2021-04-23 2024-12-03 Perceive Corporation Buffering of neural network inputs and outputs
WO2023009653A1 (en) * 2021-07-28 2023-02-02 Rain Neuromorphics Inc. Electrical networks using analytic loss gradients for design, analysis and machine learning
CN113675294B (en) * 2021-08-20 2023-03-31 电子科技大学 Photoelectric synapse device of double-layer ternary oxide and preparation and working methods thereof
CN114284430B (en) * 2021-11-18 2025-11-14 南京邮电大学 A ferroelectric memristor device based on lanthanum titanate and its fabrication method
US11853558B2 (en) 2021-12-30 2023-12-26 Micron Technology, Inc. Power down workload estimation
KR20240124982A (en) * 2022-01-28 2024-08-19 실리콘 스토리지 테크놀로지 인크 Artificial neural network including analog array and digital array
EP4345823A1 (en) * 2022-09-30 2024-04-03 IHP GmbH - Innovations for High Performance Microelectronics / Leibniz-Institut für innovative Mikroelektronik Resistive memory subcell, resistive random access memory for in-memory-computing and in-memory-processor
US12159685B2 (en) * 2022-10-11 2024-12-03 Globalfoundries U.S. Inc. Partitioned memory architecture and method for repeatedly using the architecture for multiple in-memory processing layers
US12125530B2 (en) 2022-10-11 2024-10-22 Globalfoundries U.S. Inc. Partitioned memory architecture with single resistor or dual resistor memory elements for in-memory pipeline processing
US12211585B2 (en) 2022-10-11 2025-01-28 Globalfoundries U.S. Inc. Partitioned memory architecture with single resistor memory elements for in-memory serial processing
US12136468B2 (en) 2022-10-11 2024-11-05 Globalfoundries U.S. Inc. Calibration methods and structures for partitioned memory architecture with single resistor or dual resistor memory elements
US12106804B2 (en) 2022-10-11 2024-10-01 Globalfoundries U.S. Inc. Partitioned memory architecture with dual resistor memory elements for in-memory serial processing

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5912839A (en) * 1998-06-23 1999-06-15 Energy Conversion Devices, Inc. Universal memory element and method of programming same
US7978498B2 (en) * 2009-04-03 2011-07-12 Sandisk 3D, Llc Programming non-volatile storage element using current from other element
KR101888468B1 (en) * 2011-06-08 2018-08-16 삼성전자주식회사 Synapse for a function cell of spike-timing-dependent plasticity(stdp), the function cell of spike-timing-dependent plasticity, and a neuromorphic circuit using the function cell of spike-timing-dependent plasticity
US9111222B2 (en) * 2011-11-09 2015-08-18 Qualcomm Incorporated Method and apparatus for switching the binary state of a location in memory in a probabilistic manner to store synaptic weights of a neural network
TWI451570B (en) * 2011-11-15 2014-09-01 Univ Nat Chiao Tung Multi-bit resistance switching memory components and arrays
US10157669B2 (en) * 2013-04-02 2018-12-18 Micron Technology, Inc. Method of storing and retrieving information for a resistive random access memory (RRAM) with multi-memory cells per bit
KR102179899B1 (en) * 2013-08-05 2020-11-18 삼성전자주식회사 Neuromophic system and configuration method thereof
US9483727B2 (en) * 2013-09-18 2016-11-01 Fair Isaac Corporation Reduction of computation complexity of neural network sensitivity analysis
US20150324691A1 (en) * 2014-05-07 2015-11-12 Seagate Technology Llc Neural network connections using nonvolatile memory devices
US10970625B2 (en) * 2014-11-03 2021-04-06 Hewlett Packard Enterprise Development Lp Device with multiple resistance switches with different switching characteristics
KR102380833B1 (en) * 2014-12-02 2022-03-31 삼성전자주식회사 Voice recognizing method and voice recognizing appratus
US9299430B1 (en) * 2015-01-22 2016-03-29 Nantero Inc. Methods for reading and programming 1-R resistive change element arrays
US10248907B2 (en) * 2015-10-20 2019-04-02 International Business Machines Corporation Resistive processing unit
US10332592B2 (en) * 2016-03-11 2019-06-25 Hewlett Packard Enterprise Development Lp Hardware accelerators for calculating node values of neural networks
GB2552014B (en) 2016-07-07 2020-05-13 Advanced Risc Mach Ltd Reconfigurable artificial neural networks comprising programmable non-volatile memory elements

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108977897A (en) * 2018-06-07 2018-12-11 浙江天悟智能技术有限公司 Melt-spinning process control method based on the inherent plasticity echo state network in part
CN109325588A (en) * 2018-11-14 2019-02-12 南京邮电大学 A Weight Operation Module Based on Memristor Matrix
CN109325588B (en) * 2018-11-14 2023-10-24 南京邮电大学 Weight calculation module based on memristor matrix
CN111353122A (en) * 2018-12-24 2020-06-30 旺宏电子股份有限公司 Memory storage device capable of internal product operation and operation method thereof
CN111353122B (en) * 2018-12-24 2023-04-07 旺宏电子股份有限公司 Memory storage device capable of internal product operation and operation method thereof

Also Published As

Publication number Publication date
WO2018007783A1 (en) 2018-01-11
GB2552014A (en) 2018-01-10
US11334788B2 (en) 2022-05-17
CN109416760B (en) 2024-03-01
GB2552014B (en) 2020-05-13
KR102489258B1 (en) 2023-01-18
CN109416760A (en) 2019-03-01
KR20190022622A (en) 2019-03-06
US20190236445A1 (en) 2019-08-01

Similar Documents

Publication Publication Date Title
GB201611857D0 (en) An artificial neural network
IL262329B (en) Artificial neuron
SG11202007532TA (en) Neural network accelerator
GB2582519B (en) Convolutional neural network hardware
GB2568087B (en) Activation functions for deep neural networks
GB202006969D0 (en) Facilitating neural network efficiency
GB2560387B (en) Action identification using neural networks
GB201718756D0 (en) Neural interface
GB201715031D0 (en) Neural network instruction set architecture
GB201917993D0 (en) Neural network classification
ZA201905869B (en) Octree-based convolutional neural network
IL231862A (en) Neural network image representation
GB201511887D0 (en) Improved artificial neural network for language modelling and prediction
GB201816545D0 (en) Artificial neuron apparatus
GB201512278D0 (en) Hybrid neural network
GB201608958D0 (en) Implantable neural interface
GB201603606D0 (en) Prosthesis
GB201706976D0 (en) Endoprosthesis
EP3497622A4 (en) ARTIFICIAL NEURONAL NETWORK
GB201804451D0 (en) Artificial neural networks
GB201803083D0 (en) Artificial Neural Networks
IL273190A (en) Genome-edited birds
GB2601073B (en) Activation functions for Deep Neural Networks
EP3563305A4 (en) ARTIFICIAL NEURAL NETWORK
GB201601159D0 (en) Prosthesis