[go: up one dir, main page]

DK3555814T3 - Udførelse af average pooling i hardware - Google Patents

Udførelse af average pooling i hardware Download PDF

Info

Publication number
DK3555814T3
DK3555814T3 DK17761165.4T DK17761165T DK3555814T3 DK 3555814 T3 DK3555814 T3 DK 3555814T3 DK 17761165 T DK17761165 T DK 17761165T DK 3555814 T3 DK3555814 T3 DK 3555814T3
Authority
DK
Denmark
Prior art keywords
hardware
average pooling
performing average
pooling
average
Prior art date
Application number
DK17761165.4T
Other languages
English (en)
Inventor
Reginald Clifford Young
William John Gulland
Original Assignee
Google Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/377,196 external-priority patent/US10032110B2/en
Application filed by Google Llc filed Critical Google Llc
Application granted granted Critical
Publication of DK3555814T3 publication Critical patent/DK3555814T3/da

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/06Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0464Convolutional networks [CNN, ConvNet]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00Computing arrangements using knowledge-based models
    • G06N5/04Inference or reasoning models

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Mathematical Physics (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurology (AREA)
  • Image Analysis (AREA)
  • Complex Calculations (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Advance Control (AREA)
DK17761165.4T 2016-12-13 2017-08-22 Udførelse af average pooling i hardware DK3555814T3 (da)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15/377,196 US10032110B2 (en) 2016-12-13 2016-12-13 Performing average pooling in hardware
US15/467,294 US10037490B2 (en) 2016-12-13 2017-03-23 Performing average pooling in hardware
PCT/US2017/048017 WO2018111357A1 (en) 2016-12-13 2017-08-22 Performing average pooling in hardware

Publications (1)

Publication Number Publication Date
DK3555814T3 true DK3555814T3 (da) 2024-03-18

Family

ID=59746363

Family Applications (1)

Application Number Title Priority Date Filing Date
DK17761165.4T DK3555814T3 (da) 2016-12-13 2017-08-22 Udførelse af average pooling i hardware

Country Status (12)

Country Link
US (3) US10037490B2 (da)
EP (2) EP4369255A1 (da)
JP (1) JP6900487B2 (da)
KR (2) KR102370563B1 (da)
CN (2) CN114239797B (da)
DE (2) DE202017105528U1 (da)
DK (1) DK3555814T3 (da)
FI (1) FI3555814T3 (da)
GB (1) GB2557703B (da)
IE (3) IE20170187A1 (da)
SG (2) SG10201805259XA (da)
WO (1) WO2018111357A1 (da)

Families Citing this family (59)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10175980B2 (en) 2016-10-27 2019-01-08 Google Llc Neural network compute tile
US9959498B1 (en) 2016-10-27 2018-05-01 Google Llc Neural network instruction set architecture
US10360163B2 (en) 2016-10-27 2019-07-23 Google Llc Exploiting input data sparsity in neural network compute units
US10037490B2 (en) 2016-12-13 2018-07-31 Google Llc Performing average pooling in hardware
WO2018171900A1 (en) * 2017-03-24 2018-09-27 Huawei Technologies Co., Ltd. Neural network data processing apparatus and method
US11551067B2 (en) * 2017-04-06 2023-01-10 Shanghai Cambricon Information Technology Co., Ltd Neural network processor and neural network computation method
US10795836B2 (en) * 2017-04-17 2020-10-06 Microsoft Technology Licensing, Llc Data processing performance enhancement for neural networks using a virtualized data iterator
CN107146616B (zh) * 2017-06-13 2020-05-08 Oppo广东移动通信有限公司 设备控制方法及相关产品
US11328037B2 (en) * 2017-07-07 2022-05-10 Intel Corporation Memory-size- and bandwidth-efficient method for feeding systolic array matrix multipliers
US10740607B2 (en) * 2017-08-18 2020-08-11 Autel Robotics Co., Ltd. Method for determining target through intelligent following of unmanned aerial vehicle, unmanned aerial vehicle and remote control
CN107633295B (zh) * 2017-09-25 2020-04-28 南京地平线机器人技术有限公司 用于适配神经网络的参数的方法和装置
US11010666B1 (en) * 2017-10-24 2021-05-18 Tunnel Technologies Inc. Systems and methods for generation and use of tensor networks
US12307350B2 (en) * 2018-01-04 2025-05-20 Tesla, Inc. Systems and methods for hardware-based pooling
US11164073B2 (en) 2018-02-08 2021-11-02 Western Digital Technologies, Inc. Systolic neural network processor with feedback control
US11769042B2 (en) 2018-02-08 2023-09-26 Western Digital Technologies, Inc. Reconfigurable systolic neural network engine
CN110096309B (zh) * 2018-11-14 2020-04-14 上海寒武纪信息科技有限公司 运算方法、装置、计算机设备和存储介质
US11636325B2 (en) * 2018-10-24 2023-04-25 Macronix International Co., Ltd. In-memory data pooling for machine learning
CN111126558B (zh) * 2018-10-31 2024-04-02 嘉楠明芯(北京)科技有限公司 一种卷积神经网络计算加速方法及装置、设备、介质
CN111160516B (zh) * 2018-11-07 2023-09-05 杭州海康威视数字技术股份有限公司 一种深度神经网络的卷积层稀疏化方法及装置
JP7315317B2 (ja) 2018-11-09 2023-07-26 株式会社Preferred Networks プロセッサおよびプロセッサのデータ転送方法
US10963746B1 (en) * 2019-01-14 2021-03-30 Xilinx, Inc. Average pooling in a neural network
US11556764B2 (en) * 2019-03-01 2023-01-17 Microsoft Technology Licensing, Llc Deriving a concordant software neural network layer from a quantized firmware neural network layer
GB2582352B (en) * 2019-03-20 2021-12-15 Imagination Tech Ltd Methods and systems for implementing a convolution transpose layer of a neural network
US11783176B2 (en) 2019-03-25 2023-10-10 Western Digital Technologies, Inc. Enhanced storage device memory architecture for machine learning
US10929058B2 (en) 2019-03-25 2021-02-23 Western Digital Technologies, Inc. Enhanced memory device architecture for machine learning
KR102728641B1 (ko) * 2019-04-01 2024-11-12 주식회사 사피온코리아 버퍼 메모리, 이를 이용하는 연산 장치 및 시스템
CN110046705B (zh) * 2019-04-15 2022-03-22 广州异构智能科技有限公司 用于卷积神经网络的装置
CN110033085B (zh) * 2019-04-15 2021-08-31 广州异构智能科技有限公司 张量处理器
CN110059805B (zh) * 2019-04-15 2021-08-31 广州异构智能科技有限公司 用于二值阵列张量处理器的方法
CN110188795B (zh) * 2019-04-24 2023-05-09 华为技术有限公司 图像分类方法、数据处理方法和装置
US11593637B2 (en) 2019-04-30 2023-02-28 Samsung Electronics Co., Ltd. Convolution streaming engine for deep neural networks
KR102802339B1 (ko) 2019-07-31 2025-05-07 삼성전자주식회사 프로세서 및 그 제어 방법
US11449739B2 (en) 2019-08-22 2022-09-20 Google Llc General padding support for convolution on systolic arrays
US12229657B2 (en) * 2019-10-08 2025-02-18 Apple Inc. Multi-mode planar engine for neural processor
KR20210051920A (ko) * 2019-10-31 2021-05-10 삼성전자주식회사 신경망의 커널들을 정렬하는 전자 장치 및 이의 동작 방법
CN112766471B (zh) * 2019-11-01 2024-03-29 中科寒武纪科技股份有限公司 运算装置及相关产品
US11513799B2 (en) * 2019-11-04 2022-11-29 Apple Inc. Chained buffers in neural network processor
CN111191780B (zh) * 2020-01-03 2024-03-19 珠海亿智电子科技有限公司 均值池化累加电路、装置以及方法
US11630991B2 (en) 2020-02-04 2023-04-18 Apple Inc. Broadcasting mode of planar engine for neural processor
US11507831B2 (en) * 2020-02-24 2022-11-22 Stmicroelectronics International N.V. Pooling unit for deep learning acceleration
CN113496281B (zh) * 2020-03-19 2025-03-07 光子智能私营科技有限公司 光电计算系统
KR102866053B1 (ko) * 2020-04-10 2025-09-30 에스케이하이닉스 주식회사 시스톨릭 어레이를 갖는 신경망 연산 장치
US11507817B2 (en) 2020-04-17 2022-11-22 Samsung Electronics Co., Ltd. System and method for performing computations for deep neural networks
KR102891572B1 (ko) * 2020-06-18 2025-11-26 삼성전자주식회사 텐서 처리 방법, 가속기 및 이를 포함한 전자 장치
KR102891573B1 (ko) * 2020-06-30 2025-11-26 삼성전자주식회사 텐서 처리 방법, 가속기 및 이를 포함한 가속기 시스템
US20230316071A1 (en) * 2020-06-30 2023-10-05 Leapmind Inc. Neural network generating device, neural network generating method, and neural network generating program
IT202000016909A1 (it) * 2020-07-13 2022-01-13 St Microelectronics Srl Procedimento di elaborazione dati implementato su elaboratore, sistema micro-controllore e prodotto informatico corrispondenti
JP2022018997A (ja) * 2020-07-17 2022-01-27 ソニーセミコンダクタソリューションズ株式会社 固体撮像素子、撮像装置、および、情報処理システム
US20210150323A1 (en) * 2020-12-23 2021-05-20 Intel Corporation Methods and apparatus to implement a neural network
GB2604142B (en) * 2021-02-25 2023-02-22 Imagination Tech Ltd Implementation of softmax and exponential in hardware
US11797270B2 (en) * 2021-06-17 2023-10-24 International Business Machines Corporation Single function to perform multiple operations with distinct operation parameter validation
KR102361249B1 (ko) * 2021-08-02 2022-02-14 오픈엣지테크놀로지 주식회사 브로드캐스팅 멀티플라이 최적화 방법 및 이를 이용한 하드웨어 가속기, 이를 이용한 컴퓨팅 장치
KR20230043512A (ko) * 2021-09-24 2023-03-31 에스케이하이닉스 주식회사 데이터 처리 시스템 및 그 동작 방법과, 이를 이용한 컴퓨팅 시스템
US11657864B1 (en) * 2021-12-17 2023-05-23 Winbond Electronics Corp. In-memory computing apparatus and computing method having a memory array includes a shifted weight storage, shift information storage and shift restoration circuit to restore a weigh shifted amount of shifted sum-of-products to generate multiple restored sum-of-products
US12118354B2 (en) 2022-08-30 2024-10-15 Advanced Micro Devices, Inc. Virtually padding data structures
US11726746B1 (en) * 2022-09-14 2023-08-15 Moffett International Co., Limited Vector operation acceleration with convolution computation unit
CN115660065A (zh) * 2022-09-26 2023-01-31 北京地平线信息技术有限公司 指令生成方法及装置、池化运算方法及电子设备
US20240220764A1 (en) * 2023-01-04 2024-07-04 Apple Inc. Efficient zero padding in convolution at neural processor
KR102849395B1 (ko) * 2023-11-01 2025-08-22 한국전자기술연구원 학습 및 추론 가속이 가능한 최댓값 풀링 하드웨어

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US1003749A (en) 1910-04-05 1911-09-19 Gustav Jaennert Razor.
US1003211A (en) 1910-04-11 1911-09-12 William S Levings Valve-locking device.
JP3373874B2 (ja) * 1992-11-24 2003-02-04 株式会社リコー 画像処理装置
US6389441B1 (en) 1999-05-28 2002-05-14 Eastman Kodak Company Two dimensional moving average filter
JP4573769B2 (ja) 2005-12-20 2010-11-04 富士通セミコンダクター株式会社 画像処理回路および画像処理方法
GB2436377B (en) 2006-03-23 2011-02-23 Cambridge Display Tech Ltd Data processing hardware
KR100793285B1 (ko) 2007-05-11 2008-01-10 주식회사 코아로직 필터 매트릭스에 의한 영상 노이즈 제거 시스템, 방법 및그 기록매체
JP2009230494A (ja) * 2008-03-24 2009-10-08 Nec Corp Fpgaを用いた並列周辺画素加算モジュール、その方法及びそのプログラム
US8133287B2 (en) * 2010-08-04 2012-03-13 Tesla Motors, Inc. Method of controlled cell-level fusing within a battery pack
US10078620B2 (en) 2011-05-27 2018-09-18 New York University Runtime reconfigurable dataflow processor with multi-port memory access module
US8886533B2 (en) 2011-10-25 2014-11-11 At&T Intellectual Property I, L.P. System and method for combining frame and segment level processing, via temporal pooling, for phonetic classification
JP5935435B2 (ja) * 2012-03-26 2016-06-15 富士通株式会社 画像処理装置、画像処理方法
WO2014055874A1 (en) 2012-10-05 2014-04-10 Raytheon BBN Technologies, Corp. Fast computation of kernel descriptors
US20150104102A1 (en) 2013-10-11 2015-04-16 Universidade De Coimbra Semantic segmentation method with second-order pooling
US9978014B2 (en) * 2013-12-18 2018-05-22 Intel Corporation Reconfigurable processing unit
US9424492B2 (en) 2013-12-27 2016-08-23 Xerox Corporation Weighting scheme for pooling image descriptors
CN106796647B (zh) 2014-09-05 2018-09-14 北京市商汤科技开发有限公司 场景文本检测系统和方法
US10083395B2 (en) 2015-05-21 2018-09-25 Google Llc Batch processing in a neural network processor
US9747546B2 (en) * 2015-05-21 2017-08-29 Google Inc. Neural network processor
US9805303B2 (en) * 2015-05-21 2017-10-31 Google Inc. Rotating data for neural network computations
US10192162B2 (en) * 2015-05-21 2019-01-29 Google Llc Vector computation unit in a neural network processor
US10438117B1 (en) 2015-05-21 2019-10-08 Google Llc Computing convolutions using a neural network processor
US20160358069A1 (en) * 2015-06-03 2016-12-08 Samsung Electronics Co., Ltd. Neural network suppression
US9792492B2 (en) * 2015-07-07 2017-10-17 Xerox Corporation Extracting gradient features from neural networks
JP2017068608A (ja) * 2015-09-30 2017-04-06 株式会社東芝 演算装置、方法及びプログラム
US10474627B2 (en) 2015-10-08 2019-11-12 Via Alliance Semiconductor Co., Ltd. Neural network unit with neural memory and array of neural processing units that collectively shift row of data received from neural memory
US10228911B2 (en) * 2015-10-08 2019-03-12 Via Alliance Semiconductor Co., Ltd. Apparatus employing user-specified binary point fixed point arithmetic
JP6750203B2 (ja) * 2015-10-20 2020-09-02 富士通株式会社 畳み込みニューラルネットワークの演算方法及び演算プログラム、情報処理装置
US9904874B2 (en) * 2015-11-05 2018-02-27 Microsoft Technology Licensing, Llc Hardware-efficient deep convolutional neural networks
CN105488656A (zh) 2015-11-20 2016-04-13 贵州电网有限责任公司遵义供电局 一种电网分县局继电保护管理系统功能模块动态配置技术
US10552119B2 (en) * 2016-04-29 2020-02-04 Intel Corporation Dynamic management of numerical representation in a distributed matrix processor architecture
CN106066783A (zh) * 2016-06-02 2016-11-02 华为技术有限公司 基于幂次权重量化的神经网络前向运算硬件结构
US10037490B2 (en) 2016-12-13 2018-07-31 Google Llc Performing average pooling in hardware

Also Published As

Publication number Publication date
KR20190089204A (ko) 2019-07-30
IE20170187A1 (en) 2018-06-27
US20180300628A1 (en) 2018-10-18
KR20210127813A (ko) 2021-10-22
CN114239797A (zh) 2022-03-25
SG10201707701PA (en) 2018-07-30
FI3555814T3 (fi) 2024-03-18
KR102315346B1 (ko) 2021-10-19
CN108615072A (zh) 2018-10-02
CN108615072B (zh) 2021-12-07
SG10201805259XA (en) 2018-07-30
US10037490B2 (en) 2018-07-31
DE202017105528U1 (de) 2017-12-18
KR102370563B1 (ko) 2022-03-03
EP4369255A1 (en) 2024-05-15
IE20180231A1 (en) 2018-10-17
US20190354863A1 (en) 2019-11-21
EP3555814A1 (en) 2019-10-23
WO2018111357A1 (en) 2018-06-21
US10679127B2 (en) 2020-06-09
IE20190119A1 (en) 2020-09-30
DE102017121257A1 (de) 2018-06-14
US11232351B2 (en) 2022-01-25
GB2557703B (en) 2021-03-31
CN114239797B (zh) 2025-02-18
GB201715180D0 (en) 2017-11-01
GB2557703A (en) 2018-06-27
EP3555814B1 (en) 2023-12-27
JP2020506454A (ja) 2020-02-27
JP6900487B2 (ja) 2021-07-07
US20180165577A1 (en) 2018-06-14

Similar Documents

Publication Publication Date Title
DK3555814T3 (da) Udførelse af average pooling i hardware
FIC20230006I1 (fi) Vutrisiraani
DK3539059T3 (da) Udførelse af kernel striding i hardware
CL2017001901A1 (es) Terapéuticos de glicano y métodos relacionados del mismo
DK3627029T3 (da) Manipulationssikret låg
EP3390273A4 (en) MICROSTRUCTURED SURFACE
EP3402944C0 (de) Stütze
EP3374114A4 (en) WORKBENCH
SI3259253T1 (sl) Sulfonilsečnine in sorodne spojine ter njihova uporaba
KR20180084891A (ko) 구조 조성물 및 방법
DK3663292T3 (da) Diphenylmethan-derivat i krystallinsk form
DK3923145T3 (da) Adressecaching i switches
HRP20181549T1 (hr) Pištolj s blokom za zaključavanje
EP3353244A4 (en) POLYMER AMINOACRYLATE
DK3380086T3 (da) Cyp26-resistente rar-alpha-selektive agonister i behandling af cancer
EP3398042A4 (en) REMOVAL OF BACKGROUND
SI3337506T1 (sl) Kombinacije in njihove uporabe
DK3276177T3 (da) Spiralhuspumpe
DE112016001806A5 (de) Bausatz
EP3445347A4 (en) IMPROVEMENT OF CHEMOTHERAPY
UY4439S (es) Trofeo
DK3510183T3 (da) Forbedringer af bøjlestænger
DOS2016000279S (es) Perfiles
UY4431S (es) Configuración aplicada en refrigerador
UA34510S (uk) Табурет