[go: up one dir, main page]

WO2001086359A3 - Fuzzy-steuerung mit reinforcement-lernverfahren - Google Patents

Fuzzy-steuerung mit reinforcement-lernverfahren Download PDF

Info

Publication number
WO2001086359A3
WO2001086359A3 PCT/DE2001/001653 DE0101653W WO0186359A3 WO 2001086359 A3 WO2001086359 A3 WO 2001086359A3 DE 0101653 W DE0101653 W DE 0101653W WO 0186359 A3 WO0186359 A3 WO 0186359A3
Authority
WO
WIPO (PCT)
Prior art keywords
reinforcement learning
learning method
fuzzy control
control strategy
fuzzy
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/DE2001/001653
Other languages
English (en)
French (fr)
Other versions
WO2001086359A2 (de
Inventor
Martin Appl
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens AG
Siemens Corp
Original Assignee
Siemens AG
Siemens Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens AG, Siemens Corp filed Critical Siemens AG
Publication of WO2001086359A2 publication Critical patent/WO2001086359A2/de
Publication of WO2001086359A3 publication Critical patent/WO2001086359A3/de
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/07—Controlling traffic signals
    • G08G1/081—Plural intersections under common control
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B13/00—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion
    • G05B13/02—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric
    • G05B13/0265—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric the criterion being a learning criterion
    • G05B13/0275—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric the criterion being a learning criterion using fuzzy logic only

Landscapes

  • Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Mathematical Physics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Fuzzy Systems (AREA)
  • Automation & Control Theory (AREA)
  • Feedback Control In General (AREA)
  • Traffic Control Systems (AREA)
  • Control Of Eletrric Generators (AREA)

Abstract

Zum Ermitteln einer Steuerungsstrategie eines technischen Systems werden die Systembeschreibung mittels Fuzzy-Partitionen und entsprechend mit Fuzzy-Zugehörigkeitsfunktionen diskretisiert und in dem diskretisierten Modell wird unter Verwenden von Reinforcement-Lernens die Steuerungsstrategie zum Steuern des technischen Systems ermittelt.
PCT/DE2001/001653 2000-05-05 2001-05-02 Fuzzy-steuerung mit reinforcement-lernverfahren Ceased WO2001086359A2 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE10021929.2 2000-05-05
DE2000121929 DE10021929A1 (de) 2000-05-05 2000-05-05 Verfahren und Fuzzy-Steuervorrichtung zum rechnergestützten Ermitteln einer Steuerungsstrategie für ein technisches System, Computerlesbares Speichermedium und Computerprogramm-Element

Publications (2)

Publication Number Publication Date
WO2001086359A2 WO2001086359A2 (de) 2001-11-15
WO2001086359A3 true WO2001086359A3 (de) 2002-06-06

Family

ID=7640906

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/DE2001/001653 Ceased WO2001086359A2 (de) 2000-05-05 2001-05-02 Fuzzy-steuerung mit reinforcement-lernverfahren

Country Status (2)

Country Link
DE (1) DE10021929A1 (de)
WO (1) WO2001086359A2 (de)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109975800A (zh) * 2019-04-01 2019-07-05 中国电子科技集团公司信息科学研究院 组网雷达资源管控方法及装置、计算机可读存储介质

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AT500832B1 (de) * 2004-10-13 2007-06-15 Rudolf Dr Stricker Verfahren und einrichtung zur regelung von verkehrsströmen
DE102007017259B4 (de) * 2007-04-12 2009-04-09 Siemens Ag Verfahren zur rechnergestützten Steuerung und/oder Regelung eines technischen Systems
GB0916204D0 (en) 2009-09-16 2009-10-28 Road Safety Man Ltd Traffic signal control system and method
EP2386987B1 (de) * 2010-04-20 2013-09-11 Alcatel Lucent Verfahren zum bestärkenden Lernen, entsprechendes Computerprogrammprodukt und Datenspeichervorrichtung dafür
AT510248B1 (de) * 2010-07-29 2023-01-15 Dr Kuhn Andreas Verfahren zur verkehrsregelung eines strassenzuges
DE102011075337A1 (de) * 2011-05-05 2012-11-08 Siemens Ag Verfahren und Vorrichtung zur Ansteuerung einer Anlage
CN105632198A (zh) * 2016-01-26 2016-06-01 新誉集团有限公司 基于模糊控制的城市区域道路交通协调控制方法及系统
EP3623881A1 (de) * 2018-09-17 2020-03-18 Siemens Aktiengesellschaft Computerimplementiertes verfahren zum abschätzen eines technischen verhaltens einer vorrichtung
DE102021200804A1 (de) 2021-01-29 2022-08-04 Yunex Gmbh Verfahren zur Ansteuerung von Anzeigequerschnitten

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE4436339A1 (de) * 1994-10-11 1996-04-18 Ifu Gmbh Verfahren zur verkehrsadaptiven Steuerung einer Verkehrsampelanlage
WO1997034274A1 (de) * 1996-03-12 1997-09-18 Siemens Aktiengesellschaft Verkehrsabhängige steuerung von verkehrs-lichtsignalanlagen mit hilfe von fuzzy-logik
WO2001018767A1 (de) * 1999-09-02 2001-03-15 Siemens Aktiengesellschaft Steuerungsvorrichtung für eine verkehrsampelkreuzung

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE4436339A1 (de) * 1994-10-11 1996-04-18 Ifu Gmbh Verfahren zur verkehrsadaptiven Steuerung einer Verkehrsampelanlage
WO1997034274A1 (de) * 1996-03-12 1997-09-18 Siemens Aktiengesellschaft Verkehrsabhängige steuerung von verkehrs-lichtsignalanlagen mit hilfe von fuzzy-logik
WO2001018767A1 (de) * 1999-09-02 2001-03-15 Siemens Aktiengesellschaft Steuerungsvorrichtung für eine verkehrsampelkreuzung

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
APPL M ET AL: "FUZZY Q-LEARNING IN NONSTATIONARY ENVIRONMENTS", EUROPEAN CONGRESS ON INTELLIGENT TECHNIQUES AND SOFT COMPUTING PROCEEDINGS, XX, XX, PAGE(S) 284, XP001000981 *
BERENJI ET AL: "Clustering in product space for fuzzy inference", PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS. SAN FRANCISCO, MAR. 28 - APR. 1, 1993, NEW YORK, IEEE, US, VOL. VOL. 2 CONF. 2, PAGE(S) 1402-1407, ISBN: 0-7803-0614-7, XP010103946 *
BERENJI ET AL: "Competition and collaboration among fuzzy reinforcement learning agents", FUZZY SYSTEMS PROCEEDINGS, 1998. IEEE WORLD CONGRESS ON COMPUTATIONAL INTELLIGENCE., THE 1998 IEEE INTERNATIONAL CONFERENCE ON ANCHORAGE, AK, USA 4-9 MAY 1998, NEW YORK, NY, USA,IEEE, US, PAGE(S) 622-627, ISBN: 0-7803-4863-X, XP010287575 *
BERENJI ET AL: "Fuzzy Q-learning for generalization of reinforcement learning", FUZZY SYSTEMS, 1996., PROCEEDINGS OF THE FIFTH IEEE INTERNATIONAL CONFERENCE ON NEW ORLEANS, LA, USA 8-11 SEPT. 1996, NEW YORK, NY, USA,IEEE, US, PAGE(S) 2208-2214, ISBN: 0-7803-3645-3, XP010195919 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109975800A (zh) * 2019-04-01 2019-07-05 中国电子科技集团公司信息科学研究院 组网雷达资源管控方法及装置、计算机可读存储介质
CN109975800B (zh) * 2019-04-01 2020-12-29 中国电子科技集团公司信息科学研究院 组网雷达资源管控方法及装置、计算机可读存储介质

Also Published As

Publication number Publication date
DE10021929A1 (de) 2001-11-15
WO2001086359A2 (de) 2001-11-15

Similar Documents

Publication Publication Date Title
Su et al. Energy-efficient operation by cooperative control among trains: A multi-agent reinforcement learning approach
GB2363211B (en) Adaptiver predictive model in a process control system
WO2001096076A3 (en) System and method for tuning a raw mix proportioning controller
WO2001086359A3 (de) Fuzzy-steuerung mit reinforcement-lernverfahren
GB2394313B (en) Integrated model predictive control and optimization within a process control system
GB2432683B (en) Integrated model predictive control and optimization within a process control system
WO2001073529A3 (en) Method and apparatus to implement the acpi (advanced configuration and power interface) c3 state in a rdram based system
WO2002057858A3 (en) Method and device for motion control
CA2157111A1 (en) Loop Powered Process Control Transmitter
WO2003085798A3 (en) Energy management system
HK1049549A1 (zh) 燃料處理系統操作的控制系統及方法
WO1997012508A3 (en) Transforming and manipulating program object code
AU3141600A (en) Method and device for optimising process management and process control in an arrangement for producing farinaceous products
WO2006135392A3 (en) Method and system for scr optimization
DE60141195D1 (de) Verfahren zur Steuerung eines Fahrzeuggenerators, externes Steuergerät und Vorrichtung zur Steuerung von Fahrzeugenergieerzeugung
DE50105536D1 (de) Fluidtechnisches system mit sicherheitsfunktion
FR2818342B1 (fr) Procede de reglage de la position d'un actionneur d'embrayage
CA2304840A1 (en) Reflection line control
Wu et al. Intelligent control based on description of plant characteristic model
WO2003058653A3 (en) System and method for coordinated control of a switched power capacitor with an integrated resonance protection system
DE60021647D1 (de) Verfahren zur Sendeleistungsregelung mit geschlossenem Regelkreis unter Verwendung eines veränderlichen Aktualisierungsbetrags
WO2004055609A3 (de) Verfahren und vorrichtung zur steuerung und verfahren zum einrichten eines steuerungssystems
WO2005089234A3 (en) Accelerating the discovery of effective photonic reagents
AU6986700A (en) Driving mode for optimizing energy and time in the manner in which a vehicle or train is driven
HK1060777A1 (en) Constraint and limit feasibility handling in a process control system optimizer

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): CN JP US

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
AK Designated states

Kind code of ref document: A3

Designated state(s): CN JP US

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP