Advanced search ?

Object

Download

Title: Benchmarking Procedures for Continuous Optimization Algorithms, Journal of Telecommunications and Information Technology, 2011, nr 4

Creator:

Arabas, Jarosław ; Opara, Karol

Date:

2011, nr 4

Resource Type:

artykuł

Description:

Reliable comparison of optimization algorithms requires the use of specialized benchmarking procedures. This paper highlights motivations which influence their structure, discusses evaluation criteria of algorithms, typical ways of presenting and interpreting results as well as related statistical procedures. Discussions are based on examples from CEC and BBOB benchmarks. Moreover, attention is drawn to these features of comparison procedures, which make them susceptible to manipulation. In particular, novel application of the weak axiom of revealed preferences to the field of benchmarking shows why it may be misleading to assess algorithms on basis of their ranks for each of test problems. Additionally, an idea is presented of developing massively parallel implementation of benchmarks. Not only would this provide faster computation but also open the door to improving reliability of benchmarking procedures and promoting research into parallel implementations of optimization algorithms.

Publisher:

Instytut Łączności - Państwowy Instytut Badawczy, Warszawa

Format:

application/pdf

Resource Identifier:

oai:bc.itl.waw.pl:1202 ; ISSN 1509-4553, on-line: ISSN 1899-8852

DOI:

10.26636/jtit.2011.4.1180

ISSN:

1509-4553

eISSN:

1899-8852

Source:

Journal of Telecommunications and Information Technology

Language:

ang

Rights Management:

Biblioteka Naukowa Instytutu Łączności

Subject and keywords:

comparing optimization algorithms black-box optimization evaluation criteria parallel computing

Object collections:

Last modified:

Feb 25, 2026

In our library since:

May 28, 2013

Number of object content hits:

154

All available object's versions:

https://bc.itl.waw.pl/publication/1507

Show description in RDF format:

RDF

Show description in OAI-PMH format:

OAI-PMH

Edition name Date
Opara, Karol; Arabas, Jarosław, 2011, nr 4, Benchmarking Procedures for Continuous Optimization Algorithms, Journal of Telecommunications and Information Technology, 2011, nr 4 Feb 25, 2026

Objects Similar
Gradient-Based Algorithms in the Brachistochrone Problem Having a Black-Box Represented Mathematical Model , Journal of Telecommunications and Information Technology, 2014, nr 1

Dębski, Roman

2014, nr 1
artykuł
Comparative Study of PSO and CMA-ES Algorithms on Black-box Optimization Benchmarks, Journal of Telecommunications and Information Technology, 2018, nr 4

Szynkiewicz, Paweł

2018, nr 4
artykuł
IP-KRYPTO cipher machine for military use, Journal of Telecommunications and Information Technology, 2004, nr 4

Łabuzek, Grzegorz Borowski, Mariusz

2004, nr 4
artykuł
Mobile Cloud for Parallel and Distributed Green Computing, Journal of Telecommunications and Information Technology, 2017, nr 4

Byrski, Aleksander Siwik, Leszek Kala, Dawid Godzik, Mateusz Turek, Wojciech Kisiel-Dorohinicki, Marek

2017, nr 4
artykuł
The Analysis of OpenStack Cloud Computing Platform: Features and Performance, Journal of Telecommunications and Information Technology, 2015, nr 3

Grzonka, Daniel

2015, nr 3
artykuł
A Novel GPU-Enabled Simulator for Large Scale Spiking Neural Networks, Journal of Telecommunications and Information Technology, 2016, nr 2

Szynkiewicz, Paweł

2016, nr 2
artykuł
A Hybrid CPU/GPU Cluster for Encryption and Decryption of Large Amounts of Data, Journal of Telecommunications and Information Technology, 2012, nr 3

Niewiadomska-Szynkiewicz, Ewa Marks, Michał Jantura, Jarosław Podbielski, Mikołaj

2012, nr 3
artykuł
Evolutionary Computation for Global Optimization – Current Trends, Journal of Telecommunications and Information Technology, 2011, nr 4

Arabas, Jarosław

2011, nr 4
artykuł
More
×

Citation

Citation style:

Contact details

Address

Instytut Łączności – Państwowy Instytut Badawczy ul. Szachowa 1 04-894 Warszawa

Phone

(+48) 5128 696

E-Mail

biblioteka@il-pib.pl

Visit us!

This page uses 'cookies'. More information