Phoronix Test Suite
 | |
 Phoronix Test Suite 2.0.0 running on GNU/Linux | |
| Original author(s) | Phoronix Media |
|---|---|
| Developer(s) | Michael Larabel, Matthew Tippett |
| Initial release | April 2008 |
| Stable release | 8.6.0[1] / February 5, 2019 (2019-02-05) |
| Preview release | 8.8.0[2] |
| Written in | PHP |
| Operating system | Linux, FreeBSD, OpenBSD, NetBSD, OpenSolaris, Mac OS X, Windows |
| Size | 703 kB (base program) |
| Available in | English |
| Type | Benchmark |
| License | GNU General Public License v3 |
| Website | phoronix-test-suite.com |
Phoronix Test Suite (PTS) is a free, open-source benchmark software for Linux and other operating systems which is developed by Phoronix Media with cooperation from an undisclosed number of hardware and software vendors.
The Phoronix Test Suite has been endorsed by sites such as Linux.com,[3]LinuxPlanet[4] and has been called "the best benchmarking platform" by Softpedia.[5] The Phoronix Test Suite is also used by Tom's Hardware,[6]ASELabs[7] and other review sites.
Contents
1 Features
2 Phoromatic
3 Phoromatic Tracker
4 PTS Desktop Live [No longer available]
5 Phodevi
6 PCQS
7 Release history
8 Criticism
9 See also
10 References
11 External links
Features
- Supports over 220 test profiles and over 60 test suites;
- Uses an XML-based testing architecture. Tests include MEncoder, FFmpeg and lm sensors along with OpenGL games such as Doom 3, Nexuiz, and Enemy Territory: Quake Wars, and many others;[8]
- Contains a feature called PTS Global where users are able to upload their test results and system information for sharing. Then through executing a single command, other users can compare their test results to a selected system in an easy-comparison mode;[9]
- Allow report benchmark results to the Phoronix Global online database;
- Allow compare results side-by-side;
- Is extensible and new tests can be added easily;
- Can do anonymous usage reporting;
- Can do automated Git bisecting on a performance basis to find performance regressions. It features statistical significance verification.
Phoromatic
Phoromatic is an web-based remote test management system for the Phoronix Test Suite. It does automatic scheduling of tests. It is aimed at the enterprise. It can manage multiple test nodes simultaneously within a test farm or distributed environment.
Phoromatic Tracker
Phoromatic Tracker is an extension of Phoromatic that provides a public interface into test farms.[10] Currently their reference implementations autonomously monitor the performance of the Linux kernel on a daily basis,[11]Fedora Rawhide[12] and Ubuntu.[13]
PTS Desktop Live [No longer available]
| Developer | Phoronix Media |
|---|---|
| OS family | Unix-like |
| Working state | Not working. No longer available. |
| Initial release | August 4, 2009 |
| Latest release | 2010.1 "Anzhofen" / No longer available |
| Platforms | x86-64 |
Kernel type | Monolithic (Linux) |
| Userland | GNU |
| Default user interface | GNOME |
| Official website | pts-desktop-live.com No longer links to a downloadable live disk. |
PTS Desktop Live was a stripped down x86-64 Linux distribution, which included Phoronix Test Suite 2.4. It was designed for testing/benchmarking computers from a LiveDVD / LiveUSB environment.[14]
Phodevi
| Original author(s) | Phoronix Media |
|---|---|
| Written in | PHP |
| Type | Library |
| License | GNU General Public License v3 |
| Website | Phorogit |
Phodevi (Phoronix Device Interface) is a library that provides a clean, stable, platform-independent API for accessing software and hardware information.
PCQS
Phoronix Certification & Qualification Suite (PCQS) is a reference specification for the Phoronix Test Suite.
Release history
| Version | Codename | Date |
|---|---|---|
| 1.0 | Trondheim | 5 June 2008 |
| 1.2 | Malvik | 3 September 2008 |
| 1.4 | Orkdal | 3 November 2008 |
| 1.6 | Tydal | 20 January 2009 |
| 1.8 | Selbu | 6 April 2009 |
| 2.0 | Sandtorg | 4 August 2009 |
| 2.2 | Bardu | 16 November 2009 |
| 2.4 | Lenvik | 2 February 2010 |
| 2.6 | Lyngen | 24 May 2010 |
| 2.8 | Torsken | 31 August 2010 |
| 3.0 | Iveland | 26 February 2011 |
| 3.2 | Grimstad | 15 June 2011 |
| 3.4 | Lillesand | 8 September 2011 |
| 3.6 | Arendal | 13 December 2011 |
| 3.8 | Bygland | 19 March 2012 |
| 4.0 | Suldal | 23 July 2012 |
| 4.2 | Randaberg | 20 December 2012 |
| 4.4 | Forsand | 20 February 2013 |
| 4.6 | Utsira | 21 May 2013 |
| 4.8 | Sokndal | 13 August 2013 |
| 5.0 | Plavsk | 12 March 2014 |
| 5.2 | Khanino | 5 June 2014 |
| 5.4 | Lipki | 9 December 2014 |
| 5.6 | Dedilovo | 24 March 2015 |
| 6.0 | Hammerfest | 6 November 2015 |
| 6.2 | Gamvik | 16 February 2016 |
| 6.4 | Hasvik | 2 June 2016 |
| 7.0 | Ringsaker | 7 March 2017 |
| 8.0 | Aremark | 5 June 2018 |
On 5 June 2008, Phoronix Test Suite 1.0 was released under the codename Trondheim.[15] This 1.0 release was made up of 57 test profiles and 23 test suites.[16]
On 3 September 2008, Phoronix Test Suite 1.2 was released with support for the OpenSolaris operating system[17] and a module framework accompanied by tests focusing upon new areas[18] and many new test profiles.
Phoronix Test Suite 1.8 includes a graphical user interface (GUI) using GTK+ written using the PHP-GTK bindings.
3.4 includes MATISK benchmarking module and initial support for the GNU Hurd.
Criticism
Phoronix uses Phoronix Test Suite to compare performance of different operating systems – Linux distributions, OpenSolaris and FreeBSD. Critics of Phoronix Test Suite argue that some of the third party tests are unfair towards some platforms.[citation needed]
The compiler used in building the source based tests have a large impact on the results. Depending on the reader's point of view this is seen as a detriment to the value of the results. However other readers may see that as a realistic expectation of performance for that particular system with that operating system.
PTS 3.8 reports compiler options and compiler differences between test runs.[citation needed]
See also
- Inquisitor
- Stresslinux
References
^ "Release History", Phoronix Test Suite.mw-parser-output cite.citation{font-style:inherit}.mw-parser-output .citation q{quotes:"""""""'""'"}.mw-parser-output .citation .cs1-lock-free a{background:url("//upload.wikimedia.org/wikipedia/commons/thumb/6/65/Lock-green.svg/9px-Lock-green.svg.png")no-repeat;background-position:right .1em center}.mw-parser-output .citation .cs1-lock-limited a,.mw-parser-output .citation .cs1-lock-registration a{background:url("//upload.wikimedia.org/wikipedia/commons/thumb/d/d6/Lock-gray-alt-2.svg/9px-Lock-gray-alt-2.svg.png")no-repeat;background-position:right .1em center}.mw-parser-output .citation .cs1-lock-subscription a{background:url("//upload.wikimedia.org/wikipedia/commons/thumb/a/aa/Lock-red-alt-2.svg/9px-Lock-red-alt-2.svg.png")no-repeat;background-position:right .1em center}.mw-parser-output .cs1-subscription,.mw-parser-output .cs1-registration{color:#555}.mw-parser-output .cs1-subscription span,.mw-parser-output .cs1-registration span{border-bottom:1px dotted;cursor:help}.mw-parser-output .cs1-ws-icon a{background:url("//upload.wikimedia.org/wikipedia/commons/thumb/4/4c/Wikisource-logo.svg/12px-Wikisource-logo.svg.png")no-repeat;background-position:right .1em center}.mw-parser-output code.cs1-code{color:inherit;background:inherit;border:inherit;padding:inherit}.mw-parser-output .cs1-hidden-error{display:none;font-size:100%}.mw-parser-output .cs1-visible-error{font-size:100%}.mw-parser-output .cs1-maint{display:none;color:#33aa33;margin-left:0.3em}.mw-parser-output .cs1-subscription,.mw-parser-output .cs1-registration,.mw-parser-output .cs1-format{font-size:95%}.mw-parser-output .cs1-kern-left,.mw-parser-output .cs1-kern-wl-left{padding-left:0.2em}.mw-parser-output .cs1-kern-right,.mw-parser-output .cs1-kern-wl-right{padding-right:0.2em}.
^ "Release History", Phoronix Test Suite.
^ "Phoronix Test Suite brings Linux benchmarking to the desktop", Linux.com.
^ "Benchmarking Linux With the Phoronix Test Suite — Worth Taking a Look", LinuxPlanet (reports).
^ The Best Benchmarking Platform: Phoronix Test Suite – Linux-based testing platform for software and hardware validation!, Softpedia.
^ AMD, Intel CPU Charts, tetberichte (in German), Tom's Hardware.
^ ASE labs.
^ "Suites", Phoronix Test Suite.
^ "Global Database", Phoronix Test Suite.
^ Phoromatic Tracker Launches To Monitor Linux Performance, Phoronix.
^ "Kernel Performance Tracker", Phoromatic.
^ "Fedora Rawhide Performance Tracker", Phoromatic.
^ "Ubuntu Performance Tracker", Phoromatic.
^ Announcing PTS Desktop Live 2009.3 "Gernlinden", Phoronix.
^ "Demystifying Codenames: Trondheim", Phoronix Test Suite, Phoronix.
^ News (press release), Yahoo!
[dead link]
^ "Phoronix Test Suite 1.2 To Support OpenSolaris", trondheim-pts (mailing list), Jul 2008.
^ "Phoronix Test Suite brings Linux benchmarking to the desktop", Linux.com.
External links
Official website
- Documentation
- Phoronix Global
- Phoromatic
- PTS Linux Live
- Git repository
- OpenBenchmarking.org
