Gallery2:Test Matrix - Gallery Codex
Personal tools

Gallery2:Test Matrix

From Gallery Codex

Revision as of 10:35, 12 July 2006 by Zimzat (Talk | contribs) (Category + Redundant Header)

G2 is currently supported in the following environments:

  • Operating systems: Unix, Windows
  • VM: PHP 4.1+ (4.3+ in current svn)
  • Database: Postgres 7.x/8.x, MySQL 3.x/4.x/5.x, Oracle 9i/10g, DB2 V8.2


Unit Tests

In order to fill this test matrix, please create an empty G2 installation and activate every module. We have ffmpeg, imagemagick, netpbm binaries for almost every platform and can help you achieve this goal. Then run all the unit tests and record your findings here along with the date. We will use this to keep track of quality issues as we approach our release milestones. If there's already a line for your configuration with a different owner you can update the line with your data and add yourself to the owner column.


Current

Web Server PHP Version Database Platform Locking Language Owner # Tests # Failed Date Notes
Apache 2.0.55 PHP 5.1.2 MS SQL Server 2005 Express Edition Windows XP Database en birdman 2254 11 7/6/2006 [2][3][4][5][6]
Apache 2.0.55 PHP 5.1.4 MySQL 5.0.18 (trans) MS Windows Database de valiant 2230 1 5/13/2006 [1][2]
Apache 2.0.55 PHP-CGI 5.1.4 MySQL 5.0.18 (trans) Debian sarge Database zh mindless 2248 1 5/8/2006 [1]
Apache 2.0.55 PHP-CGI 5.1.4 MySQL 5.0.18 (mysqli) Debian sarge Database en mindless 2248 1 5/8/2006 [1]
Apache 2.0.55 PHP-CGI 4.3.0 MySQL 5.0.18 (non-trans) Debian sarge File en mindless 2267 1 5/17/2006 [1]
Apache 2.0.55 PHP 4.4.2-1 MySQL 5.0.18 (trans) Debian sarge File tr mindless 2267 1 5/17/2006 [1]
Apache 2.2.2 PHP 5.1.4 MySQL 5.0.21 (trans) FreeBSD 6.1-STABLE File en Edgeman 2250 1 5/11/2006 [1]

[1]: # testimportkoi_8 (this failure just shows that UTF 8 databases can store more characters than non-utf8 databases. don't adjust the unit test, rather keep it as a reminder that bug 1382037 should be fixed)

         * custom field values 
           Mismatch At: [ 464747 Description] Если звезды зажигают ночью - значит это кому-нибудь надо. Если кто-то выстасвляет фотографии - это ведь неспроста! Может, в этом великая и сер !== Если звезды зажигают ночью - значит это кому-нибудь надо. Если кто-то выстасвляет фотографии - это ведь неспроста! Может, в этом великая и сермяжная правда жизни.
array (
 464747 => 
 array (
   'Description' => 'Если звезды зажигают ночью - значит это кому-нибудь надо. Если кто-то выстасвляет фотографии - это ведь неспроста! Может, в этом великая и сер',
 ),
)
              type:array
array (
 464747 => 
 array (
   'Description' => 'Если звезды зажигают ночью - значит это кому-нибудь надо. Если кто-то выстасвляет фотографии - это ведь неспроста! Может, в этом великая и сермяжная правда жизни.',
 ),
)
              type:array

[2]: no getid3 on windows

[3]: In addition to KOI_8, I have the same multi-byte problem with no_NO and fr_FR. testConvertHtmlToBbcode also fails if run with KOI_8, but runs clean in isolation. (Accounts for 4 failures.)

[4]: *.testCodeAudit fail (skipped, actually), these should only be run in SVN builds. (Accounts for 5 failures that are not really failures.)

[5]: StorageTest.testSqlInjectionWithNullCharacter, MSSQL complains: SQL Syntax Error.

[6]: IndexDotPhpTest.testHttpRedirect (known problem)

Old

Web Server PHP Version Database Platform Locking Language Owner # Tests # Failed Date Notes
Apache 2.0.55 PHP 5.1.2-1 MySQL 5.0.18 Debian testing File en_US,es_AR,es_MX, fr,pl,dh Brent Cordis 20 0 04/04/2006 Runing CVS Version
Apache 2.0.55 PHP 5.1.2 Oracle 10g XE Windows XP File en Larry Menard 0 0 03/19/2006 installed, no tests run yet
Apache 2.2.0 PHP 5.1.2 DB2 V8 FP10 SuSE SLES9 File en Larry Menard 1179 13 03/09/2006 [18], [19]
Apache 2.0.55 PHP 5.1.2 DB2 V8 FP10 Windows XP File en Larry Menard 2175 4 03/09/2006 [2], [3], [16], [17], [18]
Apache 2.0.54 PHP 5.0.5 MySQL 4.1.14-nt Windows XP Database en bharat 2168 3 03/19/2006 [1], [2], [3]
Apache 1.3.33 PHP 4.3.10 PostgreSQL 7.4.6 FreeBSD File en bharat 2213 NONE 03/19/2006
Apache 1.3.33 PHP 4.3.10 PostgreSQL 7.4.6 FreeBSD Database en bharat 2213 NONE 03/19/2006
Apache 1.3.33 PHP 4.3.10 MySQL 3.23.58-log FreeBSD File en bharat 2213 NONE 03/19/2006
Apache 1.3.33 PHP 4.3.10 MySQL 3.23.58-log FreeBSD Database en bharat 2213 NONE 03/19/2006
Apache 2.0.55 PHP 5.1.2 MySQL 5.0.18 (trans) Windows XP Database de valiant 2175 2 03/12/2006 [2] , [3]
Apache 2.0.55 PHP 5.1.2 PostgreSQL 8.1.2 Windows XP Database de valiant 2179 1 03/20/2006 [2], [3]
Apache 2.0.55 PHP-CGI 4.1.0 MySQL 5.0.18 (non-trans) Debian sarge File en mindless 2210 8 3/7/2006 [4]
5 rewrite/pathinfo tests and 1 core test failed with "stat failed" PHP errors; testtranslatecharset
Apache 1.3.34 PHP 4.4.2 MySQL 4.1.16 (trans) FreeBSD 4.11 File en_GB mindless 2214 4 3/20/2006 [3]; 3 other tests fail due to bad route config on this server (fsockopen can't connect to webserver on same host)
Apache 2.0.52 PHP 4.4.1 MySQL 4.1.12a Gentoo File de valiant 2172 5 02/10/2006 [3], [8], [9], [10], [11]
Apache 2.0.55 PHP 5.1.2 MySQL 5.0.18 (trans) Windows XP Database tr valiant 2149 1 02/14/2006 [2] , [3]

[1]: no gettext, which means no multilang module

[2]: no getid3 on windows

[3]: # tetestimportkoi_8 (this failure just shows that UTF 8 databases can store more characters than non-utf8 databases. don't adjust the unit test, rather keep it as a reminder that bug 1382037 should be fixed)

         * custom field values 
           Mismatch At: [ 667 Description] Если звезды зажигают ночью - значит это кому-нибудь надо. Если кто-то выстасвляет фотографии - это ведь неспроста! Может, в этом великая и сер !== Если звезды зажигают ночью - значит это кому-нибудь надо. Если кто-то выстасвляет фотографии - это ведь неспроста! Может, в этом великая и сермяжная правда жизни.
array (
 667 => 
 array (
   'Description' => 'Если звезды зажигают ночью - значит это кому-нибудь надо. Если кто-то выстасвляет фотографии - это ведь неспроста! Может, в этом великая и сер',
 ),
)
              type:array
array (
 667 => 
 array (
   'Description' => 'Если звезды зажигают ночью - значит это кому-нибудь надо. Если кто-то выстасвляет фотографии - это ведь неспроста! Может, в этом великая и сермяжная правда жизни.',
 ),
)
              type:array

[4]: Getid3HelperTest.testGetid3ArchiveDataTgz fails, because !function_exists('gzinflate')

[6]: # Getid3DescriptionOptionTest.testCreateDescription: fails, quick debugging showed that getid3 detects no tags from the test mp3 on windows

   * title 0 
     Mismatch At: [] 8000Hz sine !== original title 0
     8000Hz sine   type:string
     original title 0   type:string

[7]: # AdminDcrawControllerTest.testSaveFailedTests: fix ready, committing after RC1. it's just a bug in the unit test: http://gallery.pastebin.com/548764

   * Error count: 1 Remaining requests: Array ( )

[8]: # getid3helpertest.testgetid3dataflac

   * value is 0,744799999986

[9]: # getid3helpertest.testgetid3dataquicktime

   * value 1

[10]: # rssrendertest.testrsssimplerenderalbum

   * Mismatch At: [ 0] Header: Content-type: text/xml; charset=UTF-8 !== <rss version="2.0"> 

[11]: # rssrendertest.testrsssimplerenderphotos

   * Mismatch At: [ 0] Header: Content-type: text/xml; charset=UTF-8 !== <rss version="2.0">

[13]: # SessionTest.testLoadSessionDataExpiredSession

   * creation time lifetime 
     Mismatch At: [] 1139984346 !== 1139984347
     1139984346   type:integer
     1139984347   type:integer
   * creation time lifetime 
     Mismatch At: [] 1139984346 !== 1139984347
     1139984346   type:integer
     1139984347   type:integer

[16]: The run ends prematurely after test 516. Resumed the run with ":517-" and the run completes. See:

         * http://cpe0013102da23b-cm0f0079804905.cpe.net.cable.rogers.com/misc/Gallery2/Gallery%20Unit%20Tests%20-%20rc2%20-%20part1.htm
         * http://cpe0013102da23b-cm0f0079804905.cpe.net.cable.rogers.com/misc/Gallery2/Gallery%20Unit%20Tests%20-%20rc2%20-%20part2.htm

[17]: In addition to KOI_8, I have the same multi-byte problem with no_NO and fr_FR. testConvertHtmlToBbcode also fails if run with KOI_8, but runs clean in isolation.

[18]: testHttpRedirect: "Set-Cookie header not set" (x3)

[19]: On my Linux env I have not installed anything but the core module. I suspect that the majority of these failures are a result of some modules not being installed:

       * all "search" tests
       * testHttpRedirect (see note [18])
       * testRecreateResizesForSmallPhoto
       * testAddSmallPhotoAlbum
       * testAddNonViewableImage
       * testAddNonViewableImageWithPreExistingPreferred
       * testSessionCookieHeaderAndPersistence
       * testIsPersistentSessionAllowedForRequest
       * http://cpe0013102da23b-cm0f0079804905.cpe.net.cable.rogers.com/misc/Gallery2/Gallery%20Unit%20Tests%20-%20rc2%20-%20Linux.html

Upgrades

The upgrade path is usually tested from the last public release to the new release. Keep old tested upgrade paths in the list and add upgrades to newer versions at the top of the list. From time to time, upgrade paths from older versions (alpha 4 = core version 0.8.4 or newer) to the current release should also be performed.


Current

New Core Version New Release Name Old Core Version Old Release Name Web Server PHP Version Database Platform Owner Date Notes
1.1.0.1 2.1.1 1.0.0.4 2.0.4 Apache 1.3.33 PHP 4.3.10 Postgres 7.x FreeBSD 4.8 bharat 4/6/2006 Had to upgrade the imagemagick module by hand (probably because I have a vulnerable binary). Otherwise, smooth sailing.
1.1.0.1 2.1.1 1.0.0.4 2.0.4 Apache 2.0.55 PHP 5.1.2 Postgres 8.1.3 Windows XP Larry Menard 13/04/2006 Couldn't configure URL Rewrite in 2.0.4. (Apache conf. prob at my end?), works fine in 2.1.1
1.1.0.1 2.1.1 1.0.0.4 2.0.4 Apache 2.0.54 PHP 5.0.4 MySQL 4.1.13-nt Windows XP bharat 4/14/2006 Worked fine.
1.1.0.1 2.1.1 1.0.0.3 2.0.3 Apache 2.0.5 PHP 4.4.2-1 MySQL 5.0.18 Debian mindless 13-Apr-2006 Upgrade modules request stopped; tried again and finished OK
1.1.0.1 2.1.1 1.0.0.4 2.0.4 Apache 2.0.55 PHP 5.1.2 Oracle 10g XE Windows XP Larry Menard 04/06/2006 1) Frequent NLS probs (req. server restart), 2) Couldn't configure URL Rewrite in 2.0.4. (Apache conf. prob at my end?), works fine in 2.1.1
1.0.34 2.1-rc-2a+ 1.0.0.1 2.0.1 Apache/1.3.33 (Unix) PHP/4.3.10 mysql 3.23.58-log Debian Linux bharat 03/20/2006 [OK]
1.0.34 2.1-rc-2a+ 0.9.35 2.0-rc-1+ Apache/1.3.31 (Unix) PHP/4.3.7 mysql 4.1.9-standard Slackware Linux volksport 03/20/2006 [OK]
1.0.34 2.1-RC-2a+ 0.8.4 2.0 Alpha-4 Apache 1.3.34 PHP 4.4.2 MySQL 4.1.16 FreeBSD 4.11 mindless 3/20/2006 [Good enough] had to go to upgrade url directly (session errors from main.php), and hit known CRC mismatch in toolkit upgrades from alpha-4 to beta-1 days
1.0.34 2.1-RC-2a+ 1.0.0 2.0.0 Apache 2.0.54 PHP 5.1.2 Postgres 8 Windows XP valiant 03/17/2006 [OK] (required generate-sql changes)

Old

New Core Version New Release Name Old Core Version Old Release Name Web Server PHP Version Database Platform Owner Date Notes
1.0.28 2.1 RC1a+ 1.0.0.2 2.0.2 Apache 2.0.55 PHP 4.4.0 MySQL 4.1.14 Gentoo fryfrog 02/15/2006 [OK]
1.0.27 2.1 RC1 0.9.10 G 2 Beta-2 Apache 2.0.52 PHP-CGI 4.4.1 MySQL 4.1.10 Gentoo valiant 02/10/2006 [OK]
1.0.25 2.1-soon 0.9.10 G 2 Beta-2 Apache 2.0.52 PHP 4.4.0 PostgreSQL 8.0.1 Gentoo valiant 02/09/2006 rewrite upgrade failed
1.0.16 2.1.0- 1.0.0 G 2.0 Apache 2.0.52 PHP 4.4.0 PostgreSQL 8.0.1 Gentoo valiant 01/10/2006 [OK]
1.0.18 2.1.0- 1.0.3 2.0.1+ Apache 2.0.54 PHP-CGI 4.4.0 MySQL 4.1.12a Windows XP valiant 01/13/2006 [OK]
advertisements