Gallery2:Test Matrix - Gallery Codex
Personal tools

Gallery2:Test Matrix

From Gallery Codex

Revision as of 05:17, 19 December 2006 by H0bbel (Talk | contribs) (Current)

G2 is currently supported in the following environments:

  • Operating systems: Unix, Windows
  • VM: PHP 4.1+ (4.3+ in current svn)
  • Database: Postgres 7.x/8.x, MySQL 3.x/4.x/5.x, Oracle 9i/10g, DB2 V8.2 & 9, MS SQL Server 2005 Express Edition


Unit Tests

In order to fill this test matrix, please create an empty G2 installation and activate every module. We have ffmpeg, imagemagick, netpbm binaries for almost every platform and can help you achieve this goal. Then run all the unit tests and record your findings here along with the date. We will use this to keep track of quality issues as we approach our release milestones. If there's already a line for your configuration with a different owner you can update the line with your data and add yourself to the owner column.


Current

Web Server PHP Version Database Platform Locking Language Owner # Tests # Failed Date Notes
Apache 2.2.3 PHP 5.2.0-7 MySQL 5.0.27 (trans) flock en_US h0bbel 2637 4 2006-12-19 -digibug [14]
Apache/2.0.55 PHP 4.4.4 MySQL 5.0.18 (non-trans) Windows XP database de valiant 2591 0 2006-12-18 -getid3 -multilang (no gettext)
Apache 2.0.55 PHP 5.1.6 Oracle 10.2.0.1 Gentoo Linux File de valiant 2636 0 2006-12-16
Apache/2.0.55 PHP 5.2.0 PostgreSQL 8.1.4 Windows XP Database de valiant 2600 0 2006-12-16 -getid3
IIS 5.1 PHP 5.2.0 (ISAPI) MySQL 4.1.12a-nt (trans) Windows XP Database fr valiant 2600 0 2006-12-16 -getid3
Apache 1.3.33 PHP 4.3.10 mysqlt 3.23.58-log FreeBSD database en_US bharat 2619 0 2006-12-11
Apache 2.0.55 PHP 4.4.4/4.4.2 MySQL 5.0.18 (trans) Windows XP Database de valiant 2451 0 2006-11-05 -getid3 no mbstring
Apache 2.2.3 PHP 5.2.0 IBM DB2 V8.2.2 Windows XP Database en birdman 2575 7 2006-12-18 -getid3 -WebDAV [2][3][4][5][6][7][8]
Apache 2.2.3 PHP 5.2.0 IBM DB2 9 Express C Windows XP Database en birdman 2575 1 2006-12-15 -getid3 -WebDAV [2]
Apache 2.2.3 PHP 5.2.0 RC6 MS SQL Server 2005 Express Edition Windows XP Database en birdman 2558 3 2006-12-02 [1] [12] [16]
Apache 2.0.55 PHP-CGI 5.1.5 MySQL 5.0.22 (mysqli) Debian sarge Database zh mindless 2652 0 2006-12-07 r15407 +notification +cmmigrate [17]
Apache 2.0.55 PHP-CGI 4.3.0 MySQL 5.0.22 (non-trans) Debian sarge Database he mindless 2652 0 2006-12-08 r15412 +notification +cmmigrate
Apache 2.0.55 PHP 4.4.2-1.1 MySQL 5.0.22 (trans) Debian sarge File tr mindless 2652 0 2006-12-08 r15415 +notification +cmmigrate
Apache 2.0.55 PHP-CGI 5.1.5 PostgreSQL 7.4.13 Debian sarge File fr mindless 2613 0 2006-12-08 r15418

[1]: testimportkoi_8 failed ((should be fixed in r15011)

[2]: DataCacheTest.testCleanPageDataCache: "db2_fetch_array() [function.db2-fetch-array]: Cannot Determine LOB Size". Runs clean by itself.

[3]: migrate.ConfirmImportControllerTest.testImportno_NO: SQL0433N Value "Western European (ISO) Hello World Norwegian Norsk Hallo" is too long. SQLSTATE=22001 SQLCODE=-433

[4]: migrate.ConfirmImportControllerTest.testImportfr_FR: SQL0433N Value "CHARSET=8859-1, fr-Fr, Hello World, french, français, Bon" is too long. SQLSTATE=22001 SQLCODE=-433

[5]: migrate.ConfirmImportControllerTest.testImportKOI_8: SQL0433N Value "???? ?????? ????" is too long. SQLSTATE=22001 SQLCODE=-433

[6]: migrate.ConfirmImportControllerTest.testConvertHtmlToBbcode: There are unreleased locks! (Runs clean by itself, only fails if run with KOI_8.)

[7]: core.StorageTest.testEncodeDecodeBlob: blob data was altered in encode -> insert -> select -> decode

[8]: core.StorageTest.testTruncateString: SQL0433N Value "???????????????" is too long. SQLSTATE=22001 SQLCODE=-433

[12]: StorageTest.testTruncateString fails with SQL0433N Value "???????????????" is too long.

[13]: No code audit tests (accounts for 7 failed test) since Tortoise SVN changed the .svn/entries file format in v1.4

[14]: Missing german locale accounted for 4 failed tests

[15]: Codeaudit failures due to Webdav

[16]: WebdavTest.testLockUnlock fails with DB locking (passes with flock file based locking)

[17]: filter webdav.*lock fails for 2 of the 3 tests (mysql lock timeout on WebDavLockMap table).. changed table from InnoDB to MyISAM as this went away

[18]: photoaccess.PrintPhotoControllerTest failures, details on http://tools.gallery2.org/pastebin/1247 (fixed in r15467)

Old

Web Server PHP Version Database Platform Locking Language Owner # Tests # Failed Date Notes
Apache 2.0.55 PHP 5.1.6 PostgreSQL 8.0.1 Windows XP Database de valiant 2439 0 10/28/2006 -getid3
Apache 2.0.54 PHP 5.1.6 MySQL 5.0.14a (trans) Debian sarge File en valiant 2398 1 9/29/2006 [1]
Apache 2.2.2 PHP 5.1.4 MySQL 5.0.21 (trans) FreeBSD 6.1-STABLE File en Edgeman 2250 1 5/11/2006 [1]
Apache 2.0.55 PHP 5.1.4 IBM DB2 9 Express C Windows XP Database en birdman 2279 11 7/29/2006 -getid3[3][4][5][6][7]
Apache 1.3.33 PHP 4.3.10 MySQL 3.23.58 FreeBSD 4.8 File en mindless 2392 0 9/20/2006
Apache 2.2.2 PHP 5.1.4 (with patches) MySQL 5.0.22 OpenSuse 10.2 factory (x86_64) Flock de Jens Tkotz 1908 2 8/08/2006
Apache 2.2.2 PHP 5.1.4 (with patches) IBM DB2/LINUXX8664 9.1.0 OpenSuse 10.2 factory (x86_64) Flock de Jens Tkotz 2218 5 8/08/2006
Apache 2.0.54 PHP 5.0.5 MySQL 4.1.14-nt Windows XP Database en bharat 2366 1 10/5/2006 [1]
Apache 2.0.55 PHP 5.1.4 Oracle 10g Windows XP Database en birdman 2299 27 08/04/2006 [10]
Apache 2.2.0 PHP 5.1.2 DB2 V8 FP10 SuSE SLES9 Database en birdman 1190 10 08/03/2006 [6] [9]

[1]: # testimportkoi_8 (this failure just shows that UTF 8 databases can store more characters than non-utf8 databases. don't adjust the unit test, rather keep it as a reminder that bug 1382037 should be fixed)

         * custom field values 
           Mismatch At: [ 464747 Description] Если звезды зажигают ночью - значит это кому-нибудь надо. Если кто-то выстасвляет фотографии - это ведь неспроста! Может, в этом великая и сер !== Если звезды зажигают ночью - значит это кому-нибудь надо. Если кто-то выстасвляет фотографии - это ведь неспроста! Может, в этом великая и сермяжная правда жизни.
array (
 464747 => 
 array (
   'Description' => 'Если звезды зажигают ночью - значит это кому-нибудь надо. Если кто-то выстасвляет фотографии - это ведь неспроста! Может, в этом великая и сер',
 ),
)
              type:array
array (
 464747 => 
 array (
   'Description' => 'Если звезды зажигают ночью - значит это кому-нибудь надо. Если кто-то выстасвляет фотографии - это ведь неспроста! Может, в этом великая и сермяжная правда жизни.',
 ),
)
              type:array

[3]: In addition to KOI_8, I have the same multi-byte problem with no_NO and fr_FR. testConvertHtmlToBbcode also fails if run with KOI_8, but runs clean in isolation. (Accounts for 4 failures.)

[4]: *.testCodeAudit fail (skipped, actually), these should only be run in SVN builds. (Accounts for 5 failures that are not really failures.)

[5]: StorageTest.testSqlInjectionWithNullCharacter, MSSQL complains: SQL Syntax Error.

[6]: IndexDotPhpTest.testHttpRedirect (known problem)

[7]: StorageTest.testEncodeDecodeBlob, "blob data was altered in encode -> insert -> select -> decode"

[9]: On my Linux env I have not installed anything but the core and search modules. I suspect that the majority of these failures are a result of some modules not being installed:

       * testHttpRedirect (see note [8])
       * testRecreateResizesForSmallPhoto
       * testAddSmallPhotoToAlbum
       * testSessionCookieHeaderAndPersistence
       * testIsPersistentSessionAllowedForRequest

[10]: First time I've ever run unit tests on Oracle. Results:

http://cpe0013102da23b-cm0f0079804905.cpe.net.cable.rogers.com/misc/gallery2/Dynamic%20Albums%20Verification/Windows%20-%20Oracle/Tests%200001%20-%200508.html

http://cpe0013102da23b-cm0f0079804905.cpe.net.cable.rogers.com/misc/gallery2/Dynamic%20Albums%20Verification/Windows%20-%20Oracle/Tests%200509%20-%202299.html

2.2 Browser Compatibility Testing

Browser rendering tests. In each box put name+[browser-version]+svnrev+comments.

Feature Firefox IE6 IE7 Opera Safari
AdminPlugins mindless r14884 OK
dmolavi FF2 r14907 OK
dmolavi r14907: silk iconpack has grey backgrounds (transparency not working) bharat r15090: everything looks fine. silk icons have transparency. bharat 9.02 r15298: Actions work, but tooltip screenshots are the full width of the screen. mindless r14887: works, but status msgs show at top of document, not top of visible area
ItemEditPhotoThumbnail bharat FF1 r15316 OK bharat r15316 OK mindless r15334 OK bharat 9.02 r15298: Works, but semi-transparency inside the selection box is missing mindless r14887 OK
Autocomplete

(installer,siteadmin)

dmolavi FF2 r14897 OK
mindless FF2 r15459 OK
dmolavi r14897 OK
bharat r15316 OK
mindless r15459 OK, though don't see green dotted-line until results shown
mindless r15459 OK bharat 9.02 r15298 OK
mindless 9.02 r15459 OK
Installer/upgrader, button rounded corners

(refactored in r15456)

mindless FF2 r15456 OK mindless r15456 OK mindless r15456 OK mindless 9.02 r15456 OK
Popup thumbnails

(itemmove, itemdelete, showallcomments)

bharat FF1 r15316 OK bharat r15316 OK mindless r15450: works in itemmove/delete but in ShowAllComments only shows for first thumbnail bharat 9.02 r15298: Popup thumbnails file in ShowAllComments but takes up full width of the screen in ItemMove and ItemDelete
Markup bar/color chooser bharat FF1 r15316 OK bharat r15316: Everything works, but color chooser popup appears behind date/time dropdowns on Edit Album page. IE6 bug mindless r15450 OK bharat 9.02 r15298 OK
Watermark

(siteadmin, useradmin, itemadd, itemedit)

bharat FF1 r15316 OK bharat r15316 OK bharat 9.02 r15298 OK
Ratings bharat FF1 r15316 OK bharat r15316 OK bharat 9.02 r15298 OK
FlashVideo
MP3Audio
MovVideo (quicktime) floridave FF2 Nov3 activeX issue quicktime fix
Matrix theme dmolavi FF2 r14627
bharat FF1 r15316 OK
dmolavi r14627
bharat r15316 OK
bharat 9.02 r15298 OK
Classic theme
Floatrix theme mindless 9.02 r14981 OK
Siriux theme
Carbon theme mindless FF2 r14981 OK mindless 9.02 r14981 OK
Hybrid theme mindless r15450 OK mindless r15450: some item titles extend beyond right edge of shaded background mindless 9.02 r14973: Item links popup intermittently too wide; conflict of keyboard commands with opera actions (both are performed)
Slider theme mindless r15450 OK mindless r15450 OK
Ajaxian theme mindless FF2 r15450 OK mindless r15450: thumbnail images shift on mouseover, pink bar out of place in upper left mindless 9.02 r14981: Click photo(shrink+show link) is ok, but click again to restore size and it disappears

Upgrades

The upgrade path is usually tested from the last public release to the new release. Keep old tested upgrade paths in the list and add upgrades to newer versions at the top of the list. From time to time, upgrade paths from older versions (alpha 4 = core version 0.8.4 or newer) to the current release should also be performed.


Current Upgrades

New Core Version New Release Name Old Core Version Old Release Name Web Server PHP Version Database Platform Owner Date Notes
1.1.21 2.2-SVN (r15222) 1.1.0.2 2.1.2 Typical Apache 1.3.37 PHP 5.1.4 MySQL 4.1.21 RHEL ES rel. 3 virshu 11/18/2006 [OK]
1.1.21 2.2-SVN (r15224) 1.1.0.2 2.1.2 Full Apache 2.2.2 PHP 5.1.6 MySQL 5.0.22 FC 5 virshu 11/19/2006 [OK]
1.1.23 2.2-SVN (r15265) 1.1.0.2 2.1.2 Full IIS 5 PHP 5.2.0 MySQL 5.0.22 on a different FC6 server Windows XP Professional virshu 11/23/2006 [OK]

Old Upgrades

New Core Version New Release Name Old Core Version Old Release Name Web Server PHP Version Database Platform Owner Date Notes
1.1.0.1 2.1.1 1.0.0.4 2.0.4 Apache 1.3.33 PHP 4.3.10 Postgres 7.x FreeBSD 4.8 bharat 4/6/2006 Had to upgrade the imagemagick module by hand (probably because I have a vulnerable binary). Otherwise, smooth sailing.
1.1.0.1 2.1.1 1.0.0.4 2.0.4 Apache 2.0.55 PHP 5.1.2 Postgres 8.1.3 Windows XP Larry Menard 13/04/2006 Couldn't configure URL Rewrite in 2.0.4. (Apache conf. prob at my end?), works fine in 2.1.1
1.1.0.1 2.1.1 1.0.0.4 2.0.4 Apache 2.0.54 PHP 5.0.4 MySQL 4.1.13-nt Windows XP bharat 4/14/2006 Worked fine.
1.1.0.1 2.1.1 1.0.0.3 2.0.3 Apache 2.0.5 PHP 4.4.2-1 MySQL 5.0.18 Debian mindless 13-Apr-2006 Upgrade modules request stopped; tried again and finished OK
1.1.0.1 2.1.1 1.0.0.4 2.0.4 Apache 2.0.55 PHP 5.1.2 Oracle 10g XE Windows XP Larry Menard 04/06/2006 1) Frequent NLS probs (req. server restart), 2) Couldn't configure URL Rewrite in 2.0.4. (Apache conf. prob at my end?), works fine in 2.1.1
1.0.34 2.1-rc-2a+ 1.0.0.1 2.0.1 Apache/1.3.33 (Unix) PHP/4.3.10 mysql 3.23.58-log Debian Linux bharat 03/20/2006 [OK]
1.0.34 2.1-rc-2a+ 0.9.35 2.0-rc-1+ Apache/1.3.31 (Unix) PHP/4.3.7 mysql 4.1.9-standard Slackware Linux volksport 03/20/2006 [OK]
1.0.34 2.1-RC-2a+ 0.8.4 2.0 Alpha-4 Apache 1.3.34 PHP 4.4.2 MySQL 4.1.16 FreeBSD 4.11 mindless 3/20/2006 [Good enough] had to go to upgrade url directly (session errors from main.php), and hit known CRC mismatch in toolkit upgrades from alpha-4 to beta-1 days
1.0.34 2.1-RC-2a+ 1.0.0 2.0.0 Apache 2.0.54 PHP 5.1.2 Postgres 8 Windows XP valiant 03/17/2006 [OK] (required generate-sql changes)

Very Old

New Core Version New Release Name Old Core Version Old Release Name Web Server PHP Version Database Platform Owner Date Notes
1.0.28 2.1 RC1a+ 1.0.0.2 2.0.2 Apache 2.0.55 PHP 4.4.0 MySQL 4.1.14 Gentoo fryfrog 02/15/2006 [OK]
1.0.27 2.1 RC1 0.9.10 G 2 Beta-2 Apache 2.0.52 PHP-CGI 4.4.1 MySQL 4.1.10 Gentoo valiant 02/10/2006 [OK]
1.0.25 2.1-soon 0.9.10 G 2 Beta-2 Apache 2.0.52 PHP 4.4.0 PostgreSQL 8.0.1 Gentoo valiant 02/09/2006 rewrite upgrade failed
1.0.16 2.1.0- 1.0.0 G 2.0 Apache 2.0.52 PHP 4.4.0 PostgreSQL 8.0.1 Gentoo valiant 01/10/2006 [OK]
1.0.18 2.1.0- 1.0.3 2.0.1+ Apache 2.0.54 PHP-CGI 4.4.0 MySQL 4.1.12a Windows XP valiant 01/13/2006 [OK]
advertisements