<font color="#000000">Tamarin-Central rev 703:2cee46be9ce0 was declared stable on 12/02/08. The announcement sent to tamarin-devel can be read here.</font>
Testing Summary
Acceptance tests have passed on the following supported platforms:
* Windows, 32 & 64 bit
* Mac OX X PPC & Intel, 32 bit
* Linux, 32 bit
* Windows Mobile ARM
Version ASC-4200 of the ActionScript Compiler was used for all tests.
Performance Testsuite TIME metric
The following is a comparison of the current tamarin-central (<font color="#0000ff">tc-703
</font>) versus the prior build (<font color="#810081">tc-700</font>) as well as current against the vm in Flash Player 10. The key takeaway is that the interpreter is much improved.
| OS | default-jit | interpreted | Aggressive jit |
|---|---|---|---|
| mac (OS/X 10.4 intel, 2ghz dual core) | tc-703 vs tc-700: 0.0% tc-703 vs flash10: <font color="#990000">1.1% slower</font> <font color="#810081">full report </font> | tc-703 vs tc-700: <font color="#009900">17.4% faster</font> tc-703 vs flash10: <font color="#009900">165.3% faster</font> <font color="#810081">full report </font> | tc-703 vs tc-700: <font color="#009900">0.1% faster</font> tc-703 vs flash10: <font color="#990000">0.8% slower</font> <font color="#0000ff">full report </font> |
| windows (XP Pro, 2.13ghz dual core) | tc-703 vs tc-700: <font color="#009900">0.6% faster</font> tc-703 vs flash10: <font color="#009900">0.8% faster</font> <font color="#0000ff">full report </font> | tc-703 vs tc-700: <font color="#009900">16.4% faster</font> tc-703 vs flash10: <font color="#009900">148.7% faster</font> <font color="#0000ff">full report </font> | tc-703 vs tc-700: <font color="#990000">0.1% slower</font> tc-703 vs flash10: <font color="#009900">5.2% faster</font> <font color="#0000ff">full report </font> |
| linux (Ubuntu Linux, 2.13 ghz dual core) | tc-703 vs tc-700: <font color="#009900">6.0% faster</font> tc-703 vs flash10: <font color="#009900">1.7% faster</font> <font color="#0000ff">full report </font> | tc-703 vs tc-700: <font color="#009900">89.5% faster</font> tc-703 vs flash10: <font color="#009900">182.0% faster</font> <font color="#0000ff">full report </font> | tc-703 vs tc-700: <font color="#009900">6.1% faster</font> tc-703 vs flash10: <font color="#009900">1.4% faster</font> <font color="#0000ff">full report </font> |
Performance Testuite MEMORY metric
The following is a comparison of the current tamarin-central (<font color="#0000ff">tc-703</font>) versus the prior build (<font color="#810081">tc-700</font>). There is no linux comparison due to a linux memstat bug only recently resolved in the tamarin-central branch.
| OS | default-jit | interpreted | Aggressive jit |
|---|---|---|---|
| mac (OS/X 10.4 intel, 2ghz dual core) | tc-703 vs tc-700: <font color="#009900">2.0% smaller</font> tc-703 vs tc-663: <font color="#009900">7.8% smaller</font> <font color="#810081">full report </font> | tc-703 vs tc-700: <font color="#990000">7.1% larger</font> tc-703 vs tc-663: <font color="#990000">14.6% larger</font> <font color="#810081">full report </font> | tc-703 vs tc-700: <font color="#990000">16.4% larger</font> tc-703 vs tc-663: <font color="#990000">2.1% larger</font> <font color="#810081">full report </font> |
| windows (XP Pro, 2.13ghz dual core) | tc-703 vs tc-700: <font color="#990000">3.2% larger</font> tc-703 vs tc-663: <font color="#990000">7.6% larger</font> <font color="#0000ff">full report </font> | tc-703 vs tc-700: <font color="#990000">3.9% larger</font> tc-703 vs tc-663: <font color="#990000">12.4% larger</font> <font color="#0000ff">full report </font> | tc-703 vs tc-700: <font color="#990000">3.3% larger</font> tc-703 vs tc-663: <font color="#990000">21.4% larger</font> <font color="#0000ff">full report </font> |
| linux (Ubuntu Linux, 2.13 ghz dual core) | n/a | n/a | n/a |
VM Code Size
The following is a comparison of the current tamarin-central compiled size (<font color="#0000ff">tc-703</font>) versus the prior build (<font color="#810081">tc-700</font>) as well as the current build against the vm in Flash Player 10. A full report can be found here.
| build | size |
|---|---|
| flash10 | 576k |
| tc-700 | 740k |
| tc-703 | 655k |
Known Issues
Known failures in the acceptance testsuite include:
- <font size="+0">Number failures in testsuite when running on linux</font>
- <font size="+0">Windows mobile System.privateBytes and -memstats privateBytes always returns 0</font>
- <font size="+0">AMD64 longjmp hack needs reengineering on non-Windows platforms</font>
- <font size="+0">Different runtime errors when -Dforcemir set in acceptance test run</font>
- <font size="+0">ARM: Math failures running with THUMB or ARM jit and interp.</font>
- <font size="+0">Recursive PCRE testcases kills the stack on PocketPC builds</font>
How to Provide Feedback
Feedback is appreciated and encouraged! You can participate via any of the following: