INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/unladen_swallow/performance/bm_ai.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/unladen_swallow/performance/bm_ai.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/bm_chameleon.py -n 15 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/bm_chameleon.py -n 15 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/bm_mako.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/bm_mako.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/chaos.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/chaos.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/crypto_pyaes.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/crypto_pyaes.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/unladen_swallow/performance/bm_django.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/unladen_swallow/performance/bm_django.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/eparse.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/eparse.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/fannkuch.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/fannkuch.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/float.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/float.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/bm_genshi.py -n 5 --benchmark=text INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/bm_genshi.py -n 5 --benchmark=text INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/bm_genshi.py -n 5 --benchmark=xml INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/bm_genshi.py -n 5 --benchmark=xml INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/go.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/go.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/hexiom2.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/hexiom2.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/unladen_swallow/performance/bm_html5lib.py -n 1 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/unladen_swallow/performance/bm_html5lib.py -n 1 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/json_bench.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/json_bench.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/meteor-contest.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/meteor-contest.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/nbody_modified.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/nbody_modified.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/pidigits.py -n 1 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/pidigits.py -n 1 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/pyflate-fast.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/pyflate-fast.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/raytrace-simple.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/raytrace-simple.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/unladen_swallow/performance/bm_richards.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/unladen_swallow/performance/bm_richards.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/unladen_swallow/performance/bm_rietveld.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/unladen_swallow/performance/bm_rietveld.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/unladen_swallow/performance/bm_spitfire.py -n 5 --disable_psyco INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/unladen_swallow/performance/bm_spitfire.py -n 5 --disable_psyco INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/unladen_swallow/performance/bm_spambayes.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/unladen_swallow/performance/bm_spambayes.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/spectral-norm.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/spectral-norm.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/spitfire.py -n 5 --benchmark=spitfire_o4 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/spitfire.py -n 5 --benchmark=spitfire_o4 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/spitfire.py -n 5 --benchmark=python_cstringio INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/spitfire.py -n 5 --benchmark=python_cstringio INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/bm_sympy.py -n 1 --benchmark=expand INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/bm_sympy.py -n 1 --benchmark=expand INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/bm_sympy.py -n 1 --benchmark=integrate INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/bm_sympy.py -n 1 --benchmark=integrate INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/bm_sympy.py -n 1 --benchmark=str INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/bm_sympy.py -n 1 --benchmark=str INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/bm_sympy.py -n 1 --benchmark=sum INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/bm_sympy.py -n 1 --benchmark=sum INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/telco.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/telco.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/twisted/iteration.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/twisted/iteration.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/twisted/names.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/twisted/names.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/twisted/pb.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/twisted/pb.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/changed/pypy-c /home/manu/vcs/benchmarks/own/twisted/tcp.py -n 5 INFO:root:Running /home/manu/bench/lto_nojit/trans/baseline/pypy-c /home/manu/vcs/benchmarks/own/twisted/tcp.py -n 5 Running ai... Running bm_chameleon... Running bm_mako... Running chaos... Running crypto_pyaes... Running django... Running eparse... Running fannkuch... Running float... Running genshi_text... Running genshi_xml... Running go... Running hexiom2... Running html5lib... Running json_bench... Running meteor-contest... Running nbody_modified... Running pidigits... Running pyflate-fast... Running raytrace-simple... Running richards... Running rietveld... Running slowspitfire... Running spambayes... Running spectral-norm... Running spitfire... Running spitfire_cstringio... Running sympy_expand... Running sympy_integrate... Running sympy_str... Running sympy_sum... Running telco... Running twisted_iteration... Running twisted_names... Running twisted_pb... Running twisted_tcp... Report on Linux tmp 4.9.11-1-ARCH #1 SMP PREEMPT Sun Feb 19 13:45:52 UTC 2017 x86_64 Total CPU cores: 4 ### ai ### Min: 0.426347 -> 0.388078: 1.0986x faster Avg: 0.427899 -> 0.389716: 1.0980x faster Significant (t=48.287426, a=0.95) Stddev: 0.00143 -> 0.00104: 1.3713x smaller ### bm_chameleon ### Min: 0.096874 -> 0.091009: 1.0644x faster Avg: 0.098823 -> 0.092275: 1.0710x faster Significant (t=9.443050, a=0.95) Stddev: 0.00229 -> 0.00140: 1.6303x smaller ### bm_mako ### Min: 0.128236 -> 0.124646: 1.0288x faster Avg: 0.130181 -> 0.126348: 1.0303x faster Significant (t=3.280138, a=0.95) Stddev: 0.00129 -> 0.00227: 1.7673x larger ### chaos ### Min: 0.357279 -> 0.322519: 1.1078x faster Avg: 0.358307 -> 0.322789: 1.1100x faster Significant (t=80.865423, a=0.95) Stddev: 0.00086 -> 0.00047: 1.8123x smaller ### crypto_pyaes ### Min: 2.794742 -> 2.615789: 1.0684x faster Avg: 2.805085 -> 2.618191: 1.0714x faster Significant (t=41.056626, a=0.95) Stddev: 0.01001 -> 0.00184: 5.4361x smaller ### django ### Min: 0.675614 -> 0.633282: 1.0668x faster Avg: 0.680117 -> 0.636112: 1.0692x faster Significant (t=20.898657, a=0.95) Stddev: 0.00341 -> 0.00324: 1.0527x smaller ### eparse ### Min: 0.724124 -> 0.698543: 1.0366x faster Avg: 0.733269 -> 0.705365: 1.0396x faster Significant (t=6.272198, a=0.95) Stddev: 0.00542 -> 0.00834: 1.5399x larger ### fannkuch ### Min: 1.272138 -> 1.139302: 1.1166x faster Avg: 1.281626 -> 1.142561: 1.1217x faster Significant (t=20.034752, a=0.95) Stddev: 0.01500 -> 0.00398: 3.7712x smaller ### float ### Min: 0.401826 -> 0.379937: 1.0576x faster Avg: 0.404031 -> 0.381270: 1.0597x faster Significant (t=19.929920, a=0.95) Stddev: 0.00202 -> 0.00156: 1.2994x smaller ### genshi_text ### Min: 0.166138 -> 0.153802: 1.0802x faster Avg: 0.167613 -> 0.157437: 1.0646x faster Significant (t=3.708417, a=0.95) Stddev: 0.00148 -> 0.00595: 4.0142x larger ### genshi_xml ### Min: 0.350027 -> 0.327919: 1.0674x faster Avg: 0.353374 -> 0.331626: 1.0656x faster Significant (t=10.011555, a=0.95) Stddev: 0.00234 -> 0.00426: 1.8197x larger ### go ### Min: 1.169525 -> 1.087334: 1.0756x faster Avg: 1.172513 -> 1.089713: 1.0760x faster Significant (t=48.083897, a=0.95) Stddev: 0.00290 -> 0.00254: 1.1417x smaller ### hexiom2 ### Min: 240.664867 -> 213.380192: 1.1279x faster Avg: 240.664867 -> 213.380192: 1.1279x faster Significant (t=1919988306812560.000000, a=0.95) Stddev: 0.00000 -> 0.00000: uncomparable ### html5lib ### 12.949190 -> 12.738770: 1.0165x faster ### json_bench ### Min: 17.819932 -> 16.856764: 1.0571x faster Avg: 17.866665 -> 16.880649: 1.0584x faster Significant (t=49.593202, a=0.95) Stddev: 0.03427 -> 0.02832: 1.2102x smaller ### meteor-contest ### Min: 0.324679 -> 0.301302: 1.0776x faster Avg: 0.324850 -> 0.301574: 1.0772x faster Significant (t=194.441764, a=0.95) Stddev: 0.00012 -> 0.00024: 2.0165x larger ### nbody_modified ### Min: 0.628641 -> 0.564396: 1.1138x faster Avg: 0.639614 -> 0.569253: 1.1236x faster Significant (t=14.884512, a=0.95) Stddev: 0.01017 -> 0.00290: 3.5104x smaller ### pidigits ### 6.683489 -> 6.862369: 1.0268x slower ### pyflate-fast ### Min: 1.953119 -> 1.842279: 1.0602x faster Avg: 1.958937 -> 1.851291: 1.0581x faster Significant (t=19.193057, a=0.95) Stddev: 0.00994 -> 0.00764: 1.3007x smaller ### raytrace-simple ### Min: 1.770293 -> 1.675507: 1.0566x faster Avg: 1.774592 -> 1.682326: 1.0548x faster Significant (t=37.474988, a=0.95) Stddev: 0.00329 -> 0.00441: 1.3398x larger ### richards ### Min: 0.273948 -> 0.249900: 1.0962x faster Avg: 0.274703 -> 0.250914: 1.0948x faster Significant (t=59.355450, a=0.95) Stddev: 0.00064 -> 0.00063: 1.0273x smaller ### rietveld ### Min: 0.457732 -> 0.438966: 1.0428x faster Avg: 0.460812 -> 0.444730: 1.0362x faster Significant (t=8.357462, a=0.95) Stddev: 0.00216 -> 0.00372: 1.7256x larger ### slowspitfire ### Min: 0.673160 -> 0.622309: 1.0817x faster Avg: 0.684089 -> 0.638124: 1.0720x faster Significant (t=5.922790, a=0.95) Stddev: 0.01030 -> 0.01397: 1.3558x larger ### spambayes ### Min: 0.275838 -> 0.262510: 1.0508x faster Avg: 0.277425 -> 0.265231: 1.0460x faster Significant (t=8.071939, a=0.95) Stddev: 0.00240 -> 0.00238: 1.0067x smaller ### spectral-norm ### Min: 0.535817 -> 0.505471: 1.0600x faster Avg: 0.537023 -> 0.506228: 1.0608x faster Significant (t=55.665831, a=0.95) Stddev: 0.00106 -> 0.00063: 1.6756x smaller ### spitfire ### Min: 7.960000 -> 7.150000: 1.1133x faster Avg: 7.982000 -> 7.230000: 1.1040x faster Significant (t=20.905026, a=0.95) Stddev: 0.01924 -> 0.07810: 4.0604x larger ### spitfire_cstringio ### Min: 6.010000 -> 5.490000: 1.0947x faster Avg: 6.034000 -> 5.526000: 1.0919x faster Significant (t=38.734637, a=0.95) Stddev: 0.01817 -> 0.02302: 1.2673x larger ### sympy_expand ### 1.198510 -> 1.180079: 1.0156x faster ### sympy_integrate ### 7.377800 -> 7.012559: 1.0521x faster ### sympy_str ### 0.609476 -> 0.588356: 1.0359x faster ### sympy_sum ### 2.107641 -> 2.129639: 1.0104x slower ### telco ### Min: 1.044434 -> 1.002854: 1.0415x faster Avg: 1.045686 -> 1.004658: 1.0408x faster Significant (t=38.172300, a=0.95) Stddev: 0.00107 -> 0.00215: 2.0132x larger ### twisted_iteration ### Min: 0.190295 -> 0.182929: 1.0403x faster Avg: 0.190502 -> 0.183842: 1.0362x faster Significant (t=21.894044, a=0.95) Stddev: 0.00013 -> 0.00067: 4.9415x larger ### twisted_names ### Min: 0.009533 -> 0.009191: 1.0372x faster Avg: 0.009588 -> 0.009212: 1.0409x faster Significant (t=9.477055, a=0.95) Stddev: 0.00009 -> 0.00002: 3.7365x smaller ### twisted_pb ### Min: 0.062305 -> 0.060060: 1.0374x faster Avg: 0.062658 -> 0.060278: 1.0395x faster Significant (t=12.108781, a=0.95) Stddev: 0.00032 -> 0.00030: 1.0765x smaller ### twisted_tcp ### Min: 0.484702 -> 0.490722: 1.0124x slower Avg: 0.487373 -> 0.500687: 1.0273x slower Significant (t=-3.194592, a=0.95) Stddev: 0.00294 -> 0.00884: 3.0068x larger