How to read the tables?
Meaning of the model-checker's results| Model-checker on the instrumented program | Observed state in Litmus | Picture |
| VERIFICATION FAILED | YES | ![]() |
| VERIFICATION SUCCESSFUL | NO | ![]() |
Reading the results in the experiments tables
The table below is an excerpt of former results we obtained for x86/podwr experiments.
- In the first column, we can read the name of the original Litmus test (with a link to the file), and the expected violation cycle. The second column gathers the results of the model-checkers for SC. As we are interested in WMM bugs, the verification for SC should be
. - The three next columns concern TSO model. The last column tells which result we should get for this program under TSO, namely
. We see in the third column that Satabs indeed finds the correct result when checking the instrumented program. ESBMC in this example is missing the counterexample. Threader is either returning an error, or killed by timeout (here, it is an error).
- Note that there are two columns for TSO results: in the first one, we instrument all the delays; in the second one, we instrument only one delay per cycle.
- We also experiment under PSO, RMO and Power, and with additional model-checkers: additional columns of results (and expected results) appear after TSO's columns.
| Name | SC | TSO (all delay/cyc) | TSO (1 delay/cyc) | Expected (TSO) | ... |
|
x86/podwr000 Fre PodWR Fre PodWR |
SatAbs: ![]() 0.60sec ESBMC:
0.30secThreader:
7.92sec... |
Cycles SatAbs:
3.94sec (x6.56) ESBMC:
8.34secThreader: ERROR/TIMEOUT[1] 491.99sec ... |
Cycles SatAbs:
2.43sec (x4.05) ESBMC:
7.58sec
Threader: ERROR/TIMEOUT[1] 182.60sec ... |
|
... |
ppc/cross (tooling date Sun Jan 22 02:23:23 GMT 2012)
This family corresponds to litmus tests involving pairs exercising typical Power scenarios. Therefore they should answer Yes in litmus terms, or Verification Failed in verification terms, as soon as the model is Power. It involves several diy cycles instead of one.
| Name | SC | CAV'11 | TSO (all delay/cyc) | TSO (1 delay/cyc) | TSO (opt delay/cyc) | Expected (TSO) | PSO (all delay/cyc) | PSO (1 delay/cyc) | PSO (opt delay/cyc) | Expected (PSO) | RMO (all delay/cyc) | RMO (1 delay/cyc) | RMO (opt delay/cyc) | Expected (RMO) | Power (all delay/cyc) | Power (1 delay/cyc) | Power (opt delay/cyc) | Expected (Power) |
|
ppc/iriw+addrs |
SatAbs: ![]() 20.90sec Satabs-prefix-first:
26.67sec
CBMC-WMM:
0.10sec
CBMC-SC:
0.13sec
CImpact: ERROR/TIMEOUT[8] 304.59sec Checkfence: 0.01sec ESBMC: 0.10sec Threader-monolithic:
0.17sec
Threader-owicki-gries:
0.16sec
Threader-rely-guarantee:
0.19sec
Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: sc): ERROR/TIMEOUT[2] 0.00sec |
Cycles
SatAbs: ERROR/TIMEOUT[130] 1072.53sec (x51.31) Satabs-prefix-first:
633.03sec
CBMC-WMM:
0.22sec
CBMC-SC:
56.75sec
CImpact: ERROR/TIMEOUT[8] 470.80sec ESBMC: 0.11sec Threader-monolithic: ERROR/TIMEOUT[130] 896.35sec Threader-owicki-gries: ERROR/TIMEOUT[130] 896.79sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 896.52sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[2] 0.00sec |
Cycles
SatAbs: ![]() 52.63sec (x2.51) Satabs-prefix-first:
73.94sec
CBMC-WMM:
0.25sec
CBMC-SC:
0.11sec
CImpact: ERROR/TIMEOUT[8] 334.69sec Checkfence: 0.01sec ESBMC: 0.09sec Threader-monolithic: ERROR/TIMEOUT[1] 0.09sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.11sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.13sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[2] 0.00sec |
Cycles
SatAbs: ![]() 48.95sec (x2.34) Satabs-prefix-first:
66.86sec
CBMC-WMM:
0.24sec
CBMC-SC:
0.13sec
CImpact: ERROR/TIMEOUT[8] 284.95sec ESBMC: 0.10sec Threader-monolithic: ERROR/TIMEOUT[1] 0.11sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.11sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.12sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[2] 0.00sec |
Cycles
SatAbs: ![]() 53.66sec (x2.56) Satabs-prefix-first:
76.71sec
CBMC-WMM:
0.23sec
CBMC-SC:
0.13sec
CImpact: ERROR/TIMEOUT[8] 353.10sec ESBMC: 0.09sec Threader-monolithic: ERROR/TIMEOUT[1] 0.11sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.13sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.12sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[2] 0.01sec |
|
Cycles
SatAbs: ![]() 53.63sec (x2.56) Satabs-prefix-first:
80.76sec
CBMC-WMM:
0.20sec
CBMC-SC:
0.12sec
CImpact: ERROR/TIMEOUT[8] 330.42sec ESBMC: 0.08sec Threader-monolithic: ERROR/TIMEOUT[1] 0.10sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.11sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.11sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 57.78sec (x2.76) Satabs-prefix-first:
78.18sec
CBMC-WMM:
0.32sec
CBMC-SC:
0.15sec
CImpact: ERROR/TIMEOUT[8] 480.73sec ESBMC: 0.09sec Threader-monolithic: ERROR/TIMEOUT[1] 0.12sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.14sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.14sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 58.90sec (x2.81) Satabs-prefix-first:
81.50sec
CBMC-WMM:
0.28sec
CBMC-SC:
0.12sec
CImpact: ERROR/TIMEOUT[8] 329.45sec ESBMC: 0.08sec Threader-monolithic: ERROR/TIMEOUT[1] 0.09sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.12sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.11sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
|
Cycles
SatAbs: ![]() 51.74sec (x2.47) Satabs-prefix-first:
71.83sec
CBMC-WMM:
0.28sec
CBMC-SC:
0.12sec
CImpact: ERROR/TIMEOUT[8] 356.32sec ESBMC: 0.09sec Threader-monolithic: ERROR/TIMEOUT[1] 0.12sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.11sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.11sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 49.57sec (x2.37) Satabs-prefix-first:
71.08sec
CBMC-WMM:
0.34sec
CBMC-SC:
0.11sec
CImpact: ERROR/TIMEOUT[8] 337.81sec ESBMC: 0.09sec Threader-monolithic: ERROR/TIMEOUT[1] 0.13sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.12sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.11sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 49.62sec (x2.37) Satabs-prefix-first:
70.46sec
CBMC-WMM:
0.28sec
CBMC-SC:
0.10sec
CImpact: ERROR/TIMEOUT[8] 325.00sec ESBMC: 0.09sec Threader-monolithic: ERROR/TIMEOUT[1] 0.12sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.11sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.13sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|
Cycles
SatAbs: ERROR/TIMEOUT[130] 1265.92sec (x60.57) Satabs-prefix-first: ERROR/TIMEOUT[130] 969.99sec CBMC-WMM:
0.20sec
CBMC-SC:
37.91sec
CImpact: ERROR/TIMEOUT[8] 488.88sec ESBMC: 0.13sec Threader-monolithic: ERROR/TIMEOUT[130] 897.26sec Threader-owicki-gries: ERROR/TIMEOUT[130] 894.23sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 865.17sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 306.54sec (x14.66) Satabs-prefix-first:
71.30sec
CBMC-WMM:
0.22sec
CBMC-SC:
7.16sec
CImpact: ERROR/TIMEOUT[8] 418.17sec ESBMC: 0.07sec Threader-monolithic: ERROR/TIMEOUT[1] 577.13sec Threader-owicki-gries: ERROR/TIMEOUT[1] 550.47sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 548.69sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 316.00sec (x15.11) Satabs-prefix-first:
68.42sec
CBMC-WMM:
0.22sec
CBMC-SC:
8.75sec
CImpact: ERROR/TIMEOUT[8] 547.22sec ESBMC: 0.08sec Threader-monolithic: ERROR/TIMEOUT[1] 514.52sec Threader-owicki-gries: ERROR/TIMEOUT[1] 482.83sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 550.82sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|
|
ppc/iriw+lwsync+addr |
SatAbs: ![]() 12.05sec Satabs-prefix-first:
12.27sec
CBMC-WMM:
0.15sec
CBMC-SC:
0.14sec
CImpact: ERROR/TIMEOUT[8] 364.20sec Checkfence: 0.01sec ESBMC: 0.09sec Threader-monolithic:
0.18sec
Threader-owicki-gries:
0.14sec
Threader-rely-guarantee:
0.19sec
Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: sc): ERROR/TIMEOUT[2] 0.00sec |
Cycles
SatAbs: ![]() 625.93sec (x51.94) Satabs-prefix-first:
737.90sec
CBMC-WMM:
0.23sec
CBMC-SC:
46.61sec
CImpact: ERROR/TIMEOUT[8] 451.46sec ESBMC: 0.11sec Threader-monolithic: ERROR/TIMEOUT[130] 896.63sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.01sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.27sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[2] 0.00sec |
Cycles
SatAbs: ![]() 27.63sec (x2.29) Satabs-prefix-first:
41.16sec
CBMC-WMM:
0.24sec
CBMC-SC:
0.11sec
CImpact: ERROR/TIMEOUT[8] 364.25sec Checkfence: 0.01sec ESBMC: 0.07sec Threader-monolithic: ERROR/TIMEOUT[1] 0.11sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.09sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.10sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[2] 0.00sec |
Cycles
SatAbs: ![]() 25.86sec (x2.14) Satabs-prefix-first:
40.01sec
CBMC-WMM:
0.22sec
CBMC-SC:
0.11sec
CImpact: ERROR/TIMEOUT[8] 363.95sec ESBMC: 0.09sec Threader-monolithic: ERROR/TIMEOUT[1] 0.11sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.12sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.12sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[2] 0.00sec |
Cycles
SatAbs: ![]() 26.00sec (x2.15) Satabs-prefix-first:
40.19sec
CBMC-WMM:
0.16sec
CBMC-SC:
0.12sec
CImpact: ERROR/TIMEOUT[8] 367.74sec ESBMC: 0.09sec Threader-monolithic: ERROR/TIMEOUT[1] 0.10sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.10sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.10sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[2] 0.00sec |
|
Cycles
SatAbs: ![]() 26.04sec (x2.16) Satabs-prefix-first:
39.96sec
CBMC-WMM:
0.22sec
CBMC-SC:
0.12sec
CImpact: ERROR/TIMEOUT[8] 338.43sec ESBMC: 0.10sec Threader-monolithic: ERROR/TIMEOUT[1] 0.12sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.12sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.12sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 26.17sec (x2.17) Satabs-prefix-first:
42.31sec
CBMC-WMM:
0.24sec
CBMC-SC:
0.10sec
CImpact: ERROR/TIMEOUT[8] 265.21sec ESBMC: 0.10sec Threader-monolithic: ERROR/TIMEOUT[1] 0.11sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.12sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.11sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 26.43sec (x2.19) Satabs-prefix-first:
43.00sec
CBMC-WMM:
0.23sec
CBMC-SC:
0.12sec
CImpact: ERROR/TIMEOUT[8] 371.88sec ESBMC: 0.10sec Threader-monolithic: ERROR/TIMEOUT[1] 0.11sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.10sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.12sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
|
Cycles
SatAbs: ![]() 26.95sec (x2.23) Satabs-prefix-first:
43.69sec
CBMC-WMM:
0.25sec
CBMC-SC:
0.09sec
CImpact: ERROR/TIMEOUT[8] 389.45sec ESBMC: 0.10sec Threader-monolithic: ERROR/TIMEOUT[1] 0.11sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.10sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.13sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 26.53sec (x2.20) Satabs-prefix-first:
42.31sec
CBMC-WMM:
0.28sec
CBMC-SC:
0.12sec
CImpact: ERROR/TIMEOUT[8] 385.01sec ESBMC: 0.10sec Threader-monolithic: ERROR/TIMEOUT[1] 0.11sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.11sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.11sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 27.33sec (x2.26) Satabs-prefix-first:
43.75sec
CBMC-WMM:
0.27sec
CBMC-SC:
0.12sec
CImpact: ERROR/TIMEOUT[8] 294.34sec ESBMC: 0.07sec Threader-monolithic: ERROR/TIMEOUT[1] 0.12sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.09sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.12sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|
Cycles
SatAbs: ![]() 731.78sec (x60.72) Satabs-prefix-first: ERROR/TIMEOUT[130] 978.21sec CBMC-WMM:
0.22sec
CBMC-SC:
27.03sec
CImpact: ERROR/TIMEOUT[8] 511.27sec ESBMC: 0.11sec Threader-monolithic: ERROR/TIMEOUT[130] 897.59sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.58sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.83sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 195.15sec (x16.19) Satabs-prefix-first:
191.47sec
CBMC-WMM:
0.18sec
CBMC-SC:
4.60sec
CImpact: ERROR/TIMEOUT[8] 365.53sec ESBMC: 0.09sec Threader-monolithic: ERROR/TIMEOUT[1] 546.97sec Threader-owicki-gries: ERROR/TIMEOUT[1] 540.67sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 542.39sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 201.50sec (x16.72) Satabs-prefix-first:
213.03sec
CBMC-WMM:
0.23sec
CBMC-SC:
5.29sec
CImpact: ERROR/TIMEOUT[8] 402.88sec ESBMC: 0.10sec Threader-monolithic: ERROR/TIMEOUT[1] 404.40sec Threader-owicki-gries: ERROR/TIMEOUT[1] 398.12sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 540.26sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|
|
ppc/iriw+lwsyncs |
SatAbs: ![]() 3.84sec Satabs-prefix-first:
4.86sec
CBMC-WMM:
0.11sec
CBMC-SC:
0.12sec
CImpact: ERROR/TIMEOUT[8] 251.41sec Checkfence: 0.01sec ESBMC: 0.05sec Threader-monolithic:
0.15sec
Threader-owicki-gries:
0.15sec
Threader-rely-guarantee:
0.16sec
Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: sc): ERROR/TIMEOUT[2] 0.00sec |
Cycles
SatAbs: ![]() 202.85sec (x52.82) Satabs-prefix-first:
312.23sec
CBMC-WMM:
0.24sec
CBMC-SC:
42.64sec
CImpact: ERROR/TIMEOUT[8] 512.97sec ESBMC: 0.10sec Threader-monolithic: ERROR/TIMEOUT[130] 896.81sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.10sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 896.98sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[2] 0.00sec |
Cycles
SatAbs: ![]() 62.03sec (x16.15) Satabs-prefix-first:
28.94sec
CBMC-WMM:
0.24sec
CBMC-SC:
0.10sec
CImpact: ERROR/TIMEOUT[8] 346.83sec Checkfence: 0.01sec ESBMC: 0.10sec Threader-monolithic: ERROR/TIMEOUT[1] 0.13sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.13sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.10sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[2] 0.00sec |
Cycles
SatAbs: ![]() 60.87sec (x15.85) Satabs-prefix-first:
28.95sec
CBMC-WMM:
0.25sec
CBMC-SC:
0.10sec
CImpact: ERROR/TIMEOUT[8] 367.29sec ESBMC: 0.08sec Threader-monolithic: ERROR/TIMEOUT[1] 0.13sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.10sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.13sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[2] 0.00sec |
Cycles
SatAbs: ![]() 62.37sec (x16.24) Satabs-prefix-first:
29.53sec
CBMC-WMM:
0.25sec
CBMC-SC:
0.12sec
CImpact: ERROR/TIMEOUT[8] 371.67sec ESBMC: 0.07sec Threader-monolithic: ERROR/TIMEOUT[1] 0.12sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.12sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.11sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[2] 0.00sec |
|
Cycles
SatAbs: ![]() 64.01sec (x16.66) Satabs-prefix-first:
29.86sec
CBMC-WMM:
0.23sec
CBMC-SC:
0.13sec
CImpact: ERROR/TIMEOUT[8] 342.16sec ESBMC: 0.09sec Threader-monolithic: ERROR/TIMEOUT[1] 0.10sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.12sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.12sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 57.46sec (x14.96) Satabs-prefix-first:
27.94sec
CBMC-WMM:
0.23sec
CBMC-SC:
0.10sec
CImpact: ERROR/TIMEOUT[8] 359.64sec ESBMC: 0.06sec Threader-monolithic: ERROR/TIMEOUT[1] 0.10sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.10sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.10sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 43.39sec (x11.29) Satabs-prefix-first:
26.58sec
CBMC-WMM:
0.24sec
CBMC-SC:
0.10sec
CImpact: ERROR/TIMEOUT[8] 388.60sec ESBMC: 0.06sec Threader-monolithic: ERROR/TIMEOUT[1] 0.13sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.11sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.11sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
|
Cycles
SatAbs: ![]() 58.25sec (x15.16) Satabs-prefix-first:
26.93sec
CBMC-WMM:
0.27sec
CBMC-SC:
0.09sec
CImpact: ERROR/TIMEOUT[8] 368.01sec ESBMC: 0.10sec Threader-monolithic: ERROR/TIMEOUT[1] 0.11sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.12sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.10sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 59.45sec (x15.48) Satabs-prefix-first:
27.15sec
CBMC-WMM:
0.24sec
CBMC-SC:
0.11sec
CImpact: ERROR/TIMEOUT[8] 362.07sec ESBMC: 0.13sec Threader-monolithic: ERROR/TIMEOUT[1] 0.12sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.12sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.12sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 66.65sec (x17.35) Satabs-prefix-first:
26.84sec
CBMC-WMM:
0.28sec
CBMC-SC:
0.11sec
CImpact: ERROR/TIMEOUT[8] 362.32sec ESBMC: 0.08sec Threader-monolithic: ERROR/TIMEOUT[1] 0.07sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.11sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.12sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|
Cycles
SatAbs: ![]() 851.31sec (x221.69) Satabs-prefix-first: ERROR/TIMEOUT[130] 962.95sec CBMC-WMM:
0.21sec
CBMC-SC:
26.99sec
CImpact: ERROR/TIMEOUT[8] 489.31sec ESBMC: 0.13sec Threader-monolithic: ERROR/TIMEOUT[130] 897.34sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.71sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.65sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 227.64sec (x59.28) Satabs-prefix-first:
272.78sec
CBMC-WMM:
0.21sec
CBMC-SC:
5.60sec
CImpact: ERROR/TIMEOUT[8] 300.28sec ESBMC: 0.09sec Threader-monolithic: ERROR/TIMEOUT[1] 537.73sec Threader-owicki-gries: ERROR/TIMEOUT[1] 411.00sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 461.33sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 189.45sec (x49.33) Satabs-prefix-first:
295.99sec
CBMC-WMM:
0.21sec
CBMC-SC:
5.66sec
CImpact: ERROR/TIMEOUT[8] 444.93sec ESBMC: 0.09sec Threader-monolithic: ERROR/TIMEOUT[1] 475.90sec Threader-owicki-gries: ERROR/TIMEOUT[1] 403.27sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 409.30sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|