Surefire Report

Summary


Tests Errors Failures Skipped Success Rate Time
667 0 40 0 94.003% 2,451.873

Note: failures are anticipated and checked for with assertions while errors are unanticipated.

Package List


Package Tests Errors Failures Skipped Success Rate Time
org.sat4j.pb.constraints 666 0 40 0 93.994% 2,451.78
org.sat4j.pb 1 0 0 0 100% 0.093

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.sat4j.pb

Class Tests Errors Failures Skipped Success Rate Time
TestEclipseBug247567 1 0 0 0 100% 0.093

Test Cases

WatchedPBConstrOnRandomCardProblemsTest

testRndDeg1 3.616
testRndDeg2 1.185
testRndDeg3 0.627
testRndDeg4 0.294
testRndDeg5 0.065
testRndDeg6 0.032
testRndDeg7 0.02
testRndDeg8 0.005
testRndDeg9 0.004
testRndDeg10 0.002
testRndDeg11 0.002
testRndDeg12 0.002
testRndDeg13 0.002
testRndDeg14 0.002
testRndDeg15 0.002
testRndDeg16 0.002
testRndDeg17 0.002
testRndDeg18 0.002
testPN34 0.01
testPN4 0.015
testPN45 0.01
testPN5 0.038
testPN56 0.009
testPN6 0.151
testPN67 0.013
testPN7 0.586
testPN78 0.017
testPN8 2.045
testPN89 0.018
testPN9 11.248
testPN910 0.023

WatchedCardConstrOnRandomCardProblemsTest

testRndDeg1 0.577
testRndDeg2 0.322
testRndDeg3 0.32
testRndDeg4 0.204
testRndDeg5 0.05
testRndDeg6 0.022
testRndDeg7 0.012
testRndDeg8 0.004
testRndDeg9 0.003
testRndDeg10 0.001
testRndDeg11 0.002
testRndDeg12 0.002
testRndDeg13 0.002
testRndDeg14 0.002
testRndDeg15 0.002
testRndDeg16 0.002
testRndDeg17 0.001
testRndDeg18 0.002
testPN34 0.006
testPN4 0.008
testPN45 0.004
testPN5 0.014
testPN56 0.006
testPN6 0.024
testPN67 0.007
testPN7 0.043
testPN78 0.009
testPN8 0.079
testPN89 0.011
testPN9 0.116
testPN910 0.013

WatchedPBConstrWithClauseLearningTest

testncirc43 0.818
testncirc63 4.222
testncirc83 14.318
testndata43 0.238
testndata63 3.398
testndata83 13.746
testn9symml 0.625
testnC17 0.007
testnC432 0.941
testnb1 0.018
testnc8 0.222
testncc 0.074
testncm42a 0.056
testncmb 0.43
testnmux 0.235
testnmyadder 0.578
testPN34 0.01
testPN4 0.01
testPN45 0.009
testPN5 0.029
testPN56 0.043
testPN6 0.129
testPN67 0.016
testPN7 0.529
testPN78 0.018
testPN8 1.892
testPN89 0.021
testPN9 11.219
testPN910 0.029

CounterPBConstrWithClauseCardConstrLearningTest

testncirc43 0.756
testncirc63 6.506
testncirc83 22.899
testndata43 0.172
testndata63 5.573
testndata83 22.307
testn9symml 0.295
testnC17 0.012
testnC432 0.398
testnb1 0.008
testnc8 0.112
testncc 0.038
testncm42a 0.031
testncmb 0.142
testnmux 0.112
testnmyadder 0.301
testPN34 0.006
testPN4 0.01
testPN45 0.013
testPN5 0.012
testPN56 0.009
testPN6 0.025
testPN67 0.005
testPN7 0.03
testPN78 0.006
testPN8 0.061
testPN89 0.008
testPN9 0.089
testPN910 0.009

CounterPBConstrWithClauseAtLeastConstrLearningTest

testaloul1011 0.838
testaloul1015 0.208
testaloul1020 0.332
testaloul1516 1.548
testaloul1520 0.559
testaloul1525 0.783
testaloul2021 5.533
testaloul2025 1.388
testaloul2030 2.053
testaloul3031 30.689
Timeout: need more time to complete!
testaloul3035 5.888
testaloul3040 7.245
testaloul3536 31.426
Timeout: need more time to complete!
testaloul3540 8.695
testaloul3545 11.874
testaloul4041 33.829
Timeout: need more time to complete!
testaloul4045 14.468
testaloul4050 22.754
testaloul5051 31.341
Timeout: need more time to complete!
testaloul5055 35.927
Timeout: need more time to complete!
testaloul5060 42.847
Timeout: need more time to complete!
testPN10 0.191
testncirc43 0.24
testncirc63 4.848
testncirc83 9.918
testndata43 0.164
testndata63 4.44
testndata83 9.457
testn9symml 0.298
testnC17 0.015
testnC432 0.405
testnb1 0.008
testnc8 0.115
testncc 0.039
testncm42a 0.031
testncmb 0.146
testnmux 0.113
testnmyadder 0.314
testPN34 0.002
testPN4 0.004
testPN45 0.003
testPN5 0.008
testPN56 0.003
testPN6 0.016
testPN67 0.005
testPN7 0.03
testPN78 0.006
testPN8 0.052
testPN89 0.007
testPN9 0.09
testPN910 0.009

CounterCardConstrOnRandomCardProblemsTest

testRndDeg1 0.53
testRndDeg2 0.321
testRndDeg3 0.289
testRndDeg4 0.206
testRndDeg5 0.047
testRndDeg6 0.021
testRndDeg7 0.013
testRndDeg8 0.004
testRndDeg9 0.003
testRndDeg10 0.002
testRndDeg11 0.002
testRndDeg12 0.002
testRndDeg13 0.002
testRndDeg14 0.002
testRndDeg15 0.002
testRndDeg16 0.001
testRndDeg17 0.002
testRndDeg18 0.001
testPN34 0.006
testPN4 0.008
testPN45 0.004
testPN5 0.013
testPN56 0.006
testPN6 0.026
testPN67 0.008
testPN7 0.043
testPN78 0.009
testPN8 0.078
testPN89 0.011
testPN9 0.117
testPN910 0.013

PuebloWatchedPBClauseCardConstrWithPBConstrLearningTest

testaloul1011 0.763
testaloul1015 0.209
testaloul1020 0.339
testaloul1516 1.537
testaloul1520 0.559
testaloul1525 0.786
testaloul2021 5.529
testaloul2025 1.345
testaloul2030 2.042
testaloul3031 30.728
Timeout: need more time to complete!
testaloul3035 5.795
testaloul3040 7.175
testaloul3536 31.519
Timeout: need more time to complete!
testaloul3540 8.714
testaloul3545 11.697
testaloul4041 33.357
Timeout: need more time to complete!
testaloul4045 14.434
testaloul4050 22.256
testaloul5051 31.015
Timeout: need more time to complete!
testaloul5055 35.651
Timeout: need more time to complete!
testaloul5060 42.453
Timeout: need more time to complete!
testPN10 0.159
testncirc43 0.293
testncirc63 5.213
testncirc83 13.182
testndata43 0.167
testndata63 4.722
testndata83 12.671
testn9symml 0.302
testnC17 0.01
testnC432 0.394
testnb1 0.015
testnc8 0.123
testncc 0.048
testncm42a 0.03
testncmb 0.151
testnmux 0.113
testnmyadder 0.306
testPN34 0.002
testPN4 0.005
testPN45 0.003
testPN5 0.008
testPN56 0.003
testPN6 0.016
testPN67 0.005
testPN7 0.029
testPN78 0.005
testPN8 0.052
testPN89 0.007
testPN9 0.089
testPN910 0.009

WatchedPBConstrWithPBConstrLearningTest

testaloul1011 0.799
testaloul1015 0.256
testaloul1020 0.402
testaloul1516 1.712
testaloul1520 0.692
testaloul1525 0.988
testaloul2021 6.026
testaloul2025 1.594
testaloul2030 2.324
testaloul3031 30.622
Timeout: need more time to complete!
testaloul3035 6.475
testaloul3040 7.995
testaloul3536 33.454
Timeout: need more time to complete!
testaloul3540 9.752
testaloul3545 12.943
testaloul4041 36.055
Timeout: need more time to complete!
testaloul4045 15.747
testaloul4050 23.949
testaloul5051 34.816
Timeout: need more time to complete!
testaloul5055 38.642
Timeout: need more time to complete!
testaloul5060 45.78
Timeout: need more time to complete!
testPN10 0.182
testncirc43 0.395
testncirc63 5.319
testncirc83 36.606
Timeout: need more time to complete!
testndata43 0.28
testndata63 4.933
testndata83 36.306
Timeout: need more time to complete!
testn9symml 0.604
testnC17 0.006
testnC432 0.929
testnb1 0.015
testnc8 0.227
testncc 0.073
testncm42a 0.056
testncmb 0.434
testnmux 0.306
testnmyadder 0.646
testPN34 0.003
testPN4 0.006
testPN45 0.005
testPN5 0.01
testPN56 0.006
testPN6 0.02
testPN67 0.009
testPN7 0.036
testPN78 0.012
testPN8 0.062
testPN89 0.016
testPN9 0.104
testPN910 0.021

PuebloWatchedPbClauseAtLeastConstrWithPBConstrLearningTest

testaloul1011 0.743
testaloul1015 0.207
testaloul1020 0.332
testaloul1516 1.521
testaloul1520 0.56
testaloul1525 0.824
testaloul2021 5.499
testaloul2025 1.348
testaloul2030 2.043
testaloul3031 30.271
Timeout: need more time to complete!
testaloul3035 5.768
testaloul3040 7.199
testaloul3536 30.943
Timeout: need more time to complete!
testaloul3540 8.607
testaloul3545 11.702
testaloul4041 33.042
Timeout: need more time to complete!
testaloul4045 14.292
testaloul4050 22.061
testaloul5051 30.751
Timeout: need more time to complete!
testaloul5055 35.521
Timeout: need more time to complete!
testaloul5060 42.43
Timeout: need more time to complete!
testPN10 0.158
testncirc43 0.253
testncirc63 10.929
testncirc83 11.931
testndata43 0.169
testndata63 10.368
testndata83 11.468
testn9symml 0.31
testnC17 0.008
testnC432 0.396
testnb1 0.018
testnc8 0.128
testncc 0.038
testncm42a 0.031
testncmb 0.144
testnmux 0.113
testnmyadder 0.304
testPN34 0.002
testPN4 0.004
testPN45 0.003
testPN5 0.008
testPN56 0.004
testPN6 0.016
testPN67 0.004
testPN7 0.029
testPN78 0.006
testPN8 0.052
testPN89 0.007
testPN9 0.089
testPN910 0.008

MyCounterCardConstrOnRandomCardProblemsTest

testRndDeg1 0.528
testRndDeg2 0.314
testRndDeg3 0.286
testRndDeg4 0.203
testRndDeg5 0.047
testRndDeg6 0.021
testRndDeg7 0.013
testRndDeg8 0.004
testRndDeg9 0.003
testRndDeg10 0.002
testRndDeg11 0.002
testRndDeg12 0.002
testRndDeg13 0.001
testRndDeg14 0.002
testRndDeg15 0.002
testRndDeg16 0.001
testRndDeg17 0.001
testRndDeg18 0.001
testPN34 0.006
testPN4 0.008
testPN45 0.004
testPN5 0.014
testPN56 0.006
testPN6 0.025
testPN67 0.008
testPN7 0.046
testPN78 0.009
testPN8 0.078
testPN89 0.011
testPN9 0.121
testPN910 0.013

CounterPBConstrWithPBConstrLearningTest

testncirc43 0.821
testncirc63 3.415
testncirc83 19.437
testndata43 0.239
testndata63 2.628
testndata83 18.832
testn9symml 0.607
testnC17 0.005
testnC432 0.845
testnb1 0.018
testnc8 0.22
testncc 0.069
testncm42a 0.057
testncmb 0.534
testnmux 0.263
testnmyadder 0.788
testPN34 0.006
testPN4 0.01
testPN45 0.011
testPN5 0.017
testPN56 0.009
testPN6 0.023
testPN67 0.007
testPN7 0.035
testPN78 0.01
testPN8 0.061
testPN89 0.013
testPN9 0.1
testPN910 0.016

PuebloWatchedPBConstrWithClauseLearningTest

testncirc43 0.81
testncirc63 4.145
testncirc83 14.032
testndata43 0.24
testndata63 3.311
testndata83 13.585
testn9symml 0.613
testnC17 0.006
testnC432 0.941
testnb1 0.019
testnc8 0.216
testncc 0.074
testncm42a 0.055
testncmb 0.447
testnmux 0.242
testnmyadder 0.552
testPN34 0.006
testPN4 0.011
testPN45 0.011
testPN5 0.03
testPN56 0.012
testPN6 0.133
testPN67 0.011
testPN7 0.544
testPN78 0.012
testPN8 1.8
testPN89 0.016
testPN9 10.871
testPN910 0.024

CounterPBConstrWithCBClauseCardConstrLearningTest

testaloul1011 0.733
testaloul1015 0.206
testaloul1020 0.331
testaloul1516 1.532
testaloul1520 0.559
testaloul1525 0.787
testaloul2021 5.507
testaloul2025 1.354
testaloul2030 2.045
testaloul3031 30.476
Timeout: need more time to complete!
testaloul3035 5.841
testaloul3040 7.163
testaloul3536 31.261
Timeout: need more time to complete!
testaloul3540 8.705
testaloul3545 11.714
testaloul4041 32.855
Timeout: need more time to complete!
testaloul4045 14.16
testaloul4050 21.972
testaloul5051 30.663
Timeout: need more time to complete!
testaloul5055 35.307
Timeout: need more time to complete!
testaloul5060 42.399
Timeout: need more time to complete!
testPN10 0.146
testncirc43 0.265
testncirc63 5.075
testncirc83 13.955
testndata43 0.169
testndata63 4.558
testndata83 13.36
testn9symml 0.3
testnC17 0.013
testnC432 0.393
testnb1 0.008
testnc8 0.111
testncc 0.045
testncm42a 0.031
testncmb 0.15
testnmux 0.11
testnmyadder 0.301
testPN34 0.002
testPN4 0.004
testPN45 0.003
testPN5 0.009
testPN56 0.003
testPN6 0.016
testPN67 0.004
testPN7 0.029
testPN78 0.006
testPN8 0.052
testPN89 0.007
testPN9 0.089
testPN910 0.008

TestEclipseBug247567

testReserveVarsButUseLess 0.078

CounterPBConstrWithClauseLearningTest

testncirc43 0.767
testncirc63 3.127
testncirc83 9.888
testndata43 0.198
testndata63 2.377
testndata83 9.422
testn9symml 0.573
testnC17 0.006
testnC432 0.858
testnb1 0.015
testnc8 0.214
testncc 0.071
testncm42a 0.056
testncmb 0.521
testnmux 0.213
testnmyadder 0.573
testPN34 0.004
testPN4 0.01
testPN45 0.006
testPN5 0.018
testPN56 0.012
testPN6 0.062
testPN67 0.015
testPN7 0.279
testPN78 0.012
testPN8 1.133
testPN89 0.014
testPN9 5.604
testPN910 0.022

CounterPBWithClauseCardConstrLearningReduceToClauseTest

testncirc43 0.761
testncirc63 6.175
testncirc83 21.143
testndata43 0.17
testndata63 5.284
testndata83 20.259
testn9symml 0.295
testnC17 0.012
testnC432 0.398
testnb1 0.009
testnc8 0.112
testncc 0.038
testncm42a 0.031
testncmb 0.144
testnmux 0.113
testnmyadder 0.31
testPN34 0.006
testPN4 0.01
testPN45 0.006
testPN5 0.014
testPN56 0.012
testPN6 0.064
testPN67 0.005
testPN7 0.03
testPN78 0.006
testPN8 0.052
testPN89 0.008
testPN9 0.088
testPN910 0.009

PuebloWatchedPBConstrOnRandomCardProblemsTest

testRndDeg1 1.398
testRndDeg2 0.772
testRndDeg3 0.534
testRndDeg4 0.357
testRndDeg5 0.065
testRndDeg6 0.03
testRndDeg7 0.018
testRndDeg8 0.005
testRndDeg9 0.004
testRndDeg10 0.002
testRndDeg11 0.002
testRndDeg12 0.002
testRndDeg13 0.002
testRndDeg14 0.002
testRndDeg15 0.002
testRndDeg16 0.002
testRndDeg17 0.002
testRndDeg18 0.002
testPN34 0.004
testPN4 0.008
testPN45 0.006
testPN5 0.015
testPN56 0.009
testPN6 0.028
testPN67 0.011
testPN7 0.048
testPN78 0.015
testPN8 0.083
testPN89 0.02
testPN9 0.126
testPN910 0.025

PuebloWatchedPBConstrWithPBConstrLearningTest

testaloul1011 0.805
testaloul1015 0.255
testaloul1020 0.404
testaloul1516 1.705
testaloul1520 0.677
testaloul1525 0.925
testaloul2021 6.006
testaloul2025 1.569
testaloul2030 2.323
testaloul3031 30.579
Timeout: need more time to complete!
testaloul3035 6.438
testaloul3040 7.949
testaloul3536 33.578
Timeout: need more time to complete!
testaloul3540 9.724
testaloul3545 12.973
testaloul4041 35.882
Timeout: need more time to complete!
testaloul4045 15.836
testaloul4050 23.993
testaloul5051 34.797
Timeout: need more time to complete!
testaloul5055 38.565
Timeout: need more time to complete!
testaloul5060 45.613
Timeout: need more time to complete!
testPN10 0.175
testncirc43 0.357
testncirc63 5.336
testncirc83 36.413
Timeout: need more time to complete!
testndata43 0.287
testndata63 4.938
testndata83 36.164
Timeout: need more time to complete!
testn9symml 0.59
testnC17 0.006
testnC432 0.91
testnb1 0.016
testnc8 0.222
testncc 0.071
testncm42a 0.06
testncmb 0.411
testnmux 0.3
testnmyadder 0.631
testPN34 0.003
testPN4 0.005
testPN45 0.005
testPN5 0.01
testPN56 0.006
testPN6 0.019
testPN67 0.009
testPN7 0.036
testPN78 0.012
testPN8 0.062
testPN89 0.016
testPN9 0.104
testPN910 0.02

CounterPBConstrOnRandomCardProblemsTest

testRndDeg1 4.791
testRndDeg2 1.264
testRndDeg3 0.442
testRndDeg4 0.27
testRndDeg5 0.062
testRndDeg6 0.028
testRndDeg7 0.017
testRndDeg8 0.006
testRndDeg9 0.003
testRndDeg10 0.002
testRndDeg11 0.002
testRndDeg12 0.002
testRndDeg13 0.007
testRndDeg14 0.002
testRndDeg15 0.002
testRndDeg16 0.002
testRndDeg17 0.002
testRndDeg18 0.002
testPN34 0.007
testPN4 0.013
testPN45 0.007
testPN5 0.022
testPN56 0.008
testPN6 0.133
testPN67 0.01
testPN7 0.299
testPN78 0.013
testPN8 1.11
testPN89 0.016
testPN9 5.167
testPN910 0.018

Failure Details


testaloul3031
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul3536
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul4041
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5055
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5060
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul3031
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul3536
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul4041
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5055
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5060
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul3031
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul3536
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul4041
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5055
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5060
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testncirc83
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testndata83
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul3031
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul3536
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul4041
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5055
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5060
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul3031
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul3536
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul4041
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5055
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5060
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul3031
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul3536
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul4041
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5055
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5060
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testncirc83
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testndata83
junit.framework.AssertionFailedError: Timeout: need more time to complete!