Surefire Report

Summary


Tests Errors Failures Skipped Success Rate Time
698 0 32 0 95.415% 3,914.081

Note: failures are anticipated and checked for with assertions while errors are unanticipated.

Package List


Package Tests Errors Failures Skipped Success Rate Time
org.sat4j.pb.constraints 685 0 32 0 95.328% 3,908.758
org.sat4j.pb 13 0 0 0 100% 5.323

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.sat4j.pb

Class Tests Errors Failures Skipped Success Rate Time
TestDependencyHelper 11 0 0 0 100% 0.165
TestEclipseBug247567 1 0 0 0 100% 0.094
TestEclipseBug275101 1 0 0 0 100% 5.064

Test Cases

PuebloWatchedPBClauseCardConstrWithPBConstrLearningTest

testaloul1011 0.763
testaloul1015 0.179
testaloul1020 0.291
testaloul1516 1.474
testaloul1520 0.55
testaloul1525 0.722
testaloul2021 5.45
testaloul2025 1.257
testaloul2030 1.952
testaloul3031 37.554
testaloul3035 5.559
testaloul3040 6.968
testaloul3536 62.617
Timeout: need more time to complete!
testaloul3540 8.462
testaloul3545 11.356
testaloul4041 63.925
Timeout: need more time to complete!
testaloul4045 13.851
testaloul4050 21.607
testaloul5051 67.704
Timeout: need more time to complete!
testaloul5055 34.687
testaloul5060 41.415
testncirc103 67.013
Timeout: need more time to complete!
testndata103 65.942
Timeout: need more time to complete!
testPN10 0.14
testncirc43 0.092
testncirc63 4.127
testncirc83 11.715
testndata43 0.086
testndata63 4.108
testndata83 11.8
testn9symml 0.085
testnC17 0.007
testnC432 0.117
testnb1 0.011
testnc8 0.045
testncc 0.019
testncm42a 0.019
testncmb 0.046
testnmux 0.099
testnmyadder 0.152
testPN34 0.001
testPN4 0.003
testPN45 0.001
testPN5 0.007
testPN56 0.002
testPN6 0.014
testPN67 0.002
testPN7 0.027
testPN78 0.003
testPN8 0.048
testPN89 0.004
testPN9 0.083
testPN910 0.004

CounterPBConstrWithPBConstrLearningTest

testncirc43 0.875
testncirc63 2.652
testncirc83 16.65
testndata43 0.169
testndata63 1.987
testndata83 15.979
testn9symml 0.35
testnC17 0.003
testnC432 0.559
testnb1 0.01
testnc8 0.152
testncc 0.043
testncm42a 0.038
testncmb 0.428
testnmux 0.195
testnmyadder 0.621
testPN34 0.005
testPN4 0.01
testPN45 0.011
testPN5 0.016
testPN56 0.005
testPN6 0.025
testPN67 0.005
testPN7 0.032
testPN78 0.007
testPN8 0.058
testPN89 0.01
testPN9 0.097
testPN910 0.012

CounterPBConstrWithClauseLearningTest

testncirc43 0.705
testncirc63 2.308
testncirc83 6.99
testndata43 0.11
testndata63 1.721
testndata83 6.584
testn9symml 0.347
testnC17 0.004
testnC432 0.556
testnb1 0.012
testnc8 0.143
testncc 0.062
testncm42a 0.036
testncmb 0.419
testnmux 0.141
testnmyadder 0.41
testPN34 0.003
testPN4 0.006
testPN45 0.006
testPN5 0.014
testPN56 0.006
testPN6 0.062
testPN67 0.005
testPN7 0.264
testPN78 0.01
testPN8 1.115
testPN89 0.009
testPN9 5.478
testPN910 0.013

TestDependencyHelper

testBasicRequirements 0.073
testBasicRequirementsDetailedExplanation 0.006
testDisjunctions 0.013
testDisjunctionExplanation 0.015
testExplanationForASolution 0.006
testObjectiveFunction 0.01
testJunitExample 0.004
testJunitSingletonObjectiveExample 0.004
testEquivalency 0.003
testDisjunction 0.004
testCathyExamples 0.01

WatchedPBConstrOnRandomCardProblemsTest

testRndDeg1 3.412
testRndDeg2 1.001
testRndDeg3 0.461
testRndDeg4 0.16
testRndDeg5 0.042
testRndDeg6 0.02
testRndDeg7 0.012
testRndDeg8 0.003
testRndDeg9 0.002
testRndDeg10 0.001
testRndDeg11 0.002
testRndDeg12 0.001
testRndDeg13 0.001
testRndDeg14 0.001
testRndDeg15 0.001
testRndDeg16 0.001
testRndDeg17 0.002
testRndDeg18 0.001
testPN34 0.006
testPN4 0.012
testPN45 0.005
testPN5 0.036
testPN56 0.022
testPN6 0.147
testPN67 0.008
testPN7 0.565
testPN78 0.011
testPN8 1.904
testPN89 0.014
testPN9 10.965
testPN910 0.018

PuebloWatchedPbClauseAtLeastConstrWithPBConstrLearningTest

testaloul1011 0.822
testaloul1015 0.188
testaloul1020 0.292
testaloul1516 1.463
testaloul1520 0.513
testaloul1525 0.717
testaloul2021 5.311
testaloul2025 1.249
testaloul2030 2.05
testaloul3031 37.092
testaloul3035 5.548
testaloul3040 6.957
testaloul3536 61.644
Timeout: need more time to complete!
testaloul3540 8.429
testaloul3545 11.339
testaloul4041 63.531
Timeout: need more time to complete!
testaloul4045 13.856
testaloul4050 21.56
testaloul5051 67.3
Timeout: need more time to complete!
testaloul5055 34.579
testaloul5060 41.283
testncirc103 66.652
Timeout: need more time to complete!
testndata103 66.215
Timeout: need more time to complete!
testPN10 0.14
testncirc43 0.094
testncirc63 2.505
testncirc83 9.686
testndata43 0.077
testndata63 2.516
testndata83 9.664
testn9symml 0.083
testnC17 0.009
testnC432 0.122
testnb1 0.014
testnc8 0.048
testncc 0.02
testncm42a 0.021
testncmb 0.057
testnmux 0.063
testnmyadder 0.146
testPN34 0.002
testPN4 0.003
testPN45 0.001
testPN5 0.007
testPN56 0.002
testPN6 0.014
testPN67 0.002
testPN7 0.027
testPN78 0.002
testPN8 0.048
testPN89 0.003
testPN9 0.083
testPN910 0.003

WatchedPBConstrWithPBConstrLearningTest

testaloul1011 0.784
testaloul1015 0.226
testaloul1020 0.365
testaloul1516 1.652
testaloul1520 0.633
testaloul1525 0.865
testaloul2021 5.896
testaloul2025 1.476
testaloul2030 2.242
testaloul3031 40.143
testaloul3035 6.287
testaloul3040 7.689
testaloul3536 62.446
Timeout: need more time to complete!
testaloul3540 9.561
testaloul3545 12.712
testaloul4041 61.407
Timeout: need more time to complete!
testaloul4045 15.57
testaloul4050 23.674
testaloul5051 61.89
Timeout: need more time to complete!
testaloul5055 37.853
testaloul5060 45.196
testncirc103 68.79
Timeout: need more time to complete!
testndata103 67.988
Timeout: need more time to complete!
testPN10 0.198
testncirc43 0.221
testncirc63 4.16
testncirc83 51.231
testndata43 0.188
testndata63 4.152
testndata83 51.232
testn9symml 0.388
testnC17 0.004
testnC432 0.659
testnb1 0.011
testnc8 0.155
testncc 0.046
testncm42a 0.036
testncmb 0.345
testnmux 0.258
testnmyadder 0.502
testPN34 0.003
testPN4 0.005
testPN45 0.003
testPN5 0.009
testPN56 0.005
testPN6 0.018
testPN67 0.007
testPN7 0.033
testPN78 0.01
testPN8 0.084
testPN89 0.013
testPN9 0.117
testPN910 0.016

CounterPBConstrWithClauseAtLeastConstrLearningTest

testaloul1011 0.739
testaloul1015 0.181
testaloul1020 0.292
testaloul1516 1.458
testaloul1520 0.513
testaloul1525 0.716
testaloul2021 5.313
testaloul2025 1.241
testaloul2030 2.002
testaloul3031 36.975
testaloul3035 5.604
testaloul3040 6.986
testaloul3536 61.263
Timeout: need more time to complete!
testaloul3540 8.508
testaloul3545 11.522
testaloul4041 64.056
Timeout: need more time to complete!
testaloul4045 14.118
testaloul4050 22.009
testaloul5051 67.659
Timeout: need more time to complete!
testaloul5055 35.1
testaloul5060 42.109
testncirc103 68.166
Timeout: need more time to complete!
testndata103 67.193
Timeout: need more time to complete!
testPN10 0.155
testncirc43 0.079
testncirc63 2.365
testncirc83 5.84
testndata43 0.073
testndata63 2.315
testndata83 5.772
testn9symml 0.095
testnC17 0.001
testnC432 0.108
testnb1 0.006
testnc8 0.048
testncc 0.018
testncm42a 0.013
testncmb 0.049
testnmux 0.048
testnmyadder 0.146
testPN34 0.002
testPN4 0.003
testPN45 0.002
testPN5 0.007
testPN56 0.002
testPN6 0.014
testPN67 0.002
testPN7 0.027
testPN78 0.003
testPN8 0.049
testPN89 0.003
testPN9 0.084
testPN910 0.003

CounterPBWithClauseCardConstrLearningReduceToClauseTest

testncirc43 0.682
testncirc63 10.773
testncirc83 16.453
testndata43 0.09
testndata63 9.943
testndata83 15.965
testn9symml 0.095
testnC17 0.002
testnC432 0.117
testnb1 0.006
testnc8 0.05
testncc 0.02
testncm42a 0.015
testncmb 0.052
testnmux 0.052
testnmyadder 0.15
testPN34 0.005
testPN4 0.008
testPN45 0.002
testPN5 0.007
testPN56 0.002
testPN6 0.014
testPN67 0.003
testPN7 0.028
testPN78 0.003
testPN8 0.05
testPN89 0.004
testPN9 0.087
testPN910 0.005

TestEclipseBug247567

testReserveVarsButUseLess 0.079

TestEclipseBug275101

testReserveVarsButUseLess 5.047

TestQuickExplainPB

testGlobalInconsistency 0.066
testGlobalInconsistencyPB 0.016
testAlmostGlobalInconsistency 0.004
testAlmostGlobalInconsistencyII 0.004
testAlmostGlobalInconsistencyPB 0.009
testEclipsePatchEncoding 0.012
testUpdatedEclipsePatchEncoding 0.01

CounterCardConstrOnRandomCardProblemsTest

testRndDeg1 0.343
testRndDeg2 0.168
testRndDeg3 0.138
testRndDeg4 0.078
testRndDeg5 0.019
testRndDeg6 0.009
testRndDeg7 0.005
testRndDeg8 0.002
testRndDeg9 0.001
testRndDeg10 0.001
testRndDeg11 0.001
testRndDeg12 0
testRndDeg13 0.001
testRndDeg14 0.001
testRndDeg15 0.001
testRndDeg16 0.001
testRndDeg17 0.001
testRndDeg18 0
testPN34 0.005
testPN4 0.01
testPN45 0.003
testPN5 0.014
testPN56 0.003
testPN6 0.026
testPN67 0.004
testPN7 0.04
testPN78 0.005
testPN8 0.071
testPN89 0.006
testPN9 0.117
testPN910 0.006

WatchedPBConstrWithClauseLearningTest

testncirc43 0.801
testncirc63 3.312
testncirc83 11.392
testndata43 0.152
testndata63 2.683
testndata83 10.566
testn9symml 0.421
testnC17 0.008
testnC432 0.636
testnb1 0.014
testnc8 0.15
testncc 0.048
testncm42a 0.039
testncmb 0.319
testnmux 0.166
testnmyadder 0.409
testPN34 0.004
testPN4 0.011
testPN45 0.007
testPN5 0.031
testPN56 0.006
testPN6 0.126
testPN67 0.007
testPN7 0.508
testPN78 0.009
testPN8 1.812
testPN89 0.012
testPN9 10.94
testPN910 0.018

PuebloWatchedPBConstrWithPBConstrLearningTest

testaloul1011 0.76
testaloul1015 0.224
testaloul1020 0.367
testaloul1516 1.661
testaloul1520 0.632
testaloul1525 0.864
testaloul2021 5.943
testaloul2025 1.495
testaloul2030 2.24
testaloul3031 40.186
testaloul3035 6.292
testaloul3040 7.742
testaloul3536 62.183
Timeout: need more time to complete!
testaloul3540 9.486
testaloul3545 12.63
testaloul4041 61.806
Timeout: need more time to complete!
testaloul4045 15.499
testaloul4050 23.6
testaloul5051 62.898
Timeout: need more time to complete!
testaloul5055 37.905
testaloul5060 45.097
testncirc103 68.621
Timeout: need more time to complete!
testndata103 67.389
Timeout: need more time to complete!
testPN10 0.189
testncirc43 0.191
testncirc63 4.242
testncirc83 51.81
testndata43 0.184
testndata63 4.169
testndata83 51.758
testn9symml 0.375
testnC17 0.004
testnC432 0.613
testnb1 0.011
testnc8 0.15
testncc 0.045
testncm42a 0.034
testncmb 0.31
testnmux 0.224
testnmyadder 0.459
testPN34 0.002
testPN4 0.004
testPN45 0.003
testPN5 0.009
testPN56 0.005
testPN6 0.018
testPN67 0.007
testPN7 0.033
testPN78 0.009
testPN8 0.058
testPN89 0.012
testPN9 0.099
testPN910 0.015

PuebloWatchedPBConstrWithClauseLearningTest

testncirc43 0.811
testncirc63 3.264
testncirc83 11.35
testndata43 0.153
testndata63 2.704
testndata83 10.915
testn9symml 0.426
testnC17 0.008
testnC432 0.652
testnb1 0.015
testnc8 0.173
testncc 0.052
testncm42a 0.057
testncmb 0.323
testnmux 0.169
testnmyadder 0.406
testPN34 0.004
testPN4 0.011
testPN45 0.007
testPN5 0.029
testPN56 0.035
testPN6 0.128
testPN67 0.009
testPN7 0.525
testPN78 0.01
testPN8 1.869
testPN89 0.013
testPN9 10.065
testPN910 0.017

CounterPBConstrWithCBClauseCardConstrLearningTest

testaloul1011 0.756
testaloul1015 0.181
testaloul1020 0.292
testaloul1516 1.444
testaloul1520 0.516
testaloul1525 0.717
testaloul2021 5.258
testaloul2025 1.249
testaloul2030 1.945
testaloul3031 36.936
testaloul3035 5.678
testaloul3040 7.039
testaloul3536 61.509
Timeout: need more time to complete!
testaloul3540 8.441
testaloul3545 11.412
testaloul4041 63.759
Timeout: need more time to complete!
testaloul4045 13.914
testaloul4050 21.679
testaloul5051 66.999
Timeout: need more time to complete!
testaloul5055 34.61
testaloul5060 41.548
testncirc103 68.78
Timeout: need more time to complete!
testndata103 67.724
Timeout: need more time to complete!
testPN10 0.14
testncirc43 0.084
testncirc63 3.862
testncirc83 62.44
Timeout: need more time to complete!
testndata43 0.078
testndata63 3.883
testndata83 62.458
Timeout: need more time to complete!
testn9symml 0.084
testnC17 0.006
testnC432 0.116
testnb1 0.003
testnc8 0.041
testncc 0.011
testncm42a 0.011
testncmb 0.05
testnmux 0.039
testnmyadder 0.143
testPN34 0.001
testPN4 0.003
testPN45 0.001
testPN5 0.007
testPN56 0.001
testPN6 0.013
testPN67 0.002
testPN7 0.026
testPN78 0.002
testPN8 0.048
testPN89 0.003
testPN9 0.082
testPN910 0.003

MyCounterCardConstrOnRandomCardProblemsTest

testRndDeg1 0.346
testRndDeg2 0.17
testRndDeg3 0.14
testRndDeg4 0.077
testRndDeg5 0.019
testRndDeg6 0.009
testRndDeg7 0.006
testRndDeg8 0.002
testRndDeg9 0.001
testRndDeg10 0.001
testRndDeg11 0.001
testRndDeg12 0.001
testRndDeg13 0.001
testRndDeg14 0.001
testRndDeg15 0.001
testRndDeg16 0.001
testRndDeg17 0.001
testRndDeg18 0.001
testPN34 0.005
testPN4 0.01
testPN45 0.003
testPN5 0.013
testPN56 0.003
testPN6 0.025
testPN67 0.004
testPN7 0.04
testPN78 0.005
testPN8 0.081
testPN89 0.005
testPN9 0.129
testPN910 0.006

PuebloWatchedPBConstrOnRandomCardProblemsTest

testRndDeg1 1.416
testRndDeg2 0.62
testRndDeg3 0.378
testRndDeg4 0.166
testRndDeg5 0.039
testRndDeg6 0.018
testRndDeg7 0.011
testRndDeg8 0.003
testRndDeg9 0.002
testRndDeg10 0.001
testRndDeg11 0.001
testRndDeg12 0.001
testRndDeg13 0.001
testRndDeg14 0.001
testRndDeg15 0.001
testRndDeg16 0.001
testRndDeg17 0.001
testRndDeg18 0.001
testPN34 0.003
testPN4 0.007
testPN45 0.004
testPN5 0.015
testPN56 0.006
testPN6 0.029
testPN67 0.008
testPN7 0.045
testPN78 0.011
testPN8 0.079
testPN89 0.014
testPN9 0.126
testPN910 0.019

CounterPBConstrOnRandomCardProblemsTest

testRndDeg1 4.615
testRndDeg2 1.106
testRndDeg3 0.286
testRndDeg4 0.127
testRndDeg5 0.032
testRndDeg6 0.014
testRndDeg7 0.008
testRndDeg8 0.003
testRndDeg9 0.002
testRndDeg10 0.001
testRndDeg11 0.001
testRndDeg12 0.001
testRndDeg13 0.001
testRndDeg14 0.001
testRndDeg15 0.001
testRndDeg16 0.001
testRndDeg17 0.001
testRndDeg18 0.001
testPN34 0.065
testPN4 0.005
testPN45 0.003
testPN5 0.019
testPN56 0.017
testPN6 0.102
testPN67 0.008
testPN7 0.281
testPN78 0.01
testPN8 1.088
testPN89 0.012
testPN9 5.359
testPN910 0.012

WatchedCardConstrOnRandomCardProblemsTest

testRndDeg1 0.386
testRndDeg2 0.167
testRndDeg3 0.14
testRndDeg4 0.08
testRndDeg5 0.02
testRndDeg6 0.009
testRndDeg7 0.006
testRndDeg8 0.002
testRndDeg9 0.002
testRndDeg10 0.001
testRndDeg11 0.001
testRndDeg12 0.001
testRndDeg13 0.001
testRndDeg14 0.001
testRndDeg15 0.001
testRndDeg16 0.001
testRndDeg17 0.001
testRndDeg18 0.001
testPN34 0.004
testPN4 0.005
testPN45 0.002
testPN5 0.013
testPN56 0.003
testPN6 0.023
testPN67 0.004
testPN7 0.039
testPN78 0.004
testPN8 0.071
testPN89 0.005
testPN9 0.114
testPN910 0.006

CounterPBConstrWithClauseCardConstrLearningTest

testncirc43 0.689
testncirc63 13.937
testncirc83 17.11
testndata43 0.085
testndata63 13.084
testndata83 16.687
testn9symml 0.088
testnC17 0.008
testnC432 0.151
testnb1 0.005
testnc8 0.054
testncc 0.021
testncm42a 0.014
testncmb 0.075
testnmux 0.054
testnmyadder 0.182
testPN34 0.002
testPN4 0.012
testPN45 0.002
testPN5 0.007
testPN56 0.002
testPN6 0.014
testPN67 0.003
testPN7 0.028
testPN78 0.003
testPN8 0.05
testPN89 0.003
testPN9 0.124
testPN910 0.005

Failure Details


testaloul3536
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul4041
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testncirc103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testndata103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul3536
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul4041
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testncirc103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testndata103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul3536
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul4041
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testncirc103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testndata103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul3536
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul4041
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testncirc103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testndata103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul3536
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul4041
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testncirc103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testndata103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul3536
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul4041
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testaloul5051
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testncirc103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testndata103
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testncirc83
junit.framework.AssertionFailedError: Timeout: need more time to complete!
testndata83
junit.framework.AssertionFailedError: Timeout: need more time to complete!