Surefire Report

Summary

[Summary] [Package List] [Test Cases]


TestsErrors FailuresSkippedSuccess RateTime
1017000100%278.915

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


PackageTestsErrors FailuresSkippedSuccess RateTime
org.sat4j.pb.constraints951000100%271.856
org.sat4j.pb66000100%7.059

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.sat4j.pb

ClassTestsErrors FailuresSkippedSuccess RateTime
TestEclipseBug2475671000100%0.183
LexicoDecoratorPBTest1000100%0.148
TestEclipseBug2751011000100%0.679
TestQuickXplain10000100%0.232
TestDependencyHelper21000100%0.358
JsonPBReaderTest8000100%0.704
TestInsertionXplain10000100%0.249
TestDeletionXplain10000100%0.259
TestObjectiveFunction1000100%0.164
MikolasTest1000100%0.153
TestGlobalTimeoutForOptimalModelEnumeration2000100%3.93

Test Cases

[Summary] [Package List] [Test Cases]

CounterPBConstrWithClauseCardConstrLearningTest

testncirc631.964
testncirc831.173
testncirc430.028
testndata430.026
testndata630.497
testndata830.83
testn9symml0.072
testnC170.001
testnC4320.065
testnb10.006
testnc80.031
testncc0.008
testncm42a0.006
testncmb0.026
testnmux0.018
testnmyadder0.04
testPN40.002
testPN450.002
testPN50.002
testPN560.002
testPN60.002
testPN670.003
testPN70.006
testPN780.003
testPN80.009
testPN890.002
testPN90.004
testPN9100.003
testPN340.004

PuebloWatchedPBConstrWithClauseLearningTest

testncirc430.474
testncirc630.873
testncirc830.865
testndata430.02
testndata630.172
testndata830.702
testn9symml0.053
testnC170.002
testnC4320.061
testnb10.002
testnc80.016
testncc0.007
testncm42a0.006
testncmb0.022
testnmux0.015
testnmyadder0.038
testPN450.001
testPN50.002
testPN560.001
testPN60.005
testPN670.002
testPN70.058
testPN780.002
testPN80.07
testPN890.003
testPN90.324
testPN9100.003
testPN340.001
testPN40.001

WatchedPBConstrWithPBConstrLearningTest

testncirc10318.125
testaloul35450.171
testaloul40411.296
testaloul40450.148
testaloul40500.215
testaloul50513.625
testaloul50550.346
testaloul50600.428
testPN100.005
testaloul10150.005
testaloul10200.006
testaloul15160.019
testaloul10110.006
testaloul35400.107
testndata10316.541
testaloul15200.01
testaloul15250.012
testaloul20210.052
testaloul20250.018
testaloul20300.025
testaloul30310.351
testaloul30350.063
testaloul30400.087
testaloul35360.662
testncm42a0.004
testncirc430.017
testncirc630.163
testncirc830.73
testndata430.018
testndata630.143
testndata830.727
testn9symml0.042
testnC170.001
testnC4320.081
testnb10.002
testnc80.014
testncc0.006
testncmb0.019
testnmux0.014
testnmyadder0.034
testPN340.001
testPN40
testPN450.001
testPN50.001
testPN560.001
testPN60.002
testPN670.001
testPN70.002
testPN780.001
testPN80.002
testPN890.002
testPN90.003
testPN9100.003

TestEclipseBug247567

testReserveVarsButUseLess0.107

LexicoDecoratorPBTest

test0.075

MiniOPBClauseCardMinLearningTest

testaloul10110.443
testaloul40412.128
testaloul40450.317
testaloul40500.384
testaloul50513.906
testaloul50550.384
testaloul50600.412
testncirc1034.542
testndata1033.91
testPN100.012
testaloul10200.01
testaloul10150.008
testaloul15160.03
testaloul15200.017
testaloul15250.023
testaloul20210.061
testaloul20250.018
testaloul20300.028
testaloul30310.345
testaloul30350.067
testaloul30400.074
testaloul35360.703
testaloul35400.09
testaloul35450.109
testncirc430.029
testncirc630.161
testncirc830.6
testndata430.019
testndata630.167
testndata830.568
testn9symml0.043
testnC170.013
testnC4320.065
testnb10.002
testnc80.015
testncc0.006
testncm42a0.005
testncmb0.019
testnmux0.015
testnmyadder0.035
testPN340.002
testPN40.001
testPN450.001
testPN50.002
testPN560.002
testPN60.002
testPN670.002
testPN70.002
testPN780.002
testPN80.003
testPN890.002
testPN90.003
testPN9100.003

CounterPBConstrWithClauseAtLeastConstrLearningTest

testaloul10110.306
testncirc1033.582
testaloul15160.028
testndata1032.151
testaloul35450.12
testaloul40411.3
testaloul40450.145
testaloul40500.215
testaloul50513.674
testaloul50550.348
testaloul50600.391
testPN100.005
testaloul10200.006
testaloul10150.004
testaloul15200.01
testaloul15250.014
testaloul20210.075
testaloul20250.02
testaloul20300.026
testaloul30310.345
testaloul30350.073
testaloul30400.075
testaloul35360.683
testaloul35400.089
testncm42a0.008
testncirc430.016
testncirc630.172
testncirc830.61
testndata430.016
testndata630.168
testndata830.569
testn9symml0.048
testnC170.012
testnC4320.055
testnb10.002
testnc80.016
testncc0.006
testncmb0.026
testnmux0.016
testnmyadder0.039
testPN40.001
testPN340.001
testPN450.002
testPN50.001
testPN560.002
testPN60.002
testPN670.002
testPN70.002
testPN780.002
testPN80.003
testPN890.003
testPN90.003
testPN9100.003

TestEclipseBug275101

testReserveVarsButUseLess0.607

TestQuickXplain

testExactlyConstraint0.085
testGlobalInconsistency0.005
testGlobalInconsistencyIndex0.006
testAlmostGlobalInconsistency0.008
testAlmostGlobalInconsistencyIndex0.006
testAlmostGlobalInconsistencyII0.007
testAlmostGlobalInconsistencyIIIndex0.006
testTheCaseOfTwoMUSes0.006
testEclipseTestCase0.006
testEclipseTestCase20.005

PBCPMixedConstraintsResCPTest

testncirc831.982
testndata430.053
testndata630.204
testncirc630.175
testncirc430.018
testndata830.672
testn9symml0.049
testnC170.002
testnC4320.06
testnb10.002
testnc80.015
testncc0.007
testncm42a0.006
testncmb0.021
testnmux0.015
testnmyadder0.049
testPN560.002
testPN60.005
testPN670.002
testPN70.016
testPN780.002
testPN80.053
testPN890.002
testPN90.2
testPN9100.003
testPN340.002
testPN40.001
testPN450.001
testPN50.002

PBCPMinClauseCardConstrLearningTest

testaloul35451.105
testaloul40411.76
testaloul40450.266
testaloul40500.26
testaloul50513.832
testaloul50550.36
testaloul50600.424
testncirc1034.396
testndata1033.89
testPN100.019
testaloul10110.015
testaloul15160.025
testaloul10150.009
testaloul10200.014
testaloul15200.018
testaloul15250.023
testaloul20210.059
testaloul20250.02
testaloul20300.033
testaloul30310.359
testaloul30350.066
testaloul30400.069
testaloul35360.695
testaloul35400.092
testncm42a0.01
testncirc430.017
testncirc630.174
testncirc830.599
testndata430.019
testndata630.158
testndata830.576
testn9symml0.048
testnC170.001
testnC4320.062
testnb10.002
testnc80.014
testncc0.006
testncmb0.02
testnmux0.014
testnmyadder0.035
testPN340.003
testPN40.001
testPN450.001
testPN50.001
testPN560.002
testPN60.002
testPN670.001
testPN70.002
testPN780.001
testPN80.002
testPN890.002
testPN90.003
testPN9100.002

TestDependencyHelper

testDisjunctionExplanation0.122
testExplanationForASolution0.008
testObjectiveFunction0.015
testJunitExample0.007
testJunitSingletonObjectiveExample0.005
testEquivalency0.005
testDisjunction0.006
testCathyExamples0.009
testCardinalityConstraints0.007
testPseudoConstraints0.006
testPseudoConstraintsNegativeLiterals0.005
testIgnoreContiguousDuplicatedEntry0.004
testNonDuplicatedEntryNotCatched0.004
testLimitofHashFunction0.004
testVariablesIntroducedInNegativeFormFirst0.005
testVariablesIntroducedInNegativeFormFirstStoredCorrectly0.005
testThatWeCanRetrieveTheTruthValueOfNegatedObjects0.004
testImpliedObjects0.006
testBasicRequirementsDetailedExplanation0.006
testDisjunctions0.005
testBasicRequirements0.006

JsonPBReaderTest

testReadingSimplePseudoAtMost0.382
testReadingSimplePseudoExactly0.047
testReadingSimplePseudoAtLeastStrictly0.029
testReadingSimplePseudoAtMostStrictly0.029
testOrderofMixedConstraints0.038
testReadingSimplePseudoAtLeast0.025
testObjectiveFunctionMin0.033
testObjectiveFunctionMax0.026

CounterPBConstrWithClauseLearningTest

testncirc832.65
testncirc630.288
testncirc430.025
testndata430.025
testndata630.21
testndata831.132
testn9symml0.054
testnC170.001
testnC4320.076
testnb10.006
testnc80.018
testncc0.008
testncm42a0.006
testncmb0.035
testnmux0.019
testnmyadder0.047
testPN50.008
testPN560.004
testPN60.007
testPN670.003
testPN70.056
testPN780.004
testPN80.072
testPN890.004
testPN90.386
testPN9100.008
testPN340.003
testPN40.002
testPN450.002

CompetPBResLongWLMixedConstraintsObjectiveLearningTest

testncirc430.503
testncirc630.895
testncirc830.823
testndata430.032
testndata630.141
testndata830.6
testn9symml0.065
testnC170.001
testnC4320.061
testnb10.006
testnc80.016
testncc0.007
testncm42a0.006
testncmb0.021
testnmux0.015
testnmyadder0.037
testPN340.001
testPN40.002
testPN450.001
testPN50.002
testPN560.002
testPN60.005
testPN670.003
testPN70.018
testPN80.158
testPN890.003
testPN92.037
testPN9100.004
testPN780.003

TestInsertionXplain

testExactlyConstraint0.091
testGlobalInconsistency0.007
testGlobalInconsistencyIndex0.007
testAlmostGlobalInconsistency0.009
testAlmostGlobalInconsistencyIndex0.007
testAlmostGlobalInconsistencyII0.007
testAlmostGlobalInconsistencyIIIndex0.006
testTheCaseOfTwoMUSes0.007
testEclipseTestCase0.007
testEclipseTestCase20.007

PBCPLongMaxClauseCardConstrLearningTest

testaloul35451.003
testaloul40411.691
testaloul40450.251
testaloul40500.242
testaloul50513.787
testaloul50550.363
testaloul50600.419
testndata1032.968
testPN100.006
testncirc1032.206
testaloul10110.005
testaloul10150.007
testaloul10200.006
testaloul15160.018
testaloul15200.03
testaloul15250.013
testaloul20210.06
testaloul20250.024
testaloul20300.029
testaloul30310.37
testaloul30350.071
testaloul30400.074
testaloul35360.728
testaloul35400.1
testncm42a0.009
testncirc430.027
testncirc630.26
testncirc830.629
testndata430.017
testndata630.24
testndata830.619
testn9symml0.043
testnC170.003
testnC4320.061
testnb10.008
testnc80.021
testncc0.01
testncmb0.02
testnmux0.016
testnmyadder0.045
testPN340.005
testPN40.007
testPN450.001
testPN50.001
testPN560.004
testPN60.006
testPN670.004
testPN70.003
testPN780.002
testPN80.003
testPN890.003
testPN90.004
testPN9100.003

PuebloWatchedPBConstrWithPBConstrLearningTest

testaloul35451.081
testaloul40411.694
testaloul40450.267
testaloul40500.241
testaloul50513.621
testaloul50550.373
testaloul50600.417
testncirc10312.228
testndata10311.912
testPN100.033
testaloul10110.01
testaloul10150.017
testaloul10200.015
testaloul15160.024
testaloul15200.012
testaloul15250.016
testaloul20210.056
testaloul20250.025
testaloul20300.026
testaloul30310.339
testaloul30350.077
testaloul30400.075
testaloul35360.694
testaloul35400.093
testncm42a0.008
testncirc430.03
testncirc630.167
testncirc830.864
testndata430.036
testndata630.154
testndata830.746
testn9symml0.045
testnC170.008
testnC4320.079
testnb10.009
testnc80.043
testncc0.023
testncmb0.027
testnmux0.017
testnmyadder0.046
testPN340.002
testPN40.002
testPN450.004
testPN50.003
testPN560.008
testPN60.002
testPN670.002
testPN70.002
testPN780.002
testPN80.003
testPN890.002
testPN90.004
testPN9100.009

WatchedPBConstrWithClauseLearningTest

testncirc631.287
testncirc430.09
testncirc830.895
testndata430.019
testndata630.144
testndata830.717
testn9symml0.045
testnC170.001
testnC4320.06
testnb10.003
testnc80.017
testncc0.006
testncm42a0.005
testncmb0.021
testnmux0.015
testnmyadder0.038
testPN450.002
testPN50.003
testPN560.001
testPN60.006
testPN670.002
testPN70.061
testPN780.002
testPN80.078
testPN890.003
testPN90.395
testPN9100.004
testPN340.001
testPN40.002

TestDeletionXplain

testExactlyConstraint0.112
testGlobalInconsistency0.004
testGlobalInconsistencyIndex0.005
testAlmostGlobalInconsistency0.006
testAlmostGlobalInconsistencyIndex0.005
testAlmostGlobalInconsistencyII0.005
testAlmostGlobalInconsistencyIIIndex0.006
testTheCaseOfTwoMUSes0.005
testEclipseTestCase0.006
testEclipseTestCase20.005

CounterPBConstrOnRandomCardProblemsTest

testRndDeg10.512
testRndDeg40.144
testRndDeg50.029
testRndDeg60.014
testRndDeg70.008
testRndDeg80.002
testRndDeg90.002
testRndDeg100.001
testRndDeg110.001
testRndDeg120.001
testRndDeg130.001
testRndDeg140.001
testRndDeg150.001
testRndDeg160.001
testRndDeg170.001
testRndDeg180.002
testRndDeg20.155
testRndDeg30.113
testPN340.003
testPN40.003
testPN450.004
testPN50.008
testPN560.004
testPN60.032
testPN670.005
testPN70.103
testPN780.005
testPN80.103
testPN890.004
testPN90.425
testPN9100.004

PBCPLongMinClauseCardConstrLearningTest

testaloul35450.983
testaloul40411.619
testaloul40450.252
testaloul40500.247
testaloul50513.682
testaloul50550.369
testaloul50600.418
testndata1034.188
testPN100.007
testncirc1033.72
testaloul10110.005
testaloul10150.006
testaloul10200.007
testaloul15160.02
testaloul15200.012
testaloul15250.012
testaloul20210.065
testaloul20250.019
testaloul20300.023
testaloul30310.353
testaloul30350.066
testaloul30400.068
testaloul35360.679
testaloul35400.096
testncm42a0.006
testncirc430.017
testncirc630.144
testncirc830.537
testndata430.019
testndata630.154
testndata830.521
testn9symml0.051
testnC170.001
testnC4320.057
testnb10.002
testnc80.017
testncc0.007
testncmb0.023
testnmux0.015
testnmyadder0.038
testPN340.002
testPN40.001
testPN450.002
testPN50.002
testPN560.001
testPN60.001
testPN670.001
testPN70.002
testPN780.002
testPN80.002
testPN890.003
testPN90.003
testPN9100.003

CounterPBWithClauseCardConstrLearningReduceToClauseTest

testncirc430.612
testncirc631.256
testncirc831.066
testndata430.027
testndata630.389
testndata830.773
testn9symml0.062
testnC170.002
testnC4320.085
testnb10.007
testnc80.017
testncc0.01
testncm42a0.009
testncmb0.028
testnmux0.016
testnmyadder0.038
testPN40.002
testPN450.001
testPN50.002
testPN560.002
testPN60.006
testPN670.003
testPN70.004
testPN780.003
testPN80.004
testPN890.005
testPN90.005
testPN9100.004
testPN340.007

TestObjectiveFunction

testObjectiveFunctionWithAllWeightsToNull0.093

WatchedCardConstrOnRandomCardProblemsTest

testRndDeg60.131
testRndDeg70.029
testRndDeg80.005
testRndDeg90.004
testRndDeg100.002
testRndDeg110.002
testRndDeg120.002
testRndDeg130.002
testRndDeg140.002
testRndDeg150.002
testRndDeg160.002
testRndDeg170.002
testRndDeg180.002
testRndDeg10.232
testRndDeg20.154
testRndDeg30.163
testRndDeg40.1
testRndDeg50.032
testPN340.008
testPN40.005
testPN450.011
testPN50.006
testPN560.012
testPN60.008
testPN670.006
testPN70.012
testPN780.005
testPN80.019
testPN890.006
testPN90.041
testPN9100.009

PuebloWatchedPbClauseAtLeastConstrWithPBConstrLearningTest

testaloul10110.38
testaloul35400.714
testaloul35450.271
testaloul40411.619
testaloul40450.228
testaloul40500.217
testaloul50513.78
testaloul50550.373
testaloul50600.413
testncirc1032.553
testndata1031.949
testPN100.006
testaloul10200.006
testaloul10150.042
testaloul15160.025
testaloul15200.009
testaloul15250.028
testaloul20210.056
testaloul20250.02
testaloul20300.027
testaloul30310.358
testaloul30350.066
testaloul30400.08
testaloul35360.7
testncm42a0.007
testncirc430.016
testncirc630.152
testncirc830.529
testndata430.017
testndata630.137
testndata830.524
testn9symml0.043
testnC170.001
testnC4320.066
testnb10.002
testnc80.016
testncc0.006
testncmb0.02
testnmux0.021
testnmyadder0.034
testPN340.002
testPN40.001
testPN450.001
testPN50.002
testPN560.001
testPN60.002
testPN670.002
testPN70.002
testPN780.002
testPN80.003
testPN890.002
testPN90.003
testPN9100.003

MikolasTest

testLexicoOptimizationWithPseudoOptDecorator0.081

PuebloWatchedPBConstrOnRandomCardProblemsTest

testRndDeg60.14
testRndDeg70.033
testRndDeg80.016
testRndDeg90.004
testRndDeg100.002
testRndDeg110.003
testRndDeg120.002
testRndDeg130.002
testRndDeg140.003
testRndDeg150.002
testRndDeg160.002
testRndDeg170.002
testRndDeg180.002
testRndDeg10.216
testRndDeg20.146
testRndDeg30.136
testRndDeg40.094
testRndDeg50.023
testPN340.002
testPN40.004
testPN450.003
testPN50.005
testPN560.005
testPN60.008
testPN670.005
testPN70.012
testPN780.006
testPN80.022
testPN890.009
testPN90.029
testPN9100.006

PuebloWatchedPBClauseCardConstrWithPBConstrLearningTest

testncirc1033.756
testaloul10150.022
testaloul35450.138
testaloul40411.321
testaloul40450.169
testaloul40500.211
testaloul50513.749
testaloul50550.342
testaloul50600.395
testndata1032.054
testPN100.007
testaloul10110.008
testaloul10200.01
testaloul15160.02
testaloul15200.014
testaloul15250.017
testaloul20210.061
testaloul20250.02
testaloul20300.024
testaloul30310.349
testaloul30350.061
testaloul30400.069
testaloul35360.69
testaloul35400.09
testncm42a0.006
testncirc430.017
testncirc630.156
testncirc830.552
testndata430.022
testndata630.156
testndata830.573
testn9symml0.043
testnC170.001
testnC4320.057
testnb10.002
testnc80.015
testncc0.006
testncmb0.019
testnmux0.015
testnmyadder0.035
testPN40.001
testPN340.001
testPN450.002
testPN50.001
testPN560.002
testPN60.001
testPN670.002
testPN70.002
testPN780.002
testPN80.003
testPN890.002
testPN90.004
testPN9100.003

CompetMinPBResLongWLMixedConstraintsObjectiveLearningTest

testncirc430.502
testncirc831.436
testncirc630.164
testndata430.026
testndata630.135
testndata830.559
testn9symml0.061
testnC170.001
testnC4320.062
testnb10.002
testnc80.016
testncc0.006
testncm42a0.005
testncmb0.021
testnmux0.016
testnmyadder0.035
testPN340.002
testPN40.001
testPN450.001
testPN50.002
testPN80.141
testPN890.003
testPN91.958
testPN9100.003
testPN560.002
testPN60.004
testPN670.003
testPN70.008
testPN780.002

TestQuickExplainPB

testGlobalInconsistency0.083
testAlmostGlobalInconsistency0.004
testGlobalInconsistencyPB0.009
testAlmostGlobalInconsistencyII0.005
testAlmostGlobalInconsistencyPB0.005
testEclipsePatchEncoding0.029
testUpdatedEclipsePatchEncoding0.007

CompetPBResLongHTMixedConstraintsObjectiveLearningTest

testncirc430.573
testncirc630.91
testncirc830.823
testndata430.038
testndata630.148
testndata830.618
testn9symml0.064
testnC170.002
testnC4320.064
testnb10.003
testnc80.016
testncc0.007
testncm42a0.009
testncmb0.021
testnmux0.015
testnmyadder0.037
testPN40.002
testPN450.002
testPN50.002
testPN560.002
testPN60.006
testPN670.002
testPN70.019
testPN780.003
testPN80.2
testPN890.003
testPN91.714
testPN9100.005
testPN340.009

PBCPMaxClauseCardConstrLearningTest

testaloul10110.372
testaloul35450.722
testaloul40411.703
testaloul40450.273
testaloul40500.271
testaloul50513.778
testaloul50550.354
testaloul50600.447
testndata1033.249
testPN100.014
testncirc1032.792
testaloul10150.005
testaloul10200.006
testaloul15160.017
testaloul15200.009
testaloul15250.011
testaloul20210.053
testaloul20250.018
testaloul20300.023
testaloul30310.35
testaloul30350.064
testaloul30400.07
testaloul35360.69
testaloul35400.091
testncm42a0.007
testncirc430.016
testncirc630.299
testncirc830.724
testndata430.017
testndata630.341
testndata830.718
testn9symml0.044
testnC170.007
testnC4320.072
testnb10.002
testnc80.017
testncc0.007
testncmb0.021
testnmux0.014
testnmyadder0.035
testPN340.002
testPN40.001
testPN450.001
testPN50.001
testPN560.001
testPN60.002
testPN670.002
testPN70.002
testPN780.002
testPN80.003
testPN890.002
testPN90.003
testPN9100.002

TestGlobalTimeoutForOptimalModelEnumeration

testTimeoutOnSeconds2.101
testTimeoutOnConflicts1.749

WatchedPBConstrOnRandomCardProblemsTest

testRndDeg10.426
testRndDeg40.251
testRndDeg50.051
testRndDeg60.029
testRndDeg70.017
testRndDeg80.002
testRndDeg90.002
testRndDeg100.001
testRndDeg110.002
testRndDeg120.001
testRndDeg130.001
testRndDeg140.002
testRndDeg150.002
testRndDeg160.002
testRndDeg170.001
testRndDeg180.001
testRndDeg20.142
testRndDeg30.119
testPN340.008
testPN40.004
testPN450.003
testPN50.008
testPN560.004
testPN60.034
testPN670.004
testPN70.302
testPN780.006
testPN80.123
testPN890.004
testPN90.328
testPN9100.006

CounterPBConstrWithPBConstrLearningTest

testncirc832.421
testndata430.094
testncirc430.032
testncirc630.237
testndata630.185
testndata830.918
testn9symml0.06
testnC170.001
testnC4320.08
testnb10.005
testnc80.02
testncc0.013
testncm42a0.006
testncmb0.032
testnmux0.019
testnmyadder0.05
testPN560.002
testPN60.003
testPN670.002
testPN70.008
testPN780.003
testPN80.004
testPN890.004
testPN90.005
testPN9100.004
testPN340.002
testPN40.002
testPN450.001
testPN50.002