Revision of networks of ontologies with expansion, relaxation and generation starting with random network (4 agents; 10 runs; 20000 games; delete/replace/refine/add/addjoin/refadd)Designer: Jérôme Euzenat (INRIA) ()
Revision of networks of ontologies with expansion, relaxation and generation starting with random network (4 agents; 10 runs; 20000 games; delete/replace/refine/add/addjoin/refadd)
Hypotheses: Generating correspondences when needed should increase results quality (recall) with respect to expansion
Experimental setting: Same as 20180601-NOOR replaying the same runs as 20180913-NOOR with new implementations.
Experimenter: Jérôme Euzenat (INRIA) (2019-07-01)
Date: 2019-07-01
Lazy lavender hash: abd46811f38e9c765b2980cbb2fe504aff7b3e5e
Classpath: lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:.
OS: stretch
Variation of: 20180601-NOOR
Parameters: params.sh
Command line (script.sh):
. params.sh
for op in ${OPS}
do
bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-${op}-clever-nr${postfix} java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -Dgenerative
bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-${op}-clever-nr-im80${postfix} java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80 -Dgenerative
done
Class used: NOOEnvironment, AlignmentAdjustingAgent, AlignmentRevisionExperiment, ActionLogger, AverageLogger, Monitor
Execution environment: 24 * Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz with 20GB RAM / Linux 4.15.17-1-pve / Java(TM) SE Runtime Environment 1.8.0_151 with 4.33G max heap size
Input: Input required for reproducibility can be retrieved from: https://files.inria.fr/sakere/input/expeRun2.zip Then unzip expeRun2.zip -d input
4-20000-add-clever-nr-gen.tsv 4-20000-add-clever-nr-gen.txt 4-20000-add-clever-nr-im80-gen.tsv 4-20000-add-clever-nr-im80-gen.txt 4-20000-addjoin-clever-nr-gen.tsv 4-20000-addjoin-clever-nr-gen.txt 4-20000-addjoin-clever-nr-im80-gen.tsv 4-20000-addjoin-clever-nr-im80-gen.txt 4-20000-delete-clever-nr-gen.tsv 4-20000-delete-clever-nr-gen.txt 4-20000-delete-clever-nr-im80-gen.tsv 4-20000-delete-clever-nr-im80-gen.txt 4-20000-refadd-clever-nr-gen.tsv 4-20000-refadd-clever-nr-gen.txt 4-20000-refadd-clever-nr-im80-gen.tsv 4-20000-refadd-clever-nr-im80-gen.txt 4-20000-refine-clever-nr-gen.tsv 4-20000-refine-clever-nr-gen.txt 4-20000-refine-clever-nr-im80-gen.tsv 4-20000-refine-clever-nr-im80-gen.txt 4-20000-replace-clever-nr-gen.tsv 4-20000-replace-clever-nr-gen.txt 4-20000-replace-clever-nr-im80-gen.tsv 4-20000-replace-clever-nr-im80-gen.txt
Results (plain) are compared with the previous same experiment on 10000 (20180601-NOOR, dashed) and the current experiments without generation on 10000 (20190523-NOOR for clever-nr and 20190524-NOOR for clever-nr-im80, dotted).
| test | success rate |
network size |
incoherence degree |
semantic precision |
semantic F-measure |
semantic recall |
maximum convergence |
|---|---|---|---|---|---|---|---|
| 4-20000-delete-clever-nr-gen | 0.96 | 51 | 0.16 | 0.79 | 0.63 | 0.52 | 12420 |
| 4-20000-replace-clever-nr-gen | 0.96 | 51 | 0.17 | 0.78 | 0.65 | 0.56 | 13846 |
| 4-20000-refine-clever-nr-gen | 0.96 | 67 | 0.20 | 0.74 | 0.74 | 0.74 | 11139 |
| 4-20000-add-clever-nr-gen | 0.95 | 69 | 0.23 | 0.74 | 0.78 | 0.83 | 17473 |
| 4-20000-addjoin-clever-nr-gen | 0.97 | 70 | 0.25 | 0.71 | 0.78 | 0.85 | 13801 |
| 4-20000-refadd-clever-nr-gen | 0.96 | 72 | 0.27 | 0.68 | 0.76 | 0.88 | 13741 |
| 4-20000-delete-clever-nr-im80-gen | 0.96 | 37 | 0.00 | 1.00 | 0.49 | 0.33 | 12146 |
| 4-20000-replace-clever-nr-im80-gen | 0.96 | 39 | 0.00 | 1.00 | 0.53 | 0.36 | 13115 |
| 4-20000-refine-clever-nr-im80-gen | 0.96 | 60 | 0.00 | 1.00 | 0.76 | 0.62 | 11062 |
| 4-20000-add-clever-nr-im80-gen | 0.94 | 66 | 0.00 | 1.00 | 0.79 | 0.65 | 16176 |
| 4-20000-addjoin-clever-nr-im80-gen | 0.97 | 67 | 0.00 | 1.00 | 0.80 | 0.67 | 14102 |
| 4-20000-refadd-clever-nr-im80-gen | 0.96 | 71 | 0.00 | 1.00 | 0.87 | 0.77 | 12967 |
Analyst: Jérôme Euzenat (INRIA) (2019-07-02/2019-08-29)
Key points:
Further experiments:
This file can be retrieved from URL https://sake.re/20190624-NOOR
It is possible to check out the repository by cloning https://felapton.inrialpes.fr/cakes/20190624-NOOR.git
This experiment has been transferred from its initial location at https://gforge.inria.fr (not available any more)
The original, unaltered associated zip file can be obtained from https://files.inria.fr/sakere/gforge/20190624-NOOR.zip