Revision of networks of ontologies with expansion, relaxation and generation starting with random network (4 agents; 10 runs; 10000 games; delete/replace/refine/add/addjoin/refadd)Designer: Jérôme Euzenat (INRIA) ()
Revision of networks of ontologies with expansion, relaxation and generation starting with random network (4 agents; 10 runs; 10000 games; delete/replace/refine/add/addjoin/refadd)
Hypotheses: Generating correspondences when needed should increase results quality (recall) with respect to expansion
Experimental setting: Same as 20180530-NOOR replaying the same runs as 20180308-NOOR after major code revision
Experimenter: Jérôme Euzenat (INRIA) (2019-05-25)
Date: 2019-05-25
Lazy lavender hash: be3123f56509760ba462284623794bfb6e750303
Classpath: lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:.
OS: stretch
Variation of: 20180530-NOOR
Parameters: params.sh
Command line (script.sh):
. params.sh
OUTPUT=${OUTPUT}${LABEL}
for op in ${OPS}
do
bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-${op}${postfix} java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} ${PARAMS}
done
Class used: NOOEnvironment, AlignmentAdjustingAgent, AlignmentRevisionExperiment, ActionLogger, AverageLogger, Monitor
Execution environment: 24 * Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz with 20GB RAM / Linux 4.15.17-1-pve / Java(TM) SE Runtime Environment 1.8.0_151 with 4.33G max heap size
Input: Input required for reproducibility can be retrieved from: https://files.inria.fr/sakere/input/expeRun.zip Then unzip expeRun.zip -d input
4-10000-add-clever-nr-im80.tsv 4-10000-add-clever-nr-im80.txt 4-10000-addjoin-clever-nr-im80.tsv 4-10000-addjoin-clever-nr-im80.txt 4-10000-delete-clever-nr-im80.tsv 4-10000-delete-clever-nr-im80.txt 4-10000-refadd-clever-nr-im80.tsv 4-10000-refadd-clever-nr-im80.txt 4-10000-refine-clever-nr-im80.tsv 4-10000-refine-clever-nr-im80.txt 4-10000-replace-clever-nr-im80.tsv 4-10000-replace-clever-nr-im80.txt
This is compared with clever-nr 20190523-NOOR (dotted) and previous experiment 20180530-NOOR (dashed).
| test | success rate |
network size |
incoherence degree |
semantic precision |
semantic F-measure |
semantic recall |
maximum convergence |
|---|---|---|---|---|---|---|---|
| 4-10000-delete-clever-nr-im80 | 0.98 | 15 | 0.00 | 1.00 | 0.26 | 0.15 | 2310 |
| 4-10000-replace-clever-nr-im80 | 0.97 | 22 | 0.00 | 1.00 | 0.36 | 0.22 | 3571 |
| 4-10000-refine-clever-nr-im80 | 0.96 | 44 | 0.00 | 1.00 | 0.65 | 0.48 | 4744 |
| 4-10000-add-clever-nr-im80 | 0.96 | 34 | 0.00 | 1.00 | 0.52 | 0.35 | 4127 |
| 4-10000-addjoin-clever-nr-im80 | 0.97 | 40 | 0.00 | 1.00 | 0.58 | 0.40 | 3433 |
| 4-10000-refadd-clever-nr-im80 | 0.96 | 68 | 0.00 | 1.00 | 0.85 | 0.74 | 5626 |
Analyst: Jérôme Euzenat (INRIA) (2019-05-26/2018-08-28)
Key points:
Further experiments:
This file can be retrieved from URL https://sake.re/20190524-NOOR
It is possible to check out the repository by cloning https://felapton.inrialpes.fr/cakes/20190524-NOOR.git
This experiment has been transferred from its initial location at https://gforge.inria.fr (not available any more)
The original, unaltered associated zip file can be obtained from https://files.inria.fr/sakere/gforge/20190524-NOOR.zip