Revision of networks of ontologies with expansion, relaxation and generation starting with empty network (4 agents; 10 runs; 10000 games; delete/replace/refine/add/addjoin/refadd)2019-12-07: This experiment does not allow to conclude
Designer: Jérôme Euzenat (INRIA) (2017-05-31)
Revision of networks of ontologies with expansion, relaxation and generation starting with empty network (4 agents; 10 runs; 10000 games; delete/replace/refine/add/addjoin/refadd)
Hypotheses: Starting from scratch and generating correspondences when needed should not be different from starting with initial alignments
Experimental setting: Same as 20170531-NOOR replaying the same runs as 20180308-NOOR and after fixing addjoin and expansion.
Experimenter: Jérôme Euzenat (INRIA) (2018-08-27)
Date: 2018-08-27
Lazy lavender hash: 759ff097b96520c12aa84f3749927f9a22022e62
Classpath: lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:.
OS: stretch
Variation of: 20170531-NOOR
Parameters: params.sh
Command line (script.sh):
. params.sh
for op in delete replace refine add addjoin refadd
do
bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-${op}-clever-nr-${POSTFIX} java -Dlog.level=INFO -cp ${CLASSPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -Dgenerative -DstartEmpty
bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-${op}-clever-nr-im80-${POSTFIX} java -Dlog.level=INFO -cp ${CLASSPATH} fr.inria.exmo.lazylaven) whider.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80 -Dgenerative -DstartEmpty
done
Class used: NOOEnvironment, AlignmentAdjustingAgent, AlignmentRevisionExperiment, ActionLogger, AverageLogger, Monitor
Execution environment: 24 * Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz with 20GB RAM / Linux ProxMox 2 / Linux 4.15.17-1-pve / Java Java(TM) SE Runtime Environment 1.8.0_151 with 4.33G max heap size
Input: Input required for reproducibility can be retrieved from: https://files.inria.fr/sakere/input/expeRun.zip Then unzip expeRun.zip -d input
4-10000-add-clever-nr-gen-empty.tsv 4-10000-add-clever-nr-gen-empty.txt 4-10000-add-clever-nr-im80-gen-empty.tsv 4-10000-add-clever-nr-im80-gen-empty.txt 4-10000-addjoin-clever-nr-gen-empty.tsv 4-10000-addjoin-clever-nr-gen-empty.txt 4-10000-addjoin-clever-nr-im80-gen-empty.tsv 4-10000-addjoin-clever-nr-im80-gen-empty.txt 4-10000-delete-clever-nr-gen-empty.tsv 4-10000-delete-clever-nr-gen-empty.txt 4-10000-delete-clever-nr-im80-gen-empty.tsv 4-10000-delete-clever-nr-im80-gen-empty.txt 4-10000-refadd-clever-nr-gen-empty.tsv 4-10000-refadd-clever-nr-gen-empty.txt 4-10000-refadd-clever-nr-im80-gen-empty.tsv 4-10000-refadd-clever-nr-im80-gen-empty.txt 4-10000-refine-clever-nr-gen-empty.tsv 4-10000-refine-clever-nr-gen-empty.txt 4-10000-refine-clever-nr-im80-gen-empty.tsv 4-10000-refine-clever-nr-im80-gen-empty.txt 4-10000-replace-clever-nr-gen-empty.tsv 4-10000-replace-clever-nr-gen-empty.txt 4-10000-replace-clever-nr-im80-gen-empty.tsv 4-10000-replace-clever-nr-im80-gen-empty.txt
Results are compared to that of 20180601-NOOR (in dashed) which uses the same configurations of parameters but start with random (non realistic) alignments.
| test | success rate |
network size |
incoherence degree |
semantic precision |
semantic F-measure |
semantic recall |
maximum convergence |
|---|---|---|---|---|---|---|---|
| 4-10000-delete-clever-nr-gen-empty | 0.94 | 71 | 0.13 | 0.85 | 0.70 | 0.60 | 9801 |
| 4-10000-replace-clever-nr-gen-empty | 0.94 | 72 | 0.14 | 0.83 | 0.70 | 0.61 | 9159 |
| 4-10000-refine-clever-nr-gen-empty | 0.94 | 78 | 0.16 | 0.82 | 0.76 | 0.70 | 9881 |
| 4-10000-add-clever-nr-gen-empty | 0.93 | 83 | 0.15 | 0.82 | 0.76 | 0.72 | 8826 |
| 4-10000-addjoin-clever-nr-gen-empty | 0.96 | 80 | 0.13 | 0.84 | 0.75 | 0.68 | 8043 |
| 4-10000-refadd-clever-nr-gen-empty | 0.94 | 81 | 0.15 | 0.81 | 0.78 | 0.76 | 8731 |
| 4-10000-delete-clever-nr-im80-gen-empty | 0.94 | 61 | 0.00 | 1.00 | 0.61 | 0.44 | 8740 |
| 4-10000-replace-clever-nr-im80-gen-empty | 0.94 | 62 | 0.00 | 1.00 | 0.65 | 0.48 | 9159 |
| 4-10000-refine-clever-nr-im80-gen-empty | 0.94 | 73 | 0.00 | 1.00 | 0.78 | 0.64 | 7215 |
| 4-10000-add-clever-nr-im80-gen-empty | 0.93 | 76 | 0.00 | 1.00 | 0.77 | 0.63 | 9233 |
| 4-10000-addjoin-clever-nr-im80-gen-empty | 0.95 | 76 | 0.00 | 1.00 | 0.78 | 0.64 | 7426 |
| 4-10000-refadd-clever-nr-im80-gen-empty | 0.94 | 79 | 0.00 | 1.00 | 0.82 | 0.69 | 6729 |
Analyst: Jérôme Euzenat (INRIA) (2018-08-28)
Key points:
Further experiments:
This file can be retrieved from URL https://sake.re/20180827-NOOR
It is possible to check out the repository by cloning https://felapton.inrialpes.fr/cakes/20180827-NOOR.git
This experiment has been transferred from its initial location at https://gforge.inria.fr (not available any more)
The original, unaltered associated zip file can be obtained from https://files.inria.fr/sakere/gforge/20180827-NOOR.zip