20190624-NOOR

Experiment design

Designer: Jérôme Euzenat (INRIA) ()

Revision of networks of ontologies with expansion, relaxation and generation starting with random network (4 agents; 10 runs; 20000 games; delete/replace/refine/add/addjoin/refadd)

Hypotheses: Generating correspondences when needed should increase results quality (recall) with respect to expansion

Experimental setting: Same as 20180601-NOOR replaying the same runs as 20180913-NOOR with new implementations.

Experiment

Experimenter: Jérôme Euzenat (INRIA) (2019-07-01)

Date: 2019-07-01

Lazy lavender hash: abd46811f38e9c765b2980cbb2fe504aff7b3e5e

Classpath: lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:.

OS: stretch

Variation of: 20180601-NOOR

Parameters: params.sh

Command line (script.sh):

. params.sh

for op in ${OPS}
do
  bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-${op}-clever-nr${postfix} java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -Dgenerative
  bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-${op}-clever-nr-im80${postfix} java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80 -Dgenerative
done

Class used: NOOEnvironment, AlignmentAdjustingAgent, AlignmentRevisionExperiment, ActionLogger, AverageLogger, Monitor

Execution environment: 24 * Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz with 20GB RAM / Linux 4.15.17-1-pve / Java(TM) SE Runtime Environment 1.8.0_151 with 4.33G max heap size

Input: Input required for reproducibility can be retrieved from: https://files.inria.fr/sakere/input/expeRun2.zip Then unzip expeRun2.zip -d input

Raw results

4-20000-add-clever-nr-gen.tsv 4-20000-add-clever-nr-gen.txt 4-20000-add-clever-nr-im80-gen.tsv 4-20000-add-clever-nr-im80-gen.txt 4-20000-addjoin-clever-nr-gen.tsv 4-20000-addjoin-clever-nr-gen.txt 4-20000-addjoin-clever-nr-im80-gen.tsv 4-20000-addjoin-clever-nr-im80-gen.txt 4-20000-delete-clever-nr-gen.tsv 4-20000-delete-clever-nr-gen.txt 4-20000-delete-clever-nr-im80-gen.tsv 4-20000-delete-clever-nr-im80-gen.txt 4-20000-refadd-clever-nr-gen.tsv 4-20000-refadd-clever-nr-gen.txt 4-20000-refadd-clever-nr-im80-gen.tsv 4-20000-refadd-clever-nr-im80-gen.txt 4-20000-refine-clever-nr-gen.tsv 4-20000-refine-clever-nr-gen.txt 4-20000-refine-clever-nr-im80-gen.tsv 4-20000-refine-clever-nr-im80-gen.txt 4-20000-replace-clever-nr-gen.tsv 4-20000-replace-clever-nr-gen.txt 4-20000-replace-clever-nr-im80-gen.tsv 4-20000-replace-clever-nr-im80-gen.txt

Result exploration

Results (plain) are compared with the previous same experiment on 10000 (20180601-NOOR, dashed) and the current experiments without generation on 10000 (20190523-NOOR for clever-nr and 20190524-NOOR for clever-nr-im80, dotted).

test success
rate
network
size
incoherence
degree
semantic
precision
semantic
F-measure
semantic
recall
maximum
convergence
4-20000-delete-clever-nr-gen 0.96 51 0.16 0.79 0.63 0.52 12420
4-20000-replace-clever-nr-gen 0.96 51 0.17 0.78 0.65 0.56 13846
4-20000-refine-clever-nr-gen 0.96 67 0.20 0.74 0.74 0.74 11139
4-20000-add-clever-nr-gen 0.95 69 0.23 0.74 0.78 0.83 17473
4-20000-addjoin-clever-nr-gen 0.97 70 0.25 0.71 0.78 0.85 13801
4-20000-refadd-clever-nr-gen 0.96 72 0.27 0.68 0.76 0.88 13741
4-20000-delete-clever-nr-im80-gen 0.96 37 0.00 1.00 0.49 0.33 12146
4-20000-replace-clever-nr-im80-gen 0.96 39 0.00 1.00 0.53 0.36 13115
4-20000-refine-clever-nr-im80-gen 0.96 60 0.00 1.00 0.76 0.62 11062
4-20000-add-clever-nr-im80-gen 0.94 66 0.00 1.00 0.79 0.65 16176
4-20000-addjoin-clever-nr-im80-gen 0.97 67 0.00 1.00 0.80 0.67 14102
4-20000-refadd-clever-nr-im80-gen 0.96 71 0.00 1.00 0.87 0.77 12967

Analysis

Analyst: Jérôme Euzenat (INRIA) (2019-07-02/2019-08-29)

Key points:

Further experiments:


This file can be retrieved from URL https://sake.re/20190624-NOOR

It is possible to check out the repository by cloning https://felapton.inrialpes.fr/cakes/20190624-NOOR.git

This experiment has been transferred from its initial location at https://gforge.inria.fr (not available any more)

The original, unaltered associated zip file can be obtained from https://files.inria.fr/sakere/gforge/20190624-NOOR.zip