20190523-NOOR

Experiment design

Designer: Jérôme Euzenat (INRIA) ()

Revision of networks of ontologies with expansion, relaxation and generation starting with random network (4 agents; 10 runs; 10000 games; delete/replace/refine/add/addjoin/refadd)

Hypotheses: Generating correspondences when needed should increase results quality (recall) with respect to expansion

Experimental setting: Same as 20180529-NOOR replaying the same runs as 20180308-NOOR after major code revision

Experiment

Experimenter: Jérôme Euzenat (INRIA) (2019-05-25)

Date: 2019-05-25

Lazy lavender hash: be3123f56509760ba462284623794bfb6e750303

Classpath: lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:.

OS: stretch

Variation of: 20180529-NOOR

Parameters: params.sh

Command line (script.sh):

. params.sh

OUTPUT=${OUTPUT}${LABEL}

for op in ${OPS}
do
   bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-${op}${postfix} java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} ${PARAMS}
done

Class used: NOOEnvironment, AlignmentAdjustingAgent, AlignmentRevisionExperiment, ActionLogger, AverageLogger, Monitor

Execution environment: 24 * Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz with 20GB RAM / Linux 4.15.17-1-pve / Java(TM) SE Runtime Environment 1.8.0_151 with 4.33G max heap size

Input: Input required for reproducibility can be retrieved from: https://files.inria.fr/sakere/input/expeRun.zip Then unzip expeRun.zip -d input

Raw results

4-10000-add-clever-nr.tsv 4-10000-add-clever-nr.txt 4-10000-addjoin-clever-nr.tsv 4-10000-addjoin-clever-nr.txt 4-10000-delete-clever-nr.tsv 4-10000-delete-clever-nr.txt 4-10000-refadd-clever-nr.tsv 4-10000-refadd-clever-nr.txt 4-10000-refine-clever-nr.tsv 4-10000-refine-clever-nr.txt 4-10000-replace-clever-nr.tsv 4-10000-replace-clever-nr.txt

Result exploration

Results are compared to those of 20180529-NOOR (dashed)

test success
rate
network
size
incoherence
degree
semantic
precision
semantic
F-measure
semantic
recall
maximum
convergence
4-10000-delete-clever-nr 0.98 15 0.02 0.96 0.28 0.16 1502
4-10000-replace-clever-nr 0.97 28 0.10 0.84 0.47 0.33 1958
4-10000-refine-clever-nr 0.96 47 0.16 0.79 0.66 0.56 3409
4-10000-add-clever-nr 0.96 47 0.24 0.71 0.66 0.62 2873
4-10000-addjoin-clever-nr 0.98 53 0.26 0.67 0.67 0.67 2060
4-10000-refadd-clever-nr 0.96 67 0.26 0.69 0.75 0.82 4621

Analysis

Analyst: Jérôme Euzenat (INRIA) (2019-05-26/2019-08-26)

Key points:

Further experiments:


This file can be retrieved from URL https://sake.re/20190523-NOOR

It is possible to check out the repository by cloning https://felapton.inrialpes.fr/cakes/20190523-NOOR.git

This experiment has been transferred from its initial location at https://gforge.inria.fr (not available any more)

The original, unaltered associated zip file can be obtained from https://files.inria.fr/sakere/gforge/20190523-NOOR.zip