20180827-NOOR

2019-12-07: This experiment does not allow to conclude

Experiment design

Designer: Jérôme Euzenat (INRIA) (2017-05-31)

Revision of networks of ontologies with expansion, relaxation and generation starting with empty network (4 agents; 10 runs; 10000 games; delete/replace/refine/add/addjoin/refadd)

Hypotheses: Starting from scratch and generating correspondences when needed should not be different from starting with initial alignments

Experimental setting: Same as 20170531-NOOR replaying the same runs as 20180308-NOOR and after fixing addjoin and expansion.

Experiment

Experimenter: Jérôme Euzenat (INRIA) (2018-08-27)

Date: 2018-08-27

Lazy lavender hash: 759ff097b96520c12aa84f3749927f9a22022e62

Classpath: lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:.

OS: stretch

Variation of: 20170531-NOOR

Parameters: params.sh

Command line (script.sh):

. params.sh

for op in delete replace refine add addjoin refadd
do
  bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-${op}-clever-nr-${POSTFIX} java -Dlog.level=INFO -cp ${CLASSPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -Dgenerative -DstartEmpty
  bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-${op}-clever-nr-im80-${POSTFIX} java -Dlog.level=INFO -cp ${CLASSPATH} fr.inria.exmo.lazylaven) whider.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80 -Dgenerative -DstartEmpty
done

Class used: NOOEnvironment, AlignmentAdjustingAgent, AlignmentRevisionExperiment, ActionLogger, AverageLogger, Monitor

Execution environment: 24 * Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz with 20GB RAM / Linux ProxMox 2 / Linux 4.15.17-1-pve / Java Java(TM) SE Runtime Environment 1.8.0_151 with 4.33G max heap size

Input: Input required for reproducibility can be retrieved from: https://files.inria.fr/sakere/input/expeRun.zip Then unzip expeRun.zip -d input

Raw results

4-10000-add-clever-nr-gen-empty.tsv 4-10000-add-clever-nr-gen-empty.txt 4-10000-add-clever-nr-im80-gen-empty.tsv 4-10000-add-clever-nr-im80-gen-empty.txt 4-10000-addjoin-clever-nr-gen-empty.tsv 4-10000-addjoin-clever-nr-gen-empty.txt 4-10000-addjoin-clever-nr-im80-gen-empty.tsv 4-10000-addjoin-clever-nr-im80-gen-empty.txt 4-10000-delete-clever-nr-gen-empty.tsv 4-10000-delete-clever-nr-gen-empty.txt 4-10000-delete-clever-nr-im80-gen-empty.tsv 4-10000-delete-clever-nr-im80-gen-empty.txt 4-10000-refadd-clever-nr-gen-empty.tsv 4-10000-refadd-clever-nr-gen-empty.txt 4-10000-refadd-clever-nr-im80-gen-empty.tsv 4-10000-refadd-clever-nr-im80-gen-empty.txt 4-10000-refine-clever-nr-gen-empty.tsv 4-10000-refine-clever-nr-gen-empty.txt 4-10000-refine-clever-nr-im80-gen-empty.tsv 4-10000-refine-clever-nr-im80-gen-empty.txt 4-10000-replace-clever-nr-gen-empty.tsv 4-10000-replace-clever-nr-gen-empty.txt 4-10000-replace-clever-nr-im80-gen-empty.tsv 4-10000-replace-clever-nr-im80-gen-empty.txt

Result exploration

Results are compared to that of 20180601-NOOR (in dashed) which uses the same configurations of parameters but start with random (non realistic) alignments.

test success
rate
network
size
incoherence
degree
semantic
precision
semantic
F-measure
semantic
recall
maximum
convergence
4-10000-delete-clever-nr-gen-empty 0.94 71 0.13 0.85 0.70 0.60 9801
4-10000-replace-clever-nr-gen-empty 0.94 72 0.14 0.83 0.70 0.61 9159
4-10000-refine-clever-nr-gen-empty 0.94 78 0.16 0.82 0.76 0.70 9881
4-10000-add-clever-nr-gen-empty 0.93 83 0.15 0.82 0.76 0.72 8826
4-10000-addjoin-clever-nr-gen-empty 0.96 80 0.13 0.84 0.75 0.68 8043
4-10000-refadd-clever-nr-gen-empty 0.94 81 0.15 0.81 0.78 0.76 8731
4-10000-delete-clever-nr-im80-gen-empty 0.94 61 0.00 1.00 0.61 0.44 8740
4-10000-replace-clever-nr-im80-gen-empty 0.94 62 0.00 1.00 0.65 0.48 9159
4-10000-refine-clever-nr-im80-gen-empty 0.94 73 0.00 1.00 0.78 0.64 7215
4-10000-add-clever-nr-im80-gen-empty 0.93 76 0.00 1.00 0.77 0.63 9233
4-10000-addjoin-clever-nr-im80-gen-empty 0.95 76 0.00 1.00 0.78 0.64 7426
4-10000-refadd-clever-nr-im80-gen-empty 0.94 79 0.00 1.00 0.82 0.69 6729

Analysis

Analyst: Jérôme Euzenat (INRIA) (2018-08-28)

Key points:

Further experiments:


This file can be retrieved from URL https://sake.re/20180827-NOOR

It is possible to check out the repository by cloning https://felapton.inrialpes.fr/cakes/20180827-NOOR.git

This experiment has been transferred from its initial location at https://gforge.inria.fr.

The original, unaltered associated zip file can be obtained from https://files.inria.fr/sakere/gforge/20180827-NOOR.zip