20180927-NOOR

Experiment design

Designer: Jérôme Euzenat (INRIA) (2017-10-01)

Revision of networks of ontologies with 5 agents relaxation, expansion and generation (5 agents; 10 runs; 100000 games; delete/replace/refine/add/addjoin/refadd)

Hypotheses: With 5 agents processes converge within 100000 games

Experimental setting: Same as 20171231-NOOR after correction of expansion (48054fa4b73f6eb5aebb5fcda4bd7c6831f0040f) and add behaviour. Results are also compared with the same set of games (and obviously different initial situations)

Experiment

Experimenter: Jérôme Euzenat (INRIA) (2018-09-27)

Date: 2018-09-27 -- 2018-10-29

Lazy lavender hash: 759ff097b96520c12aa84f3749927f9a22022e62

Classpath: lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:.

OS: stretch

Variation of: 20171231-NOOR

Parameters: params.sh

Command line (script.sh):

. params.sh

# bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-nothing java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} -DrevisionModality=nothing -DsaveDir=input/expeRun -DsaveGames -DloadDir=input/expeRun -DloadEnv -DloadAgents

for op in ${OPS}
do
  bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-${op}-clever-nr-gen java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -Dgenerative
  bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-${op}-clever-nr-im80-gen java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80 -Dgenerative
  bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-${op}-clever-nr-gen-empty java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -Dgenerative -Dstartempty
  bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-${op}-clever-nr-im80-gen-empty java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80 -Dgenerative -Dstartempty
done

# bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-nothing2 java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} -DrevisionModality=nothing -DsaveDir=input/expeRun -DloadGames -DloadDir=input/expeRun -DsaveEnv -DloadAgents

for op in ${OPS}
do
  bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-${op}-clever-nr-gen-real java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -Dgenerative -Drealistic
  bash scripts/runexp.sh -p ${OUTPUT} -d ${DIRPREF}-${op}-clever-nr-im80-gen-real java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80 -Dgenerative -Drealistic
done

Class used: NOOEnvironment, AlignmentAdjustingAgent, AlignmentRevisionExperiment, ActionLogger, AverageLogger, Monitor

Execution environment: 24 * Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz with 20GB RAM / Linux ProxMox 2 / Linux 4.15.17-1-pve / Java Java(TM) SE Runtime Environment 1.8.0_151 with 4.33G max heap size

Note: This experiment has been set up to first generate the runs and then play them with different configuration. To strictly repeat it, it is necessary to reuse the same input and not generate a new one. Hence, the input is saved in the repository, the generating line above must be commented (including in Docker).

Raw results

5-100000-add-clever-nr-gen-empty.tsv 5-100000-add-clever-nr-gen-empty.txt 5-100000-add-clever-nr-gen-real.tsv 5-100000-add-clever-nr-gen-real.txt 5-100000-add-clever-nr-gen.tsv 5-100000-add-clever-nr-gen.txt 5-100000-add-clever-nr-im80-gen-empty.tsv 5-100000-add-clever-nr-im80-gen-empty.txt 5-100000-add-clever-nr-im80-gen-real.tsv 5-100000-add-clever-nr-im80-gen-real.txt 5-100000-add-clever-nr-im80-gen.tsv 5-100000-add-clever-nr-im80-gen.txt 5-100000-addjoin-clever-nr-gen-empty.tsv 5-100000-addjoin-clever-nr-gen-empty.txt 5-100000-addjoin-clever-nr-gen-real.tsv 5-100000-addjoin-clever-nr-gen-real.txt 5-100000-addjoin-clever-nr-gen.tsv 5-100000-addjoin-clever-nr-gen.txt 5-100000-addjoin-clever-nr-im80-gen-empty.tsv 5-100000-addjoin-clever-nr-im80-gen-empty.txt 5-100000-addjoin-clever-nr-im80-gen-real.tsv 5-100000-addjoin-clever-nr-im80-gen-real.txt 5-100000-addjoin-clever-nr-im80-gen.tsv 5-100000-addjoin-clever-nr-im80-gen.txt 5-100000-delete-clever-nr-gen-empty.tsv 5-100000-delete-clever-nr-gen-empty.txt 5-100000-delete-clever-nr-gen-real.tsv 5-100000-delete-clever-nr-gen-real.txt 5-100000-delete-clever-nr-gen.tsv 5-100000-delete-clever-nr-gen.txt 5-100000-delete-clever-nr-im80-gen-empty.tsv 5-100000-delete-clever-nr-im80-gen-empty.txt 5-100000-delete-clever-nr-im80-gen-real.tsv 5-100000-delete-clever-nr-im80-gen-real.txt 5-100000-delete-clever-nr-im80-gen.tsv 5-100000-delete-clever-nr-im80-gen.txt 5-100000-nothing.tsv 5-100000-nothing.txt 5-100000-nothing2.tsv 5-100000-nothing2.txt 5-100000-refadd-clever-nr-gen-empty.tsv 5-100000-refadd-clever-nr-gen-empty.txt 5-100000-refadd-clever-nr-gen-real.tsv 5-100000-refadd-clever-nr-gen-real.txt 5-100000-refadd-clever-nr-gen.tsv 5-100000-refadd-clever-nr-gen.txt 5-100000-refadd-clever-nr-im80-gen-empty.tsv 5-100000-refadd-clever-nr-im80-gen-empty.txt 5-100000-refadd-clever-nr-im80-gen-real.tsv 5-100000-refadd-clever-nr-im80-gen-real.txt 5-100000-refadd-clever-nr-im80-gen.tsv 5-100000-refadd-clever-nr-im80-gen.txt 5-100000-refine-clever-nr-gen-empty.tsv 5-100000-refine-clever-nr-gen-empty.txt 5-100000-refine-clever-nr-gen-real.tsv 5-100000-refine-clever-nr-gen-real.txt 5-100000-refine-clever-nr-gen.tsv 5-100000-refine-clever-nr-gen.txt 5-100000-refine-clever-nr-im80-gen-empty.tsv 5-100000-refine-clever-nr-im80-gen-empty.txt 5-100000-refine-clever-nr-im80-gen-real.tsv 5-100000-refine-clever-nr-im80-gen-real.txt 5-100000-refine-clever-nr-im80-gen.tsv 5-100000-refine-clever-nr-im80-gen.txt 5-100000-replace-clever-nr-gen-empty.tsv 5-100000-replace-clever-nr-gen-empty.txt 5-100000-replace-clever-nr-gen-real.tsv 5-100000-replace-clever-nr-gen-real.txt 5-100000-replace-clever-nr-gen.tsv 5-100000-replace-clever-nr-gen.txt 5-100000-replace-clever-nr-im80-gen-empty.tsv 5-100000-replace-clever-nr-im80-gen-empty.txt 5-100000-replace-clever-nr-im80-gen-real.tsv 5-100000-replace-clever-nr-im80-gen-real.txt 5-100000-replace-clever-nr-im80-gen.tsv 5-100000-replace-clever-nr-im80-gen.txt

Result exploration

The same curves as 20171231-NOOR are given, first without and then with relaxation:

Analysis

Analyst: Jérôme Euzenat (INRIA) (2018-10-29)

Key points:

• Overall the curves of all processes are very similar
• Experiments based on random alignments (underestimated size) and realistic-size random alignments roughly generate the same results
• Experiments based on empty initial alignments tend --surprisingly-- to lead to larger alignments
• with add, addjoin and refadd, they also provide alignments of higher precision and lower recall

Further experiments:

• None

This file can be retrieved from URL https://sake.re/20180927-NOOR

It is possible to check out the repository by cloning https://felapton.inrialpes.fr/cakes/20180927-NOOR.git

This experiment has been transferred from its initial location at https://gforge.inria.fr (not available any more)

The original, unaltered associated zip file can be obtained from https://files.inria.fr/sakere/gforge/20180927-NOOR.zip