20171001-NOOR

2018-09-17: expansion did not work properly since commit 562f5c4b96893d30e2dc9fd59d935e013ce5219f (see 20180917-NOOR)

Experiment design

Hypothesis:

• The trends observed in 20170530-NOOR and 20170531-NOOR do not depend on the number of agents

Experimental setting: Same as 20170530-NOOR and 20170531-NOOR with 5 agents and 20000 iterations

Experiment

Experimenter: Jérôme Euzenat (INRIA)

Date: 2017-09-28 to 2017-10-08

Lazy lavender hash: 562f5c4b96893d30e2dc9fd59d935e013ce5219f

Parameters: params.sh

Command line (script.sh):

for op in delete replace refine add addjoin refadd
do
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=5 -DnbIterations=20000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=5 -DnbIterations=20000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=5 -DnbIterations=20000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -Dgenerative
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=5 -DnbIterations=20000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80 -Dgenerative
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=5 -DnbIterations=20000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -Dgenerative -Dstartempty
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=5 -DnbIterations=20000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80 -Dgenerative -Dstartempty
done

Class used: NOOEnvironment, AlignmentAdjustingAgent, AlignmentRevisionExperiment, ActionLogger, AverageLogger, Monitor

Execution environment: Debian Linux virtual machine configured with four processors and 20GB of RAM running under a Dell PowerEdge T610 with 4*Intel Xeon Quad Core 1.9GHz E5-2420 processors, under Linux ProxMox 2 (Debian). - Java 1.8.0_131-b11 HotSpot

Raw results

5-20000-add-clever-nr-gen-empty.tsv 5-20000-add-clever-nr-gen-empty.txt 5-20000-add-clever-nr-gen.tsv 5-20000-add-clever-nr-gen.txt 5-20000-add-clever-nr-im80-gen-empty.tsv 5-20000-add-clever-nr-im80-gen-empty.txt 5-20000-add-clever-nr-im80-gen.tsv 5-20000-add-clever-nr-im80-gen.txt 5-20000-add-clever-nr-im80.tsv 5-20000-add-clever-nr-im80.txt 5-20000-add-clever-nr.tsv 5-20000-add-clever-nr.txt 5-20000-addjoin-clever-nr-gen-empty.tsv 5-20000-addjoin-clever-nr-gen-empty.txt 5-20000-addjoin-clever-nr-gen.tsv 5-20000-addjoin-clever-nr-gen.txt 5-20000-addjoin-clever-nr-im80-gen-empty.tsv 5-20000-addjoin-clever-nr-im80-gen-empty.txt 5-20000-addjoin-clever-nr-im80-gen.tsv 5-20000-addjoin-clever-nr-im80-gen.txt 5-20000-addjoin-clever-nr-im80.tsv 5-20000-addjoin-clever-nr-im80.txt 5-20000-addjoin-clever-nr.tsv 5-20000-addjoin-clever-nr.txt 5-20000-delete-clever-nr-gen-empty.tsv 5-20000-delete-clever-nr-gen-empty.txt 5-20000-delete-clever-nr-gen.tsv 5-20000-delete-clever-nr-gen.txt 5-20000-delete-clever-nr-im80-gen-empty.tsv 5-20000-delete-clever-nr-im80-gen-empty.txt 5-20000-delete-clever-nr-im80-gen.tsv 5-20000-delete-clever-nr-im80-gen.txt 5-20000-delete-clever-nr-im80.tsv 5-20000-delete-clever-nr-im80.txt 5-20000-delete-clever-nr.tsv 5-20000-delete-clever-nr.txt 5-20000-refadd-clever-nr-gen-empty.tsv 5-20000-refadd-clever-nr-gen-empty.txt 5-20000-refadd-clever-nr-gen.tsv 5-20000-refadd-clever-nr-gen.txt 5-20000-refadd-clever-nr-im80-gen-empty.tsv 5-20000-refadd-clever-nr-im80-gen-empty.txt 5-20000-refadd-clever-nr-im80-gen.tsv 5-20000-refadd-clever-nr-im80-gen.txt 5-20000-refadd-clever-nr-im80.tsv 5-20000-refadd-clever-nr-im80.txt 5-20000-refadd-clever-nr.tsv 5-20000-refadd-clever-nr.txt 5-20000-refine-clever-nr-gen-empty.tsv 5-20000-refine-clever-nr-gen-empty.txt 5-20000-refine-clever-nr-gen.tsv 5-20000-refine-clever-nr-gen.txt 5-20000-refine-clever-nr-im80-gen-empty.tsv 5-20000-refine-clever-nr-im80-gen-empty.txt 5-20000-refine-clever-nr-im80-gen.tsv 5-20000-refine-clever-nr-im80-gen.txt 5-20000-refine-clever-nr-im80.tsv 5-20000-refine-clever-nr-im80.txt 5-20000-refine-clever-nr.tsv 5-20000-refine-clever-nr.txt 5-20000-replace-clever-nr-gen-empty.tsv 5-20000-replace-clever-nr-gen-empty.txt 5-20000-replace-clever-nr-gen.tsv 5-20000-replace-clever-nr-gen.txt 5-20000-replace-clever-nr-im80-gen-empty.tsv 5-20000-replace-clever-nr-im80-gen-empty.txt 5-20000-replace-clever-nr-im80-gen.tsv 5-20000-replace-clever-nr-im80-gen.txt 5-20000-replace-clever-nr-im80.tsv 5-20000-replace-clever-nr-im80.txt 5-20000-replace-clever-nr.tsv 5-20000-replace-clever-nr.txt

Result exploration

(drawn from data scaled every 100 measures)

Analysis

Key points:

• All values over 19900 denote non convergence of the process: it has to be performed again with more iteration/time
• However, the level of achieved coherence/precision seems to indicate that convergence is not very far
• The curves on non empty can be thought of as an extrapolation of those with less agents but the scale is far larger
• The results on starting empty may be though similar

Further experiments:

• Experiments should be run with higher number of iterations (see 20171128-NOOR)
• and higher number of agents/variable numbers of ontology size

This file can be retrieved from URL https://sake.re/20171001-NOOR

It is possible to check out the repository by cloning https://felapton.inrialpes.fr/cakes/20171001-NOOR.git

This experiment has been transferred from its initial location at https://gforge.inria.fr (not available any more)

The original, unaltered associated zip file can be obtained from https://files.inria.fr/sakere/gforge/20171001-NOOR.zip