20170917-NOOR

2018-05-16: Under scrutiny because expansion did not work since commit 562f5c4b96893d30e2dc9fd59d935e013ce5219f

Experiment design

Hypothesis:

• The trends observed in 20170530-NOOR and 20170531-NOOR do not depend on the number of agents

Experimental setting: Same as 20170530-NOOR and 20170531-NOOR with 6 agents

Experiment

Experimenter: Jérôme Euzenat (INRIA)

Date: 2017-09-17 to 19

Lazy lavender hash: 562f5c4b96893d30e2dc9fd59d935e013ce5219f

Parameters: params.sh

Command line (script.sh):

for op in delete replace refine add addjoin refadd
do
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=6 -DnbIterations=10000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=6 -DnbIterations=10000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=6 -DnbIterations=10000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -Dgenerative
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=6 -DnbIterations=10000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80 -Dgenerative
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=6 -DnbIterations=10000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -Dgenerative -Dstartempty
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=6 -DnbIterations=10000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80 -Dgenerative -Dstartempty
done

Class used: NOOEnvironment, AlignmentAdjustingAgent, AlignmentRevisionExperiment, ActionLogger, AverageLogger, Monitor

Execution environment: Debian Linux virtual machine configured with four processors and 20GB of RAM running under a Dell PowerEdge T610 with 4*Intel Xeon Quad Core 1.9GHz E5-2420 processors, under Linux ProxMox 2 (Debian). - Java 1.8.0_131-b11 HotSpot

Raw results

6-10000-add-clever-nr-gen-empty.tsv 6-10000-add-clever-nr-gen-empty.txt 6-10000-add-clever-nr-gen.tsv 6-10000-add-clever-nr-gen.txt 6-10000-add-clever-nr-im80-gen-empty.tsv 6-10000-add-clever-nr-im80-gen-empty.txt 6-10000-add-clever-nr-im80-gen.tsv 6-10000-add-clever-nr-im80-gen.txt 6-10000-add-clever-nr-im80.tsv 6-10000-add-clever-nr-im80.txt 6-10000-add-clever-nr.tsv 6-10000-add-clever-nr.txt 6-10000-addjoin-clever-nr-gen-empty.tsv 6-10000-addjoin-clever-nr-gen-empty.txt 6-10000-addjoin-clever-nr-gen.tsv 6-10000-addjoin-clever-nr-gen.txt 6-10000-addjoin-clever-nr-im80-gen-empty.tsv 6-10000-addjoin-clever-nr-im80-gen-empty.txt 6-10000-addjoin-clever-nr-im80-gen.tsv 6-10000-addjoin-clever-nr-im80-gen.txt 6-10000-addjoin-clever-nr-im80.tsv 6-10000-addjoin-clever-nr-im80.txt 6-10000-addjoin-clever-nr.tsv 6-10000-addjoin-clever-nr.txt 6-10000-delete-clever-nr-gen-empty.tsv 6-10000-delete-clever-nr-gen-empty.txt 6-10000-delete-clever-nr-gen.tsv 6-10000-delete-clever-nr-gen.txt 6-10000-delete-clever-nr-im80-gen-empty.tsv 6-10000-delete-clever-nr-im80-gen-empty.txt 6-10000-delete-clever-nr-im80-gen.tsv 6-10000-delete-clever-nr-im80-gen.txt 6-10000-delete-clever-nr-im80.tsv 6-10000-delete-clever-nr-im80.txt 6-10000-delete-clever-nr.tsv 6-10000-delete-clever-nr.txt 6-10000-refadd-clever-nr-gen-empty.tsv 6-10000-refadd-clever-nr-gen-empty.txt 6-10000-refadd-clever-nr-gen.tsv 6-10000-refadd-clever-nr-gen.txt 6-10000-refadd-clever-nr-im80-gen-empty.tsv 6-10000-refadd-clever-nr-im80-gen-empty.txt 6-10000-refadd-clever-nr-im80-gen.tsv 6-10000-refadd-clever-nr-im80-gen.txt 6-10000-refadd-clever-nr-im80.tsv 6-10000-refadd-clever-nr-im80.txt 6-10000-refadd-clever-nr.tsv 6-10000-refadd-clever-nr.txt 6-10000-refine-clever-nr-gen-empty.tsv 6-10000-refine-clever-nr-gen-empty.txt 6-10000-refine-clever-nr-gen.tsv 6-10000-refine-clever-nr-gen.txt 6-10000-refine-clever-nr-im80-gen-empty.tsv 6-10000-refine-clever-nr-im80-gen-empty.txt 6-10000-refine-clever-nr-im80-gen.tsv 6-10000-refine-clever-nr-im80-gen.txt 6-10000-refine-clever-nr-im80.tsv 6-10000-refine-clever-nr-im80.txt 6-10000-refine-clever-nr.tsv 6-10000-refine-clever-nr.txt 6-10000-replace-clever-nr-gen-empty.tsv 6-10000-replace-clever-nr-gen-empty.txt 6-10000-replace-clever-nr-gen.tsv 6-10000-replace-clever-nr-gen.txt 6-10000-replace-clever-nr-im80-gen-empty.tsv 6-10000-replace-clever-nr-im80-gen-empty.txt 6-10000-replace-clever-nr-im80-gen.tsv 6-10000-replace-clever-nr-im80-gen.txt 6-10000-replace-clever-nr-im80.tsv 6-10000-replace-clever-nr-im80.txt 6-10000-replace-clever-nr.tsv 6-10000-replace-clever-nr.txt

Result exploration

(drawn from data scaled every 100 measures)

Analysis

Key points:

• All values over 9900 denote non convergence of the process: it has to be performed again with more iteration/time
• The curves on non empty can be thought of as an extrapolation of those with less agents but the scale is far larger
• The results on starting empty may be though similar
• The behaviour of 'add' is more different than with the previous experiments

Further experiments:

• Experiments should be run with higher number of iterations
• and higher number of agents/variable numbers of ontology size

This file can be retrieved from URL https://sake.re/20170917-NOOR

It is possible to check out the repository by cloning https://felapton.inrialpes.fr/cakes/20170917-NOOR.git

This experiment has been transferred from its initial location at https://gforge.inria.fr (not available any more)

The original, unaltered associated zip file can be obtained from https://files.inria.fr/sakere/gforge/20170917-NOOR.zip