20170214a-NOOR

Experiment design

Revision of networks of ontologies comparing delete/replace/add and new reference (4 agents; 10000 iterations)

Hypothesis: Repetition of 20170208-NOOR with new version

Experimental setting: Repetition of 20170208-NOOR.

Experiment

Experimenter: Jérôme Euzenat (INRIA)

Date: 20170214

Lazy lavender hash: dc342dca26a5a6feff895b2a1829b04e7dfaa5ae

Parameters: params.sh

Command line (script.sh):

java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.1.9.jar:lib/slf4j/logback-core-1.1.9.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=4 -DnbIterations=10000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=delete

java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.1.9.jar:lib/slf4j/logback-core-1.1.9.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=4 -DnbIterations=10000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=replace

java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.1.9.jar:lib/slf4j/logback-core-1.1.9.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=4 -DnbIterations=10000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=add

Class used: NOOEnvironment, AlignmentAdjustingAgent, AlignmentRevisionExperiment, ActionLogger, AverageLogger, Monitor

Execution environment: Debian Linux virtual machine configured with four processors and 20GB of RAM running under a Dell PowerEdge T610 with 4*Intel Xeon Quad Core 1.9GHz E5-2420 processors, under Linux ProxMox 2 (Debian). - Java 1.8.0 HotSpot

Raw results

20170214a-NOOR-4-10000-add.tsv 20170214a-NOOR-4-10000-add.txt 20170214a-NOOR-4-10000-delete.tsv 20170214a-NOOR-4-10000-delete.txt 20170214a-NOOR-4-10000-replace.tsv 20170214a-NOOR-4-10000-replace.txt

Result exploration

modality	size	success	convergence	Incoherence degree	Precision	F-measure	Recall
delete	6	.99	445	0.	1.	.13	.07
replace	11	.99	1478	.01	.99	.21	.12
add	33	.98	1396	.14	.80	.52	.39

In red the average success rate (over 10 runs) of delete;
In blue the average success rate (over 10 runs) of replace;
In green the average success rate (over 10 runs) of add;
In dashed, the semantic F-measure.

Above: semantic precision;
Below: semantic recall.

(drawn from data scaled every 100 measures)

Analysis

Key points:

The results correspospond to those of 20170208-NOOR. See the analysis there.
Convergence seems slower.

Further experiments:

This file can be retrieved from URL https://sake.re/20170214a-NOOR

It is possible to check out the repository by cloning https://felapton.inrialpes.fr/cakes/20170214a-NOOR.git

This experiment has been transferred from its initial location at https://gforge.inria.fr (not available any more)