20170607-NOOR

Experiment design

Revision of networks of ontologies with expansion, relaxation starting from empty networks (4 agents; 10 runs; 10000 games; del/replace/refine/add/addjoin/refadd)

Hypotheses:

Experimental setting: Same as 20170529-NOOR starting with empty networks.

Experiment

Experimenter: Jérôme Euzenat (INRIA)

Date: 20170607 (this has been made after the experiments of 2017-05-30, because the issue was already known. This has been rerun again for completeness) Lazy lavender hash: 997c4a9c1b698616c49342bb1fa5a6b8adf7faf8

Parameters: params.sh

Command line (script.sh):

for op in delete replace refine add addjoin refadd
do
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.1.9.jar:lib/slf4j/logback-core-1.1.9.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=4 -DnbIterations=10000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -Dstartempty
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.1.9.jar:lib/slf4j/logback-core-1.1.9.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=4 -DnbIterations=10000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80 -Dstartempty
done

Class used: NOOEnvironment, AlignmentAdjustingAgent, AlignmentRevisionExperiment, ActionLogger, AverageLogger, Monitor

Execution environment: Debian Linux virtual machine configured with four processors and 20GB of RAM running under a Dell PowerEdge T610 with 4*Intel Xeon Quad Core 1.9GHz E5-2420 processors, under Linux ProxMox 2 (Debian). - Java 1.8.0 HotSpot

We do not provide the full logs as all tsv log files are the same (as MediaWiki detects them [when in gforge]), we only uploaded the two first ones.

Raw results

20170607-NOOR-4-10000-add-clever-nr-empty.txt 20170607-NOOR-4-10000-add-clever-nr-im80-empty.txt 20170607-NOOR-4-10000-addjoin-clever-nr-empty.txt 20170607-NOOR-4-10000-addjoin-clever-nr-im80-empty.txt 20170607-NOOR-4-10000-delete-clever-nr-empty.tsv 20170607-NOOR-4-10000-delete-clever-nr-empty.txt 20170607-NOOR-4-10000-delete-clever-nr-im80-empty.txt 20170607-NOOR-4-10000-refadd-clever-nr-empty.txt 20170607-NOOR-4-10000-refadd-clever-nr-im80-empty.txt 20170607-NOOR-4-10000-refine-clever-nr-empty.txt 20170607-NOOR-4-10000-refine-clever-nr-im80-empty.txt 20170607-NOOR-4-10000-replace-clever-nr-empty.tsv 20170607-NOOR-4-10000-replace-clever-nr-empty.txt 20170607-NOOR-4-10000-replace-clever-nr-im80-empty.txt

Result exploration

testsuccess
rate
network
size
incoherence
degree
semantic
precision
semantic
F-measure
semantic
recall
maximum
convergence
4-10000-delete-clever-nr-empty1.00120.001.000.130.071
4-10000-replace-clever-nr-empty1.00120.001.000.130.071
4-10000-refine-clever-nr-empty1.00120.001.000.130.071
4-10000-add-clever-nr-empty1.00120.001.000.130.071
4-10000-addjoin-clever-nr-empty1.00120.001.000.130.071
4-10000-refadd-clever-nr-empty1.00120.001.000.130.071
4-10000-delete-clever-nr-im80-empty1.00120.001.000.130.071
4-10000-replace-clever-nr-im80-empty1.00120.001.000.130.071
4-10000-refine-clever-nr-im80-empty1.00120.001.000.130.071
4-10000-add-clever-nr-im80-empty1.00120.001.000.130.071
4-10000-addjoin-clever-nr-im80-empty1.00120.001.000.130.071
4-10000-refadd-clever-nr-im80-empty1.00120.001.000.130.071

Analysis

Key points:

Further experiments:


This file can be retrieved from URL https://sake.re/20170607-NOOR

It is possible to check out the repository by cloning https://felapton.inrialpes.fr/cakes/20170607-NOOR.git

This experiment has been transferred from its initial location at https://gforge.inria.fr (not available any more)