Revision of networks of ontologies with expansion and expansion and relaxation (4 agents; 10 runs; 10000 games; delete/replace/refine/add/addjoin/refadd)Designer: Jérôme Euzenat (INRIA) (2017-02-15)
Revision of networks of ontologies with expansion and expansion and relaxation (4 agents; 10 runs; 10000 games; delete/replace/refine/add/addjoin/refadd)
Hypotheses: Relaxation improves on expansion by reaching 100% precision
Experimental setting: Same as 20170529-NOOR and 20170215b-NOOR replaying the same runs as 20180308-NOOR (putatively) and after fixing addjoin and expansion.
Experimenter: Jérôme Euzenat (INRIA) (2018-05-30)
Date: 2018-05-30
Lazy lavender hash: d50e70f87bca76951ec2f149dc8ae1d42b9a1a28
Classpath: lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:.
OS: stretch
Variation of: 20170529-NOOR
Parameters: params.sh
Command line (script.sh):
#!/bin/bash
JPATH=lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:.
OPT="-DnbAgents=4 -DnbIterations=10000 -DnbRuns=10 -DreportPrecRec"
LOADOPT="-DloadDir=input/expeRun -DloadEnv -DloadAgents -DreplayGames"
for op in delete replace refine add addjoin refadd
do
bash scripts/runexp.sh -d 4-10000-${op}-clever-nr-im80 java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80
done
Class used: NOOEnvironment, AlignmentAdjustingAgent, AlignmentRevisionExperiment, ActionLogger, AverageLogger, Monitor
Execution environment: Debian Linux virtual machine configured with four processors and 20GB of RAM running under a Dell PowerEdge T610 with 4*Intel Xeon Quad Core 1.9GHz E5-2420 processors, under Linux ProxMox 2 (Debian). - Java 1.8.0 HotSpot
Input: Input required for reproducibility can be retrieved from: https://files.inria.fr/sakere/input/expeRun.zip Then unzip expeRun.zip -d input
4-10000-add-clever-nr-im80.tsv 4-10000-add-clever-nr-im80.txt 4-10000-addjoin-clever-nr-im80.tsv 4-10000-addjoin-clever-nr-im80.txt 4-10000-delete-clever-nr-im80.tsv 4-10000-delete-clever-nr-im80.txt 4-10000-refadd-clever-nr-im80.tsv 4-10000-refadd-clever-nr-im80.txt 4-10000-refine-clever-nr-im80.tsv 4-10000-refine-clever-nr-im80.txt 4-10000-replace-clever-nr-im80.tsv 4-10000-replace-clever-nr-im80.txt
All plots compare -clever-nr-im80 (this experiment, plain) with -clever-nr (20180529-NOOR, dotted) and im80 (20180311-NOOR, dashed).
| test | success rate | network size | incoherence degree | semantic precision | semantic F-measure | semantic recall | maximum convergence |
|---|---|---|---|---|---|---|---|
| 4-10000-delete-clever-nr-im80 | 0.98 | 13 | 0.00 | 1.00 | 0.23 | 0.13 | 2116 |
| 4-10000-replace-clever-nr-im80 | 0.97 | 25 | 0.00 | 1.00 | 0.39 | 0.24 | 3038 |
| 4-10000-refine-clever-nr-im80 | 0.96 | 34 | 0.00 | 1.00 | 0.52 | 0.35 | 2450 |
| 4-10000-add-clever-nr-im80 | 0.95 | 47 | 0.00 | 1.00 | 0.63 | 0.46 | 4578 |
| 4-10000-addjoin-clever-nr-im80 | 0.97 | 46 | 0.00 | 1.00 | 0.62 | 0.45 | 3191 |
| 4-10000-refadd-clever-nr-im80 | 0.96 | 70 | 0.00 | 1.00 | 0.85 | 0.73 | 8114 |
Analyst: Jérôme Euzenat (INRIA) (2018-08-16)
Key points:
Further experiments: none
This file can be retrieved from URL https://sake.re/20180530-NOOR
It is possible to check out the repository by cloning https://felapton.inrialpes.fr/cakes/20180530-NOOR.git
This experiment has been transferred from its initial location at https://gforge.inria.fr (not available any more)
The original, unaltered associated zip file can be obtained from https://files.inria.fr/sakere/gforge/20180530-NOOR.zip