Experiment 20140408-NOOR¶

Varying the ratio of disjointness has little effect

Experiment design¶

Date: 2014-04-08

Hypotheses: Diminishing the disjointness ratio (the proportion of disjointness statements in the ontologies) has an influence on the results

Variation of: 20140305-NOOR

4 agents; 10 runs; 2000 games

Adaptation operators: add

Disjointness ratios: 100 80 60 40 20 0

Experimental setting: Same as [20140305-NOOR] with disjointness ratio set to 100, 80, 60, 40, 20, and 0

Variables¶

controled variables: ['disjointRatio']

dependent variables: ['srate', 'size', 'inc', 'fmeas', 'conv']

Experiment¶

Date: 2014-04-08

Performer: Jérôme Euzenat (INRIA)

Lazy lavender hash: 89f0656ffc28a6c4560a7a55cf1508d866528a96

Classpath: lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:.

OS: wheezy

Parameter file: params.sh

Executed command (script.sh):

#!/bin/bash

. params.sh

for dr in ${DISJOINTRATIO}
do
	java -Xms500M -Xmx1G -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} -DdisjointRatio=${dr} > /tmp/20140408-${OPS}${NBAGENTS}-${NBITERATIONS}-${dr}.txt
done

Class used: NOOEnvironment, AlignmentAdjustingAgent, AlignmentRevisionExperiment, ActionLogger, AverageLogger, Monitor.

Execution environment: Debian Linux virtual machine configured with four processors and 20GB of RAM running under a Dell PowerEdge T610 with 2*Intel Xeon Quad Core 2.26GHz E5607 processors and 32GB of RAM, under Linux ProxMox 2 (Debian). - Java 1.6.0 HotSpot

Raw results¶

results/
  20140408-NOOR-add4-2000-40.txt
  20140408-NOOR-add4-2000-100.txt
  20140408-NOOR-add4-2000-100.tsv
  20140408-NOOR-add4-2000-80.tsv
  20140408-NOOR-add4-2000-40.tsv
  20140408-NOOR-add4-2000-60.tsv
  20140408-NOOR-add4-2000-60.txt
  20140408-NOOR-add4-2000-20.tsv
  20140408-NOOR-add4-2000-20.txt
  20140408-NOOR-add4-2000-0.txt
  20140408-NOOR-add4-2000-80.txt
  20140408-NOOR-add4-2000-0.tsv

Analysis¶

Initial results¶

Measure	Size	Success rate	Incoherence	Semantic F-measure	Size	Convergence	Semantic F-measure	Size	Semantic F-measure	Size
DisjRatio	Reference	Final	Final	Final	Final	Final	LogMap	LogMap	Alcomo	Alcomo
100	54.00	0.89	0.00	0.23	12.50	1177	0.25	36.80	0.26	27.20
80	54.00	0.89	0.00	0.23	15.00	1214	0.25	34.10	0.26	28.30
60	54.00	0.89	0.00	0.23	13.00	1358	0.26	36.70	0.25	28.40
40	54.00	0.89	0.00	0.22	13.90	1425	0.24	35.60	0.25	27.80
20	54.00	0.88	0.00	0.20	11.50	1516	0.25	35.90	0.25	28.10
0	54.00	0.89	0.00	0.24	14.10	1923	0.27	34.60	0.26	27.70

Discussion¶

Key points¶

The ratio of disjointness does not seem to make much difference either for agents or for LogMap and Alcomo.

This file can be retrieved from URL https://sake.re/20140408-NOOR

It is possible to check out the repository by cloning https://felapton.inrialpes.fr/cakes/20140408-NOOR.git

This experiment has been transferred from its initial location at https://gforge.inria.fr (not available any more)

See original markdown (20140408-NOOR.md) or HTML (20140408-NOOR.html) files.