20171128-NOOR

2018-09-17: expansion did not work properly since commit 562f5c4b96893d30e2dc9fd59d935e013ce5219f (see 20180917-NOOR)

Experiment design

Hypothesis:

Experimental setting: After 20171001-NOOR, we estimated that the convergence should be reached by 45000. Hence the experimental setting is the same as 20171001-NOOR with 45000 iterations

Experiment

Experimenter: Jérôme Euzenat (INRIA)

Date: 2017-11-28 to 2017-12-10

Lazy lavender hash: 9af56486cfe565bca783c866ed9c0f7d4ca520e5

Parameters: params.sh

Command line (script.sh):

for op in delete replace refine add addjoin refadd
do
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=5 -DnbIterations=45000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=5 -DnbIterations=45000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=5 -DnbIterations=45000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -Dgenerative
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=5 -DnbIterations=45000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80 -Dgenerative
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=5 -DnbIterations=45000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -Dgenerative -Dstartempty
   java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor -DnbAgents=5 -DnbIterations=45000 -DnbRuns=10 -DreportPrecRec -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80 -Dgenerative -Dstartempty
done

Class used: NOOEnvironment, AlignmentAdjustingAgent, AlignmentRevisionExperiment, ActionLogger, AverageLogger, Monitor

Execution environment: Debian Linux virtual machine configured with four processors and 20GB of RAM running under a Dell PowerEdge T610 with 4*Intel Xeon Quad Core 1.9GHz E5-2420 processors, under Linux ProxMox 2 (Debian). - Java 1.8.0_131-b11 HotSpot

Raw results

5-45000-add-clever-nr-gen-empty.tsv 5-45000-add-clever-nr-gen-empty.txt 5-45000-add-clever-nr-gen.tsv 5-45000-add-clever-nr-gen.txt 5-45000-add-clever-nr-im80-gen-empty.tsv 5-45000-add-clever-nr-im80-gen-empty.txt 5-45000-add-clever-nr-im80-gen.tsv 5-45000-add-clever-nr-im80-gen.txt 5-45000-add-clever-nr-im80.tsv 5-45000-add-clever-nr-im80.txt 5-45000-add-clever-nr.tsv 5-45000-add-clever-nr.txt 5-45000-addjoin-clever-nr-gen-empty.tsv 5-45000-addjoin-clever-nr-gen-empty.txt 5-45000-addjoin-clever-nr-gen.tsv 5-45000-addjoin-clever-nr-gen.txt 5-45000-addjoin-clever-nr-im80-gen-empty.tsv 5-45000-addjoin-clever-nr-im80-gen-empty.txt 5-45000-addjoin-clever-nr-im80-gen.tsv 5-45000-addjoin-clever-nr-im80-gen.txt 5-45000-addjoin-clever-nr-im80.tsv 5-45000-addjoin-clever-nr-im80.txt 5-45000-addjoin-clever-nr.tsv 5-45000-addjoin-clever-nr.txt 5-45000-delete-clever-nr-gen-empty.tsv 5-45000-delete-clever-nr-gen-empty.txt 5-45000-delete-clever-nr-gen.tsv 5-45000-delete-clever-nr-gen.txt 5-45000-delete-clever-nr-im80-gen-empty.tsv 5-45000-delete-clever-nr-im80-gen-empty.txt 5-45000-delete-clever-nr-im80-gen.tsv 5-45000-delete-clever-nr-im80-gen.txt 5-45000-delete-clever-nr-im80.tsv 5-45000-delete-clever-nr-im80.txt 5-45000-delete-clever-nr.tsv 5-45000-delete-clever-nr.txt 5-45000-refadd-clever-nr-gen-empty.tsv 5-45000-refadd-clever-nr-gen-empty.txt 5-45000-refadd-clever-nr-gen.tsv 5-45000-refadd-clever-nr-gen.txt 5-45000-refadd-clever-nr-im80-gen-empty.tsv 5-45000-refadd-clever-nr-im80-gen-empty.txt 5-45000-refadd-clever-nr-im80-gen.tsv 5-45000-refadd-clever-nr-im80-gen.txt 5-45000-refadd-clever-nr-im80.tsv 5-45000-refadd-clever-nr-im80.txt 5-45000-refadd-clever-nr.tsv 5-45000-refadd-clever-nr.txt 5-45000-refine-clever-nr-gen-empty.tsv 5-45000-refine-clever-nr-gen-empty.txt 5-45000-refine-clever-nr-gen.tsv 5-45000-refine-clever-nr-gen.txt 5-45000-refine-clever-nr-im80-gen-empty.tsv 5-45000-refine-clever-nr-im80-gen-empty.txt 5-45000-refine-clever-nr-im80-gen.tsv 5-45000-refine-clever-nr-im80-gen.txt 5-45000-refine-clever-nr-im80.tsv 5-45000-refine-clever-nr-im80.txt 5-45000-refine-clever-nr.tsv 5-45000-refine-clever-nr.txt 5-45000-replace-clever-nr-gen-empty.tsv 5-45000-replace-clever-nr-gen-empty.txt 5-45000-replace-clever-nr-gen.tsv 5-45000-replace-clever-nr-gen.txt 5-45000-replace-clever-nr-im80-gen-empty.tsv 5-45000-replace-clever-nr-im80-gen-empty.txt 5-45000-replace-clever-nr-im80-gen.tsv 5-45000-replace-clever-nr-im80-gen.txt 5-45000-replace-clever-nr-im80.tsv 5-45000-replace-clever-nr-im80.txt 5-45000-replace-clever-nr.tsv 5-45000-replace-clever-nr.txt

Result exploration

testsuccess
rate
network
size
incoherence
degree
semantic
precision
semantic
F-measure
semantic
recall
maximum
convergence
5-45000-delete-clever-nr1.00100.001.000.060.031264
5-45000-replace-clever-nr0.99230.020.950.110.063082
5-45000-refine-clever-nr0.99510.020.960.240.145399
5-45000-add-clever-nr0.981060.160.790.480.356084
5-45000-addjoin-clever-nr0.99540.090.850.300.183543
5-45000-refadd-clever-nr0.991180.090.870.510.365835
5-45000-delete-clever-nr-im801.00100.001.000.060.031274
5-45000-replace-clever-nr-im800.99250.001.000.110.062742
5-45000-refine-clever-nr-im800.99460.001.000.210.126715
5-45000-add-clever-nr-im800.98830.001.000.280.1711559
5-45000-addjoin-clever-nr-im800.99460.001.000.180.104785
5-45000-refadd-clever-nr-im800.991130.001.000.440.289198
5-45000-delete-clever-nr-gen0.952310.001.000.510.3442425
5-45000-replace-clever-nr-gen0.952290.001.000.520.3543617
5-45000-refine-clever-nr-gen0.952280.000.990.580.4143810
5-45000-add-clever-nr-gen0.902310.100.860.700.6044999
5-45000-addjoin-clever-nr-gen0.952280.030.970.620.4644995
5-45000-refadd-clever-nr-gen0.952340.060.930.700.5643466
5-45000-delete-clever-nr-im80-gen0.952330.001.000.520.3541060
5-45000-replace-clever-nr-im80-gen0.952260.001.000.520.3543583
5-45000-refine-clever-nr-im80-gen0.952310.001.000.560.3944569
5-45000-add-clever-nr-im80-gen0.902350.010.960.600.4344999
5-45000-addjoin-clever-nr-im80-gen0.952310.001.000.580.4143353
5-45000-refadd-clever-nr-im80-gen0.952380.001.000.650.4844996
5-45000-delete-clever-nr-gen-empty0.962600.001.000.540.3724415
5-45000-replace-clever-nr-gen-empty0.962600.001.000.530.3632084
5-45000-refine-clever-nr-gen-empty0.962600.001.000.530.3634034
5-45000-add-clever-nr-gen-empty0.932610.001.000.530.3644930
5-45000-addjoin-clever-nr-gen-empty0.962600.001.000.560.3940335
5-45000-refadd-clever-nr-gen-empty0.962600.001.000.540.3737134
5-45000-delete-clever-nr-im80-gen-empty0.962600.001.000.530.3628865
5-45000-replace-clever-nr-im80-gen-empty0.962600.001.000.540.3730616
5-45000-refine-clever-nr-im80-gen-empty0.962600.001.000.530.3735765
5-45000-add-clever-nr-im80-gen-empty0.932610.001.000.530.3644999
5-45000-addjoin-clever-nr-im80-gen-empty0.962600.001.000.560.3939725
5-45000-refadd-clever-nr-im80-gen-empty0.962600.001.000.550.3836307

(drawn from data scaled every 100 measures)

Analysis

Key points:

Further experiments:


This file can be retrieved from URL https://sake.re/20171128-NOOR

It is possible to check out the repository by cloning https://felapton.inrialpes.fr/cakes/20171128-NOOR.git

This experiment has been transferred from its initial location at https://gforge.inria.fr.

The original, unaltered associated zip file can be obtained from https://files.inria.fr/sakere/gforge/20171128-NOOR.zip