Experiment 20180531-NOOR¶

Starting with a realistic alignment size improves the final size (hence recall and F-measure)

Experiment design¶

Date: 20180723

Hypotheses: Starting with a realistic alignment size improves the final size (hence recall and F-measure)

Variation of: 20180307-NOOR

4 agents; 10 runs; 10000 games

Adaptation operators: delete replace refine add addjoin refadd

Experimental setting: Same as [[20180307-NOOR]] replaying the same runs as [[20180308-NOOR]] (with different initial alignments) and after fixing addjoin, expansion and real size estimation.

Variables¶

controled variables: ['revisionModality', 'expandAlignments', 'nonRedundancy', 'immediateRatio']

dependent variables: ['srate', 'size', 'inc', 'prec', 'fmeas', 'rec', 'conv']

Experiment¶

Date: 20180723

Performer: Jérôme Euzenat (INRIA)

Lazy lavender hash: d50e70f87bca76951ec2f149dc8ae1d42b9a1a28

Classpath: lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:.

OS: stretch

Parameter file: params.sh

Executed command (script.sh):

#!/bin/bash

for op in ${OPS}
do
   bash scripts/runexp.sh -d 4-10000-${op}-real java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op}
   bash scripts/runexp.sh -d 4-10000-${op}-im80-real java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DimmediateRatio=80
   bash scripts/runexp.sh -d 4-10000-${op}-clever-nr-real java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy
   bash scripts/runexp.sh -d 4-10000-${op}-clever-nr-im80-real java -Dlog.level=INFO -cp ${JPATH} fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80

done

exit

Class used: NOOEnvironment, AlignmentAdjustingAgent, AlignmentRevisionExperiment, ActionLogger, AverageLogger, Monitor

Execution environment: Debian Linux virtual machine configured with four processors and 20GB of RAM running under a Dell PowerEdge T610 with 4*Intel Xeon Quad Core 1.9GHz E5-2420 processors, under Linux ProxMox 2 (Debian). - Java 1.8.0 HotSpot

Raw results¶

Analysis¶

Systematic comparison of realistic (plain) with plain (20180308-NOOR), clever-nr (20180529-NOOR), im80 (20180311-NOOR) and clever-nr-im80 (20180530-NOOR) (all dashed):