# 20180601-NOOR

## Experiment design
**Designer**: Jérôme Euzenat (INRIA) (2017-05-30)

[<img src='../imgs/icon8-docker-50.png' align='right' width='50px' />](../dockerfiles/stretch.dkr) [<img src='../imgs/icon8-blue-docker-50.png' align='right' width='50px' />](20180601-NOOR.dkr)
Revision of networks of ontologies with expansion, relaxation and generation starting with random network (4 agents; 10 runs; 10000 games; delete/replace/refine/add/addjoin/refadd)

**Hypotheses**:
Generating correspondences when needed should increase results quality (recall) with respect to expansion

**Experimental setting**: 
Same as [20170530-NOOR](../20170530-NOOR) replaying the same runs as [20180308-NOOR](../20180308-NOOR) and after fixing addjoin and expansion.

## Experiment
**Experimenter**: Jérôme Euzenat (INRIA) (2018-06-01)

**Date**: 2018-06-01

**Lazy lavender hash**: d50e70f87bca76951ec2f149dc8ae1d42b9a1a28

**Classpath**: `lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:.`

**OS**: stretch

**Variation of**: [20170530-NOOR](../20170530-NOOR)

**Parameters**: [params.sh](params.sh)

**Command line** ([script.sh](script.sh)):
~~~~
#!/bin/bash

JPATH=lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:.

OPT="-DnbAgents=4 -DnbIterations=10000 -DnbRuns=10 -DreportPrecRec"

LOADOPT="-DloadDir=input/expeRun -DloadEnv -DloadAgents -DreplayGames"

for op in delete replace refine add addjoin refadd
do
  bash scripts/runexp.sh -d 4-10000-${op}-clever-nr-gen java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -Dgenerative
  bash scripts/runexp.sh -d 4-10000-${op}-clever-nr-im80-gen java -Dlog.level=INFO -cp lib/lazylav/ll.jar:lib/slf4j/logback-classic-1.2.3.jar:lib/slf4j/logback-core-1.2.3.jar:. fr.inria.exmo.lazylavender.engine.Monitor ${OPT} ${LOADOPT} -DrevisionModality=${op} -DexpandAlignments=clever -DnonRedundancy -DimmediateRatio=80 -Dgenerative
done
~~~~

**Class used**: 
NOOEnvironment, AlignmentAdjustingAgent, AlignmentRevisionExperiment, ActionLogger, AverageLogger, Monitor

**Execution environment**:
Debian Linux virtual machine configured with four processors and 20GB of RAM running under a Dell PowerEdge T610 with 4*Intel Xeon Quad Core 1.9GHz E5-2420 processors, under Linux ProxMox 2 (Debian). - Java 1.8.0 HotSpot



**Input**: Input required for reproducibility can be retrieved from
[https://files.inria.fr/sakere/input/expeRun.zip](https://files.inria.fr/sakere/input/expeRun.zip) or [![doi:10.5281/zenodo.4912599](https://zenodo.org/badge/DOI/10.5281/zenodo.4912599.svg)](https://doi.org/10.5281/zenodo.4912599)
Then `unzip expeRun.zip -d input`

### Raw results

[4-10000-add-clever-nr-gen.tsv](results/4-10000-add-clever-nr-gen.tsv) 
[4-10000-add-clever-nr-gen.txt](results/4-10000-add-clever-nr-gen.txt) 
[4-10000-add-clever-nr-im80-gen.tsv](results/4-10000-add-clever-nr-im80-gen.tsv) 
[4-10000-add-clever-nr-im80-gen.txt](results/4-10000-add-clever-nr-im80-gen.txt) 
[4-10000-addjoin-clever-nr-gen.tsv](results/4-10000-addjoin-clever-nr-gen.tsv) 
[4-10000-addjoin-clever-nr-gen.txt](results/4-10000-addjoin-clever-nr-gen.txt) 
[4-10000-addjoin-clever-nr-im80-gen.tsv](results/4-10000-addjoin-clever-nr-im80-gen.tsv) 
[4-10000-addjoin-clever-nr-im80-gen.txt](results/4-10000-addjoin-clever-nr-im80-gen.txt) 
[4-10000-delete-clever-nr-gen.tsv](results/4-10000-delete-clever-nr-gen.tsv) 
[4-10000-delete-clever-nr-gen.txt](results/4-10000-delete-clever-nr-gen.txt) 
[4-10000-delete-clever-nr-im80-gen.tsv](results/4-10000-delete-clever-nr-im80-gen.tsv) 
[4-10000-delete-clever-nr-im80-gen.txt](results/4-10000-delete-clever-nr-im80-gen.txt) 
[4-10000-refadd-clever-nr-gen.tsv](results/4-10000-refadd-clever-nr-gen.tsv) 
[4-10000-refadd-clever-nr-gen.txt](results/4-10000-refadd-clever-nr-gen.txt) 
[4-10000-refadd-clever-nr-im80-gen.tsv](results/4-10000-refadd-clever-nr-im80-gen.tsv) 
[4-10000-refadd-clever-nr-im80-gen.txt](results/4-10000-refadd-clever-nr-im80-gen.txt) 
[4-10000-refine-clever-nr-gen.tsv](results/4-10000-refine-clever-nr-gen.tsv) 
[4-10000-refine-clever-nr-gen.txt](results/4-10000-refine-clever-nr-gen.txt) 
[4-10000-refine-clever-nr-im80-gen.tsv](results/4-10000-refine-clever-nr-im80-gen.tsv) 
[4-10000-refine-clever-nr-im80-gen.txt](results/4-10000-refine-clever-nr-im80-gen.txt) 
[4-10000-replace-clever-nr-gen.tsv](results/4-10000-replace-clever-nr-gen.tsv) 
[4-10000-replace-clever-nr-gen.txt](results/4-10000-replace-clever-nr-gen.txt) 
[4-10000-replace-clever-nr-im80-gen.tsv](results/4-10000-replace-clever-nr-im80-gen.tsv) 
[4-10000-replace-clever-nr-im80-gen.txt](results/4-10000-replace-clever-nr-im80-gen.txt) 

## Result exploration

Systematic comparison of clever-nr (dashed, [20180529-NOOR](../20180529-NOOR)) to clever-nr-gen (plain) and clever-nr-im80 (dashed, [20180530-NOOR](../20180530-NOOR)) to clever-nr-im80-gen (plain):


<img src='imgs/20180601-NOOR-0.png' align='center'/>


<img src='imgs/20180601-NOOR-1.png' align='center'/>


<img src='imgs/20180601-NOOR-2.png' align='center'/>


<img src='imgs/20180601-NOOR-3.png' align='center'/>


<img src='imgs/20180601-NOOR-4.png' align='center'/>


<style type="text/css">
.result-table {
width: 100%;
border-collapse: collapse;
border-spacing: 0;
}
.result-table td, th { border: 1px solid #CCC; }
</style>
<table class="result-table">
<tr><th>test</th><th>success<br />rate</th><th>network<br />size</th><th>incoherence<br />degree</th><th>semantic<br />precision</th><th>semantic<br />F-measure</th><th>semantic<br />recall</th><th>maximum<br />convergence</th></tr>
<tr><td>4-10000-delete-clever-nr-gen</td><td>0.94</td><td>58</td><td>0.12</td><td>0.85</td><td>0.67</td><td>0.55</td><td>8076</td></tr>
<tr><td>4-10000-replace-clever-nr-gen</td><td>0.94</td><td>61</td><td>0.13</td><td>0.84</td><td>0.71</td><td>0.62</td><td>7952</td></tr>
<tr><td>4-10000-refine-clever-nr-gen</td><td>0.94</td><td>70</td><td>0.16</td><td>0.80</td><td>0.76</td><td>0.71</td><td>7727</td></tr>
<tr><td>4-10000-add-clever-nr-gen</td><td>0.91</td><td>74</td><td>0.23</td><td>0.73</td><td>0.77</td><td>0.83</td><td>8825</td></tr>
<tr><td>4-10000-addjoin-clever-nr-gen</td><td>0.95</td><td>76</td><td>0.23</td><td>0.72</td><td>0.76</td><td>0.81</td><td>6238</td></tr>
<tr><td>4-10000-refadd-clever-nr-gen</td><td>0.94</td><td>78</td><td>0.23</td><td>0.70</td><td>0.76</td><td>0.85</td><td>7721</td></tr>

<tr style="border-top: 1px solid #CCC;"><td>4-10000-delete-clever-nr-im80-gen</td><td>0.93</td><td>51</td><td>0.00</td><td>1.00</td><td>0.60</td><td>0.43</td><td>9646</td></tr>
<tr><td>4-10000-replace-clever-nr-im80-gen</td><td>0.94</td><td>55</td><td>0.00</td><td>1.00</td><td>0.64</td><td>0.47</td><td>8048</td></tr>
<tr><td>4-10000-refine-clever-nr-im80-gen</td><td>0.93</td><td>64</td><td>0.00</td><td>1.00</td><td>0.76</td><td>0.62</td><td>6460</td>
<tr><td>4-10000-add-clever-nr-im80-gen</td><td>0.91</td><td>67</td><td>0.00</td><td>1.00</td><td>0.79</td><td>0.65</td><td>9351</td></tr>
<tr><td>4-10000-addjoin-clever-nr-im80-gen</td><td>0.95</td><td>69</td><td>0.00</td><td>1.00</td><td>0.80</td><td>0.67</td><td>6982</td></tr>
<tr><td>4-10000-refadd-clever-nr-im80-gen</td><td>0.94</td><td>75</td><td>0.00</td><td>1.00</td><td>0.86</td><td>0.76</td><td>7774</td></tr>
</tr>
</table>

## Analysis

**Analyst**: Jérôme Euzenat (INRIA) (2018-08-16)


**Key points**:
* The generative modality always generates larger alignments
* It is always slower to converge
* Always generates a higher F-measure and recall
* Has a lower precision wrt clever-nr, but preserves the same 100% precision as -im80
These are the same conclusions as [20170530-NOOR](../20170530-NOOR)

**Further experiments**:
none


----

This file can be retrieved from URL [https://sake.re/20180601-NOOR](https://sake.re/20180601-NOOR)
<!-- A zip of the whole experiment data can be found at [DOI]() -->
It is possible to check out the repository by cloning <span style="color: blue;">https://felapton.inrialpes.fr/cakes/20180601-NOOR.git</span>

This experiment has been transferred from its initial location at https://gforge.inria.fr (not available any more)

The original, unaltered associated zip file can be obtained from [https://files.inria.fr/sakere/gforge/20180601-NOOR.zip](https://files.inria.fr/sakere/gforge/20180601-NOOR.zip)