Common use of Test and Evaluation Clause in Contracts

Test and Evaluation. The transfer selection component is tested by determining the transfer of a test lemma in a given sentence context, and comparing it with the one of a reference translation. In the best case, all translations proposed by the Lt-Xfr component are identical with the transfers selected in the reference translations. As the LinguaDict lexicon contains many near translations, which can hardly be distinguished on the basis of conceptual transfer, a special evaluation procedure was adopted, consisting of three ranks instead of a binary decision:  Rank 1: the translation proposed by the system is identical to the one in the test reference sentence  Rank 2: the proposed translation close / synonym to the one in the test reference sentence. This was decided to be the case if o the proposed translation belongs to the same WordNet synset as the reference o the proposed translation is orthographically similar to the reference (like: ‘electric’ vs. ‘electrical’, ‘agglutinating’ vs. ‚agglutinative‘, ‘dialogue’ (UK) vs. ‘dialog’ (US) etc.  Rank 3: the two translations are (still) different. Evaluation would allow rank1 and rank2, and reject rank3 results. Based on the three ranks, a simple scoring system is used (rank1 = 1, rank2 = 2, rank3 = 3) to compute an overall score: The lower the score the closer the translation is to the reference.

Appears in 2 contracts

Sources: Grant Agreement, Grant Agreement