[Mova](https://md.mova.elamur.ai/free/en/) · [this page in HTML](https://mova.elamur.ai/free/en/docs/papers/cartagena-2011-integrating-shallow-transfer-rules-into/)

[home](https://md.mova.elamur.ai/free/en/) / [docs](https://md.mova.elamur.ai/free/en/docs/) / [papers](https://md.mova.elamur.ai/free/en/docs/papers/) / [Machine translation](https://md.mova.elamur.ai/free/en/docs/papers/mtrans/) / Integrating shallow-transfer rules into phrase-based statistical machine translation

# Integrating shallow-transfer rules into phrase-based statistical machine translation

**Authors:** Víctor M. Sánchez-Cartagena, [Felipe Sánchez-Martínez](https://md.mova.elamur.ai/free/en/docs/papers/authors/felipe-sanchez-martinez/), [Juan Antonio Pérez-Ortiz](https://md.mova.elamur.ai/free/en/docs/papers/authors/juan-antonio-perez-ortiz/) · **Year:** 2011 · **Venue:** Machine Translation Summit XIII **Link:** [aclanthology.org/2011.mtsummit-papers.64](https://aclanthology.org/2011.mtsummit-papers.64/) · **Licence:** [CC BY-NC-SA 3.0](https://creativecommons.org/licenses/by-nc-sa/3.0/) — summary only

[**11** citations](https://openalex.org/works?filter=cites:W568992468) openalex · 2026-10-19[**6** citations in our library](https://md.mova.elamur.ai/free/en/docs/papers/cited-by/cartagena-2011-integrating-shallow-transfer-rules-into/) of the 140673 papers whose bibliographies we read[Proceedings of Machine Translation Summit XIII: Papers](https://aclanthology.org/volumes/2011.mtsummit-papers/)[licence](https://creativecommons.org/licenses/by-nc-sa/3.0/)

- [Publisher's page](https://aclanthology.org/2011.mtsummit-papers.64/)
- [PDF](https://aclanthology.org/2011.mtsummit-papers.64.pdf)
- [OpenAlex](https://openalex.org/W568992468)

**Authors (3)**

1. Víctor M. Sánchez-Cartagena
2. Felipe Sánchez-Martínez
3. Juan Antonio Pérez-Ortiz

Citations and author metrics from openalex (2026-10-19); authors with the same name are not always told apart.

## What it is about

A hybrid method that feeds a phrase-based statistical system with the knowledge of a shallow-transfer rule system. Each Apertium dictionary entry, and each span of text matched by a structural transfer rule, is turned into a bilingual phrase pair, and the pairs are added to the phrase table. Three ways of scoring the new pairs are compared: appending them to the corpus, adding them once to the table with a boolean flag, or both. Experiments use Spanish-English in both directions on Europarl training sizes from 5,000 sentences up to all of it, in-domain and out-of-domain. The gain is largest when training data is small and the test text is general news that the rules cover. For Spanish-English out-of-domain with 5,000 training sentences, BLEU rises from 14.33 for the baseline to 21.32 with phrase-rules; with the whole corpus the gain is smaller (24.23 to 24.81). Generating only the spans that occur in the input avoids meaningless combinations.

## Ideas

- I1. Add a boolean feature to the translator's encoder table that marks chunks coming from curated author deltas, as the phrase-rules variant does. A curated chunk should not be drowned by counts of the corpus, so the scorer needs to know where a chunk came from.
- I2. Generate candidate multi-word chunks only from spans that occur in the input text, not from every combination of dictionary entries. For the encoder, this means building chunks from the anchors of the frames in the sentence, which avoids the combinatorial junk the paper warns about.
- I3. Report gains by training size and by domain, as the paper does. For the translator, show the curve of exact-match against the number of verse pairs, separately for verses that are narrative and verses that are poetic or legal.
- I4. Give multi-word units a fixed alignment instead of letting the aligner split them. The paper leaves them unaligned and gives them a weight of 1.0. In the Hebrew reader, a dictionary multi-word unit could be fixed before IBM Model 1 runs.

## For Mova

The code is tools/translate (ibm.rs for alignment, profile.rs for the encoder table, hebrew.rs for the reader). The phrase-pair generation idea fits the encoder; the boolean-flag scoring is cheap to test in profile.rs. Mova is not a phrase-based system, so none of the SMT scoring is copied, and the claims above must be measured on the Bible pairs before they are stated.

Topics: [Machine translation](https://md.mova.elamur.ai/free/en/docs/papers/topics/machine-translation/)

## Cite

The paper itself, not this card. BibTeX from the library's record of the work.

```
@inproceedings{sanchezcartagena2011integrating,
  title = {{Integrating shallow-transfer rules into phrase-based statistical machine translation}},
  author = {Sánchez-Cartagena, Víctor M. and Sánchez-Martínez, Felipe and Pérez-Ortiz, Juan Antonio},
  booktitle = {Proceedings of Machine Translation Summit XIII: Papers},
  year = {2011},
  url = {https://aclanthology.org/2011.mtsummit-papers.64/}
}
```

- [← previous Evaluating prose style transfer with the Bible](https://md.mova.elamur.ai/free/en/docs/papers/carlson-2017-evaluating-prose-style-transfer-bible/)
- [next → Unsupervised AMR-Dependency Parse Alignment](https://md.mova.elamur.ai/free/en/docs/papers/chen-2017-unsupervised-amr-dependency-parse-alignment/)
- [↑ back to Machine translation](https://md.mova.elamur.ai/free/en/docs/papers/mtrans/)

## References

21 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. P. F. Brown, S. A. D. Pietra, V. J. D. Pietra, M. J. Goldsmith, J. Hajic, R. L. Mercer, and S. Mohanty. 1993. But dictionaries are data too. In Proceedings of the workshop on Human Language Technology, pages 202–205. [find](https://scholar.google.com/scholar?q=P%2E+F%2E+Brown%2C+S%2E+A%2E+D%2E+Pietra%2C+V%2E+J%2E+D%2E+Pietra%2C+M%2E+J%2E+Goldsmith%2C+J%2E+Hajic%2C+R%2E+L%2E+Mercer%2C+and+S%2E+Mohanty%2E+1993%2E+But+dictionaries+are+data+too%2E+In+Proceedings+of+the+workshop+on+Human+Language+Technology)
2. C. Callison-Burch, P. Koehn, C. Monz, and O. Zaidan. 2011. Findings of the 2011 workshop on statistical machine translation. In Proceedings of the Sixth Workshop on Statistical Machine Translation, pages 22–64. [find](https://scholar.google.com/scholar?q=C%2E+Callison%2DBurch%2C+P%2E+Koehn%2C+C%2E+Monz%2C+and+O%2E+Zaidan%2E+2011%2E+Findings+of+the+2011+workshop+on+statistical+machine+translation%2E+In+Proceedings+of+the+Sixth+Workshop+on+Statistical+Machine+Translation%2C+pa)
3. L. Dugast, J. Senellart, and P. Koehn. 2007. Statistical post-editing on SYSTRAN’s rule-based translation system. In Proceedings of the Second Workshop on Statistical Machine Translation, pages 220–223. [find](https://scholar.google.com/scholar?q=L%2E+Dugast%2C+J%2E+Senellart%2C+and+P%2E+Koehn%2E+2007%2E+Statistical+post%2Dediting+on+SYSTRAN%E2%80%99s+rule%2Dbased+translation+system%2E+In+Proceedings+of+the+Second+Workshop+on+Statistical+Machine+Translation%2C+pages+220%E2%80%9322)
4. L. Dugast, J. Senellart, and P. Koehn. 2008. Can we Relearn an RBMT System? In Proceedings of the Third Workshop on Statistical Machine Translation, pages 175–178. [find](https://scholar.google.com/scholar?q=L%2E+Dugast%2C+J%2E+Senellart%2C+and+P%2E+Koehn%2E+2008%2E+Can+we+Relearn+an+RBMT+System%3F+In+Proceedings+of+the+Third+Workshop+on+Statistical+Machine+Translation%2C+pages+175%E2%80%93178%2E)
5. A. Eisele, C. Federmann, H. Saint-Amand, M. Jellinghaus, T. Herrmann, and Y. Chen. 2008. Using Moses to integrate multiple rule-based machine translation engines into a hybrid system. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 179–182. [find](https://scholar.google.com/scholar?q=A%2E+Eisele%2C+C%2E+Federmann%2C+H%2E+Saint%2DAmand%2C+M%2E+Jellinghaus%2C+T%2E+Herrmann%2C+and+Y%2E+Chen%2E+2008%2E+Using+Moses+to+integrate+multiple+rule%2Dbased+machine+translation+engines+into+a+hybrid+system%2E+In+Proceedings+o)
6. M.L. Forcada, M. Ginestı́-Rosell, J. Nordfalk, J. O’Regan, S. Ortiz-Rojas, J.A. Pérez-Ortiz, F. Sánchez-Martı́nez, G. Ramı́rez-Sánchez, and F.M. Tyers. 2011. Apertium: a free/open-source platform for rule-based machine translation. Machine Translation. Special Issue on Free/Open-Source Machine Translation, In press. [find](https://scholar.google.com/scholar?q=M%2EL%2E+Forcada%2C+M%2E+Ginest%C4%B1%CC%81%2DRosell%2C+J%2E+Nordfalk%2C+J%2E+O%E2%80%99Regan%2C+S%2E+Ortiz%2DRojas%2C+J%2EA%2E+Pe%CC%81rez%2DOrtiz%2C+F%2E+Sa%CC%81nchez%2DMart%C4%B1%CC%81nez%2C+G%2E+Ram%C4%B1%CC%81rez%2DSa%CC%81nchez%2C+and+F%2EM%2E+Tyers%2E+2011%2E+Apertium%3A+a+free%2Fopen%2Dsource+platform+f)
7. J. Goodman and S. F. Chen. 1998. An empirical study of smoothing techniques for language modeling. Technical Report TR-10-98, Harvard University, August. [find](https://scholar.google.com/scholar?q=J%2E+Goodman+and+S%2E+F%2E+Chen%2E+1998%2E+An+empirical+study+of+smoothing+techniques+for+language+modeling%2E+Technical+Report+TR%2D10%2D98%2C+Harvard+University%2C+August%2E)
8. W. J. Hutchins and H. L. Somers. 1992. An introduction to machine translation, volume 362. Academic Press New York. [find](https://scholar.google.com/scholar?q=W%2E+J%2E+Hutchins+and+H%2E+L%2E+Somers%2E+1992%2E+An+introduction+to+machine+translation%2C+volume+362%2E+Academic+Press+New+York%2E)
9. P. Koehn, H. Hoang, A. Birch, C. Callison-Burch, M. Federico, N. Bertoldi, B. Cowan, C. Shen, W.and Moran, R. Zens, C. Dyer, O. Bojar, A. Constantin, and E. Herbst. 2007. Moses: Open Source Toolkit for Statistical Machine Translation. In Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions, pages 177–180. [find](https://scholar.google.com/scholar?q=P%2E+Koehn%2C+H%2E+Hoang%2C+A%2E+Birch%2C+C%2E+Callison%2DBurch%2C+M%2E+Federico%2C+N%2E+Bertoldi%2C+B%2E+Cowan%2C+C%2E+Shen%2C+W%2Eand+Moran%2C+R%2E+Zens%2C+C%2E+Dyer%2C+O%2E+Bojar%2C+A%2E+Constantin%2C+and+E%2E+Herbst%2E+2007%2E+Moses%3A+Open+Source+Toolkit+fo)
10. P. Koehn. 2005. Europarl: A parallel corpus for statistical machine translation. MT summit, 5:12–16. [find](https://scholar.google.com/scholar?q=P%2E+Koehn%2E+2005%2E+Europarl%3A+A+parallel+corpus+for+statistical+machine+translation%2E+MT+summit%2C+5%3A12%E2%80%9316%2E)
11. P. Koehn. 2010. Statistical Machine Translation. Cambridge University Press. [find](https://scholar.google.com/scholar?q=P%2E+Koehn%2E+2010%2E+Statistical+Machine+Translation%2E+Cambridge+University+Press%2E)
12. A. Lopez and P. Resnik. 2006. Word-based alignment, phrase-based translation: What’s the link. In Proceedings of the 7th Conference of the Association for Machine Translation in the Americas, pages 90–99. [find](https://scholar.google.com/scholar?q=A%2E+Lopez+and+P%2E+Resnik%2E+2006%2E+Word%2Dbased+alignment%2C+phrase%2Dbased+translation%3A+What%E2%80%99s+the+link%2E+In+Proceedings+of+the+7th+Conference+of+the+Association+for+Machine+Translation+in+the+Americas%2C+pages+90)
13. F. J. Och and H. Ney. 2003. A systematic comparison of various statistical alignment models. Computational Linguistics, 29:19–51, March. [find](https://scholar.google.com/scholar?q=F%2E+J%2E+Och+and+H%2E+Ney%2E+2003%2E+A+systematic+comparison+of+various+statistical+alignment+models%2E+Computational+Linguistics%2C+29%3A19%E2%80%9351%2C+March%2E)
14. F. J. Och. 2003. Minimum error rate training in statistical machine translation. In Proceedings of the 41st Annual Meeting of the ACL, pages 160–167. [find](https://scholar.google.com/scholar?q=F%2E+J%2E+Och%2E+2003%2E+Minimum+error+rate+training+in+statistical+machine+translation%2E+In+Proceedings+of+the+41st+Annual+Meeting+of+the+ACL%2C+pages+160%E2%80%93167%2E)
15. K. Papineni, S. Roukos, T. Ward, and W. Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the ACL, pages 311–318. [find](https://scholar.google.com/scholar?q=K%2E+Papineni%2C+S%2E+Roukos%2C+T%2E+Ward%2C+and+W%2E+Zhu%2E+2002%2E+Bleu%3A+a+method+for+automatic+evaluation+of+machine+translation%2E+In+Proceedings+of+the+40th+Annual+Meeting+of+the+ACL%2C+pages+311%E2%80%93318%2E) [our card](https://md.mova.elamur.ai/free/en/docs/papers/papineni-2002-bleu-method-automatic-evaluation-machine/)
16. M. Popovic and H. Ney. 2006. Statistical machine translation with a small amount of bilingual training data. In LREC workshop on Minority Languages, pages 25– 29. [find](https://scholar.google.com/scholar?q=M%2E+Popovic+and+H%2E+Ney%2E+2006%2E+Statistical+machine+translation+with+a+small+amount+of+bilingual+training+data%2E+In+LREC+workshop+on+Minority+Languages%2C+pages+25%E2%80%93+29%2E)
17. H. Schwenk, S. Abdul-Rauf, L. Barrault, and J. Senellart. 2009. SMT and SPE machine translation systems for WMT’09. In Proceedings of the Fourth Workshop on Statistical Machine Translation, pages 130–134. [find](https://scholar.google.com/scholar?q=H%2E+Schwenk%2C+S%2E+Abdul%2DRauf%2C+L%2E+Barrault%2C+and+J%2E+Senellart%2E+2009%2E+SMT+and+SPE+machine+translation+systems+for+WMT%E2%80%9909%2E+In+Proceedings+of+the+Fourth+Workshop+on+Statistical+Machine+Translation%2C+pages+130%E2%80%93)
18. A. Stolcke. 2002. SRILM-an extensible language modeling toolkit. In 7th International Conference on Spoken Language Processing, pages 901–904. [find](https://scholar.google.com/scholar?q=A%2E+Stolcke%2E+2002%2E+SRILM%2Dan+extensible+language+modeling+toolkit%2E+In+7th+International+Conference+on+Spoken+Language+Processing%2C+pages+901%E2%80%93904%2E)
19. G. Thurmair. 2009. Comparing different architectures of hybrid Machine Translation systems. In Proceedings MT Summit XII. [find](https://scholar.google.com/scholar?q=G%2E+Thurmair%2E+2009%2E+Comparing+different+architectures+of+hybrid+Machine+Translation+systems%2E+In+Proceedings+MT+Summit+XII%2E)
20. F. M. Tyers. 2009. Rule-based augmentation of training data in Breton-French statistical machine translation. In Proceedings of the 13th Annual Conference of the European Association for Machine Translation, pages 213–217. [find](https://scholar.google.com/scholar?q=F%2E+M%2E+Tyers%2E+2009%2E+Rule%2Dbased+augmentation+of+training+data+in+Breton%2DFrench+statistical+machine+translation%2E+In+Proceedings+of+the+13th+Annual+Conference+of+the+European+Association+for+Machine+Trans)
21. Y. Zhang, S. Vogel, and A. Waibel. 2004. Interpreting BLEU/NIST scores: How much improvement do we need to have a better system. In Proceedings of the Fourth International Conference on Language Resources and Evaluation, pages 2051–2054. [find](https://scholar.google.com/scholar?q=Y%2E+Zhang%2C+S%2E+Vogel%2C+and+A%2E+Waibel%2E+2004%2E+Interpreting+BLEU%2FNIST+scores%3A+How+much+improvement+do+we+need+to+have+a+better+system%2E+In+Proceedings+of+the+Fourth+International+Conference+on+Language+Resou)