Reducing Doom Loops with Final Token Preference Optimization

This article proposes a method called "Antidoom" to reduce the occurrence of doom loops in language models, which are repetitive and unproductive patterns of behavior. The method uses Final Token Preference Optimization (FTPO) to train the model to prefer coherent alternatives at the position where the loop begins.