Nudging: Inference-time Alignment of LLMs via Guided Decoding

Researchers introduced NUDGING, a training-free, inference-time alignment method that uses a small aligned model to guide large base language models, improving their ability to follow instructions without additional training. This approach achieves performance comparable to or better than larger aligned models, offering a cost-effective and modular solution for LLM alignment.