Weitao Feng

Harmful RL using inverted reward signals can efficiently jailbreak large language models at minimal cost ($40) by exploiting RLHF alignment mechanisms, and accessible fine-tuning platforms like Tinker have dramatically lowered the technical and financial barriers to such attacks.

“Author of "Red Teaming via Harmful RL" in Hugging Face”