First Tokens: The Achilles’ Heel of LLMs
www.invicti.com
The Assistant Prefill feature available in many LLMs can open up models to jailbreaking, including the possibility of persistent prefills to bypass LLM safety alignments.