On the Token Collapse Phenomenon in Textual Graph Soft Prompting
Identifies near-identical graph tokens in graph soft prompting and shows that strong answer accuracy can mask limited use of graph information. Introduces a two-stage training procedure to mitigate collapse and intervention-based diagnostics to test graph use.