SwaT sends KV-cache data between LLMs of different families
In tests, SwaT had 40% more mean accuracy and was 4 times as fast as text.
Claimed, not confirmed
Sources
Posted
What matters in AI.
SubscribeIn tests, SwaT had 40% more mean accuracy and was 4 times as fast as text.
Claimed, not confirmed
Posted
