#Llama-3-8B

3 stories · 0 in 7 days · 1 in 30 days
Stories, products and papers tagged "Llama-3-8B", newest first.
Oct 28
PapersMulti-sourceSelected10:47
Study Explains Why DPO Updates Stay Sparse via NTK Theory

The practical payoff is a theoretical licence to merge DPO-aligned checkpoints: sparser, disentangled updates mean less interference when combining model variants. Researchers working on preference alignment or model merging can use the support-pair bounds to reason about how many samples actually shape a fine-tune. Teams choosing between DPO and SFT for multi-task pipelines get a concrete 35× interference reduction figure to weigh.

Event
arXiv: Anthropic@Kensuke Sasaki, Issei Sato6 sourcesSource
Sep 2
Aug 5