Skip to content

Self Replace merge

Won-Kyu Park edited this page Jun 30, 2024 · 2 revisions

Self/Replace merges are supported to multifly alpha

  • to itself(model A: theta0) - Self : result = model_A * alpha = model_A * alpha + model_B * 0
  • to model B and replace merged result - Replace : result = model_B * alpha = model_A * 0 + model_B * alpha

when you think, specific condition results to much overfit you can cosider Self or Replace method to reduce specific block level weights.

Clone this wiki locally