Some MOE models use gating mechanisms to decide which experts to activate per input, regardless of sharing.

MOE models use a gate — a kind of decision-maker inside the model — that picks which experts should work on each input. This gating works independently of whether experts are shared or unique to layers. The gate helps the model focus resources only where needed, activating a small number of experts for each input, which improves efficiency. This design is common across MOE models and helps explain why expert sharing is a flexible choice. The gating mechanism can work well with either setup.