Concepts / Weighted-Majority Algorithm

Weighted-Majority Algorithm

PAC learning separates training from prediction, whereas online learning does not.

  • Programming

Decisions Before Labels

Imagine that examples arrive one at a time, exactly when a prediction is needed. The learner cannot first collect a complete training set and postpone every decision. It must predict, discover the correct label, and then use that new information when the next example arrives. This timing is the central setting of online learning.

PAC learningOnline learning
The learner first receives a batch of training examples.The learner predicts each example before its true label is known.
The learner learns a hypothesis from the batch.The learner observes the label after predicting.
The learner predicts labels for new examples afterward.The observed example can become training information for later rounds.
thenafterwardafter predictionnext-round informationTraining batchPredictLearn hypothesisObserve labelPredict new labelsUse feedback
How does the timing of training, prediction, label observation, and learning differ?

One Round in Order

Weighted-Majority can be read as a repeated decision process. Suppose there are d experts and a planned horizon of T rounds. At the start of a round, every expert has an unnormalized weight. The learner first turns those weights into a probability distribution by dividing each weight by the total of all weights. It then chooses an expert according to that distribution. Afterward, it observes the costs assigned to all experts, pays the distribution-weighted cost for the round, and updates every expert's weight. The next round begins with the updated weights.

distributionafter choicecost vectorNormalize weightsMake predictionObserve costsUpdate weights
What happens first, and how does each stage affect the next?

From Weights to Advice

Prediction with expert advice represents the learner's choice as a distribution over experts. If expert i has current unnormalized weight w̃_i, the learner divides it by the total Z of all current unnormalized weights. The resulting values are probabilities, so their total is 1. The learner therefore relies more strongly on experts with larger current weights, without having to select one expert deterministically in every description of the method.

Normalizing Two Expert Weights

Suppose two experts enter a round with unnormalized weights 2 and 1.

Add the weights: The normalization total is 3.

Divide each weight by the total: The first expert receives probability 2 divided by 3, and the second receives probability 1 divided by 3.

Interpret the distribution: The learner gives the first expert twice as much probability as the second expert for this round.

The distribution over experts is 2/3 for the first expert and 1/3 for the second expert.

normalizenormalizeExpert Aweight 2; probability 2/3Predictiondistributiontotal probability 1Expert Bweight 1; probability 1/3
How are current weights normalized into a distribution, and how does that distribution express reliance on each expert?

The current distribution determines the learner's averaged cost for the round. This is different from simply reporting the cost of one fixed expert: the learner's cost is weighted by how strongly the learner relied on each expert.

Costs and Future Influence

After the costs arrive, expert i's unnormalized weight is multiplied by exp(-eta v_t,i), where v_t,i is that expert's cost on the round. Costs lie between 0 and 1. A larger cost therefore produces a smaller multiplicative factor than a smaller cost. Costly advice loses more relative weight, while less costly advice retains more of its weight. The parameter eta controls the update expression and is set using the number of experts d and the planned number of rounds T.

Different Costs, Different Updates

Two experts begin a round with weights 2 and 1. The first expert receives a larger cost than the second expert.

Keep the entering weights: The first expert starts with more influence, but that does not guarantee it will keep more influence.

Apply the multiplicative factors: The first expert is multiplied by exp(-eta times its larger cost). The second is multiplied by exp(-eta times its smaller cost).

Compare relative retention: Because the first cost is larger, its multiplicative factor is smaller. It loses more relative weight than the second expert.

Normalize next time: At the next round, both updated weights are divided by their new total to form the new distribution.

The expert with the larger cost has less relative influence in the next prediction than it would have had if both costs were equal.

receivesreceivesmultiply by exp(-eta times cost)multiply by exp(-eta times cost)Expert Aweight 2Cost Alarger costExpert Areduced relative weightExpert Bweight 1Cost Bsmaller costExpert Bretains more relativeweight
How does the cost assigned to each expert change that expert's weight and its influence on the next prediction?

Realizable and Unrealizable Settings

Online binary classification is studied under realizable and unrealizable assumptions. In the realizable case, the analysis allows a hypothesis that correctly explains every observed example. In the unrealizable case, every available hypothesis eventually makes mistakes on the sequence. This distinction changes what the learner is being compared against: perfect explanation is available in the realizable setting, while the learner must reason about unavoidable mistakes in the unrealizable setting.

permitsimpliesRealizable casePerfect hypothesiscorrect on every observedexampleUnrealizable caseMistakeseventually made by everyhypothesis
What changes when one hypothesis can explain every observed example versus when every hypothesis eventually makes mistakes?

The Chapter Progression

Weighted-Majority is the chapter's first important online-learning algorithm. The progression then moves to online-learning problems with convex loss functions and finally to the Perceptron algorithm. The Perceptron is presented as an example of using surrogate convex loss functions in the online-learning model.

TopicRole in the progression
Weighted-MajorityIntroduces an online algorithm that adjusts reliance on experts.
Convex loss functionsExtends the study to online-learning problems whose loss function is convex.
PerceptronShows the use of surrogate convex loss functions in the online-learning model.

These topics form a progression within the study of online learning.

Unknown Time Horizons

The update parameter eta is chosen using the number of experts d and the planned number of rounds T. That creates a problem when the total number of rounds is not known in advance. The doubling trick removes this dependence by organizing the run into progressively extended time periods and restarting the algorithm for those periods. The learner therefore does not need one final round count before the run begins.

period ends; restartperiod ends; restartFirst periodrestart with plannedhorizonLonger periodrestart with extendedhorizonNext longer periodcontinue extending
How do progressively extended time periods help when the total number of rounds is unknown?

Implementation Checkpoints

  • Using the cost vector before making the current prediction.

    The intended order is normalization, prediction, cost observation, and then weight update.

    Fix: Use the costs to affect the next round, not the prediction that occurred before those costs were observed.

  • Treating the learner's cost as the cost of one selected expert.

    The learner pays the distribution-weighted cost, which is an average determined by the current distribution.

    Fix: Combine each expert's cost with the probability assigned to that expert.

  • Normalizing at the wrong point.

    Updated unnormalized weights must be used to form the next choice distribution.

    Fix: After updating, use the new total when normalization is needed for the next prediction.

  • Inspecting only the final distribution while debugging.

    A mismatch in an earlier checkpoint propagates to every later value.

    Fix: Compare entering weights, normalization, cost-weighted loss, and post-cost update in that order.

Debug one round as four checkpoints: the weights entering the round, the normalization total, the cost-weighted loss, and the post-cost update. The first checkpoint that differs from the intended algorithm identifies where later values began to diverge.

Practice the Trace

MEDIUM

Two experts enter a round with unnormalized weights 4 and 2. First, describe the probability distribution used for the prediction. Then suppose the first expert receives a larger cost than the second. Without calculating a numerical exponential, explain which expert loses more relative weight and what changes in the next round.

Hints
  • Add the entering weights to find the normalization total.
  • Divide each weight by that total.
  • Compare exp(-eta times the larger cost) with exp(-eta times the smaller cost).

What do you think happens?

After the costs are observed, should the learner update the weights before or after calculating the current round's prediction?

  • Before the prediction
  • After the prediction
Reveal answer

Answer: After the prediction

The learner first normalizes the entering weights and makes the prediction. It then observes costs, pays the distribution-weighted cost, and updates weights for the next round.

Key Takeaways

  1. Online learning predicts before observing the true label, while PAC learning separates batch training from later prediction.
  2. Weighted-Majority normalizes current expert weights into a distribution before predicting.
  3. The learner's cost is distribution-weighted rather than automatically equal to the cost of one expert.
  4. A larger expert cost produces a smaller exponential multiplicative factor and reduces that expert's future relative influence.
  5. The doubling trick uses progressively extended periods when the total number of rounds is unknown.

Key Takeaways

  • Online learning requires a prediction before the current label is known; the revealed label can inform later rounds.
  • Weighted-Majority represents reliance on experts with a normalized distribution over their current weights.
  • Each expert's cost changes its unnormalized weight through an exponential multiplicative update.
  • Correct tracing follows normalization, prediction, cost observation, and update in that order.
  • The doubling trick handles an unknown total number of rounds by using progressively extended time periods.