In stepwise regression, you step predictor by predictor, each time selecting the one with the greatest correlation with the measurement, subtracting greedily to leave a residual with no correlation to any of the previous predictors.
Why go stepwise? Why not just pick the predictors with best correlation to the measurement right now, however many you need, and use those? Why is a stepwise approach better? Does it yield smaller 1-norms?
