We propose a multivariate methodology based on Functional Gradient Descent to estimate and forecast time-varying expected bond returns. Backtesting our procedure on US monthly data, we collect empirical evidence of its strong forecasting potential in terms of the accuracy of the predictions, also in comparison to the classical univariate methodology used in the literature.