This study examines a selection of off-the-shelf forecasting and forecast combination algorithms with a focus on assessing their practical relevance by drawing conclusions for non-expert users. Some of the methods have only recently been introduced and have not been part in comparative empirical evaluations before. Considering the advances of forecasting techniques, this analysis addresses the question whether we need human expertise for forecasting or whether the investigated methods provide comparable performance.