Learning with incomplete information and the mathematical structure behind it