It should be possible to specify local learning rates in the input file which
also must be saved to the output file.

