Optimizers try to tie together the loss function and model parameters by updating the model in response to the output of the loss function.  An optimizer is a function or an algorithm that modifies the attributes of the neural network, similar as weights and learning rate.