In modern machine learning, optimization algorithms are crucial; they steer the training process by skillfully navigating through complex, high-dimensional loss landscapes. Among these, stochastic ...

We propose the linearly adaptive cross entropy loss function. This is a novel measure derived from the information theory. In comparison to the standard cross entropy loss function, the proposed one ...