Information Theory on Overthinking It