It is normal for the front or the sides your refrigerator cabinet to feel slightly warm.
The compressor produces heat while generating the energy to keep your fridge cool. This heat is expelled through the condenser coils. Some of this heat might be felt through the side surfaces.
The warmth might increase during humid weather as the appliance will be working harder to prevent condensation forming inside the compartments.