Wednesday and Thursday will be a touch chillier, according to AccuWeather, but warmer temperatures will be back in a couple of days.