Do you actually get pepper plants to bud this time of year? In my experience, most flowering/fruiting plants should be started in the early spring or at least after day light periods start to get longer - unless you are supplementing with artificial light that is. I have to admit though, I haven't done a lot of pepper growing except in my garden in the NW.
Typically though, a flowering/fruiting plant (not including tomatoes) will start to set buds as the daylight periods get shorter. In college, we forced budding in greenhouses by manipulating the dark periods. So we would give plants artificial light to mimic spring and summer if we were starting them in the fall and then reduce that light as time went on to mimic fall coming in. That way we were able to create two growing seasons per year. That was in Northern California at Chico State.
In the south, I don't know how much difference you have in dark periods throughout the seasons but I would think there would be enough to tell the plants when they are supposed to be setting fruit. Temperatures shouldn't have as much to do with this as the length of dark periods per day. I'm sure the warmer weather would have a good amount to do with the quality of the fruit and health of the plant though. the biggest problem we have here is the warm period is just too short for good fruit production. We get a lot of little peppers that don't quite ripen.
I'm not sure if peppers are like tomatoes. Tomatoes set fruit as the plant matures and not due to season. So this could all be totally useless information. Oh well - wouldn't be the first time.