This is a confirmed bug in Apache with no configuration workaround:
https://bz.apache.org/bugzilla/show_bug.cgi?id=53555
There's a pretty good description of the details, which match our behavior here:
https://serverfault.com/questions/516373/what-is-the-meaning-of-ah00485-scor...
One thing that some people seem to have had success with is turning keepalive off.
ServerLimit, for the event MPM (what we use), the recommendation is:
With event, increase this directive if the process number defined by your MaxRequestWorkers and ThreadsPerChild settings, plus the number of gracefully shutting down processes, is more than 16 server processes (default).
Our MaxRequestWorkers is 50. We don't define ThreadsPerChild which defaults to 25. So if I read that correctly (and I haven't tuned Apache for a living in a looonnnggg time), we want something like 50+25=75 plus some more for shutting down processes, so like... 80? I can prep a diff for that plus keepalive and see how that goes.
On 10/7/23 22:00, Ilan Rabinovitch wrote:
Logs on the host from just before the last outage. Seems like we need some mpm tuning. We set worker limit and max connections, but haven't adjusted server limit from defaults yet. I think that defaults so something low with mpm_event.
error_log:[Sat Oct 07 18:35:35.108228 2023] [mpm_event:error] [pid 598185:tid 139630331418944] AH03490: scoreboard is full, not at MaxRequestWorkers.Increase ServerLimit. error_log:[Sat Oct 07 18:35:36.109222 2023] [mpm_event:error] [pid 598185:tid 139630331418944] AH03490: scoreboard is full, not at MaxRequestWorkers.Increase ServerLimit. error_log:[Sat Oct 07 18:35:40.123947 2023] [mpm_event:error] [pid 598185:tid 139630331418944] AH03490: scoreboard is full, not at MaxRequestWorkers.Increase ServerLimit.
On Sat, Oct 7, 2023 at 9:39 PM Phil Dibowitz phil@ipom.com wrote:
Restarted. Added cron to restart. Will find time to pair debug with Smith this week.
Get BlueMail for Android
scale-infra mailing list scale-infra@lists.linuxfests.org https://lists.linuxfests.org/cgi-bin/mailman/listinfo/scale-infra