#7587 Increase WSGI worker process count
Closed: fixed Opened by cheimes.

WSGI daemon process count is currently limited to two single-threaded processes. IPA requires single threaded WSGI workers, because IPA uses GSSAPI authentication. Two daemon processes means that the IPA RCP can only handle two requests at a time. This can be too low for a busy server.

On a 64bit system with Python 3.6, each WSGI worker process consumes about 100-110 MB resident memory. Since mod_wsgi preforks the workers, about 30-35 MB memory of the 110 MB RSS are shared across workers. Increasing the worker count from 2 to 5 means, IPA RPC consumes about 200 to 250 MB additional memory.


Metadata Update from @cheimes:
- Custom field on_review adjusted to https://pagure.io/freeipa/issue/7587

Metadata Update from @cheimes:
- Issue assigned to cheimes

Metadata Update from @pvoborni:
- Custom field rhbz adjusted to https://bugzilla.redhat.com/show_bug.cgi?id=1591647

Issue linked to bug 1591647

master:

  • f1d5ab3a03191dbb02e5f95308cf8c4f1971cdcf Increase WSGI process count to 5 on 64bit

ipa-4-6:

  • db8e0e6e04e903f387b0c68da725f60114817b1b Increase WSGI process count to 5 on 64bit

WIth 5 workers, test_commands on master sometimes fail with OOM killer. 4.5 tests aren't passing at all. With 4 workers, 4.5 is working fine. I suggest to reduce the amount of workers from 5 to 4, which is already double of the previous value.

ipa-4-5:

  • 0571ed71489e4eddbf3d88e97c063325a29076eb Increase WSGI process count to 5 on 64bit
  • 1e131bbe741290f9845a2fceb621af1052aac30a Use 4 WSGI workers on 64bit systems

master:

  • 0e21d933916b71d901310db6d16694401c289dd9 Use 4 WSGI workers on 64bit systems

ipa-4-6:

  • f98b6e18ebcfe9edd475833d636600fc1758fda3 Use 4 WSGI workers on 64bit systems

Metadata Update from @cheimes:
- Issue close_status updated to: fixed
- Issue status updated to: Closed (was: Open)

master:

  • f0c3a3592818d132bd2b61e5fbe9e5b51b429a96 Test if WSGI worker process count is set to 4

ipa-4-7:

  • 660f90b263174a0e3c39bc3644b2ab17f814ac4b Test if WSGI worker process count is set to 4

ipa-4-6:

  • 6760ac910ea5f70c30517bf9e4d77e3064a66085 Test if WSGI worker process count is set to 4
Metadata