Repository navigation
Issue with Keycloak Scaling in AKS Using Bitnami Helm Chart (Chart Version: keycloak-21.8.0) #36502
Unanswered
umesh-gajjar
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Keycloak has been installed on an AKS cluster using the Bitnami Helm chart (chart version: keycloak-21.8.0) with 3 replicas, and it is functioning correctly under normal load conditions. However, when there is a high load on the website and the Keycloak replicas are scaled from 3 to 4, all 3 existing Keycloak replicas temporarily stop serving requests for approximately 2-3 minutes. After the 4th replica is up and running, the original 3 replicas resume serving requests.
Below is the log excerpt from one of the Keycloak pods during this scenario:
2025-01-15 15:52:47,970 INFO [org.infinispan.CLUSTER] (jgroups-169,keycloak-dev-2-18566) ISPN100000: Node keycloak-dev-3-32970 joined the cluster
2025-01-15 15:52:47,970 INFO [org.infinispan.CLUSTER] (jgroups-169,keycloak-dev-2-18566) ISPN100000: Node keycloak-dev-3-32970 joined the cluster
2025-01-15 15:52:48,961 INFO [org.infinispan.LIFECYCLE] (jgroups-169,keycloak-dev-2-18566) [Context=org.infinispan.PERMISSIONS] ISPN100002: Starting rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], phase READ_OLD_WRITE_ALL, topology id 64
2025-01-15 15:52:48,962 INFO [org.infinispan.LIFECYCLE] (non-blocking-thread--p2-t2) [Context=org.infinispan.PERMISSIONS] ISPN100010: Finished rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], topology id 64
2025-01-15 15:52:49,188 INFO [org.infinispan.LIFECYCLE] (jgroups-169,keycloak-dev-2-18566) [Context=org.infinispan.ROLES] ISPN100002: Starting rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], phase READ_OLD_WRITE_ALL, topology id 64
2025-01-15 15:52:49,188 INFO [org.infinispan.LIFECYCLE] (non-blocking-thread--p2-t2) [Context=org.infinispan.ROLES] ISPN100010: Finished rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], topology id 64
2025-01-15 15:52:49,252 INFO [org.infinispan.LIFECYCLE] (jgroups-169,keycloak-dev-2-18566) [Context=org.infinispan.CONFIG] ISPN100002: Starting rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], phase READ_OLD_WRITE_ALL, topology id 63
2025-01-15 15:52:49,253 INFO [org.infinispan.LIFECYCLE] (non-blocking-thread--p2-t2) [Context=org.infinispan.CONFIG] ISPN100010: Finished rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], topology id 63
2025-01-15 15:52:49,395 INFO [org.infinispan.LIFECYCLE] (jgroups-175,keycloak-dev-2-18566) [Context=actionTokens] ISPN100002: Starting rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], phase READ_OLD_WRITE_ALL, topology id 61
2025-01-15 15:52:49,396 INFO [org.infinispan.LIFECYCLE] (non-blocking-thread--p2-t2) [Context=actionTokens] ISPN100010: Finished rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], topology id 61
2025-01-15 15:52:49,466 INFO [org.infinispan.LIFECYCLE] (jgroups-169,keycloak-dev-2-18566) [Context=authenticationSessions] ISPN100002: Starting rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], phase READ_OLD_WRITE_ALL, topology id 58
2025-01-15 15:52:49,467 INFO [org.infinispan.LIFECYCLE] (non-blocking-thread--p2-t2) [Context=authenticationSessions] ISPN100010: Finished rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], topology id 58
2025-01-15 15:52:49,660 INFO [org.infinispan.LIFECYCLE] (jgroups-169,keycloak-dev-2-18566) [Context=clientSessions] ISPN100002: Starting rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], phase READ_OLD_WRITE_ALL, topology id 58
2025-01-15 15:52:49,660 INFO [org.infinispan.LIFECYCLE] (non-blocking-thread--p2-t2) [Context=clientSessions] ISPN100010: Finished rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], topology id 58
2025-01-15 15:52:49,850 INFO [org.infinispan.LIFECYCLE] (jgroups-175,keycloak-dev-2-18566) [Context=loginFailures] ISPN100002: Starting rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], phase READ_OLD_WRITE_ALL, topology id 58
2025-01-15 15:52:49,851 INFO [org.infinispan.LIFECYCLE] (non-blocking-thread--p2-t1) [Context=loginFailures] ISPN100010: Finished rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], topology id 58
2025-01-15 15:52:49,907 INFO [org.infinispan.LIFECYCLE] (jgroups-169,keycloak-dev-2-18566) [Context=offlineClientSessions] ISPN100002: Starting rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], phase READ_OLD_WRITE_ALL, topology id 58
2025-01-15 15:52:49,907 INFO [org.infinispan.LIFECYCLE] (non-blocking-thread--p2-t1) [Context=offlineClientSessions] ISPN100010: Finished rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], topology id 58
2025-01-15 15:52:49,947 INFO [org.infinispan.LIFECYCLE] (jgroups-175,keycloak-dev-2-18566) [Context=offlineSessions] ISPN100002: Starting rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], phase READ_OLD_WRITE_ALL, topology id 59
2025-01-15 15:52:49,947 INFO [org.infinispan.LIFECYCLE] (non-blocking-thread--p2-t1) [Context=offlineSessions] ISPN100010: Finished rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], topology id 59
2025-01-15 15:52:50,001 INFO [org.infinispan.LIFECYCLE] (jgroups-169,keycloak-dev-2-18566) [Context=sessions] ISPN100002: Starting rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], phase READ_OLD_WRITE_ALL, topology id 58
2025-01-15 15:52:50,001 INFO [org.infinispan.LIFECYCLE] (non-blocking-thread--p2-t1) [Context=sessions] ISPN100010: Finished rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], topology id 58
2025-01-15 15:52:50,100 INFO [org.infinispan.LIFECYCLE] (jgroups-169,keycloak-dev-2-18566) [Context=work] ISPN100002: Starting rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], phase READ_OLD_WRITE_ALL, topology id 63
2025-01-15 15:52:50,100 INFO [org.infinispan.LIFECYCLE] (non-blocking-thread--p2-t1) [Context=work] ISPN100010: Finished rebalance with members [keycloak-dev-0-44710, keycloak-dev-2-18566, keycloak-dev-1-28764, keycloak-dev-3-32970], topology id 63
All reactions