--Task-- name: self-service enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: idm target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: [] options: {'testMode': 'open', 'simulation': 'com.forgerock.gatling.Loadtest', 'testCase': 'platform.SelfService', 'throughput': '370', 'duration': 3600, 'rampup-duration': 30, 'java-opts': '-Dprefix=self -Duser_password=Pa_ssw0rd'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [22/Apr/2023 07:44:09] self-service pre : N/A ________________________________________________________________________________ [22/Apr/2023 07:44:09] - INFO: Get overseer pod resources requests memory [loop_until]: kubectl --namespace=xlou get pods overseer-0-74fc4c7cd9-5grs6 -o jsonpath={.spec.containers[].resources.requests.memory} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 4Gi --- stderr --- [22/Apr/2023 07:44:10] - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) [22/Apr/2023 07:44:10] - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/self-service/stdout.txt Pod log : /results/orders/self-service ________________________________________________________________________________ [22/Apr/2023 07:44:10] self-service print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ /lodestar/clients/gatling-for-pyrock.sh --run-mode local --simulation com.forgerock.gatling.Loadtest --simulations-folder /lodestar/pyrock/shared/clients/gatling-open/ --run-description platform.SelfService@medium --results-folder /results/gatling/self-service --no-reports ________________________________________________________________________________ [22/Apr/2023 07:44:10] self-service create_order : Create order for overseer with the command to run ________________________________________________________________________________ Order file : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform/07_Platform/01_self-service/order.json { "name": "self-service", "command": "/lodestar/clients/gatling-for-pyrock.sh --run-mode local --simulation com.forgerock.gatling.Loadtest --simulations-folder /lodestar/pyrock/shared/clients/gatling-open/ --run-description platform.SelfService@medium --results-folder /results/gatling/self-service --no-reports", "out-dir": "/results/orders/self-service", "environment": { "JAVA_OPTS": "-Dam_host=xlou.iam.xlou-cdm.engineeringpit.com -DamadminPassword=ctY2gkw46JLgulYKx5OiO3Xs -DamadminUsername=amadmin -Dduration=3600 -Didm_host=xlou.iam.xlou-cdm.engineeringpit.com -Dnum_users=10000000 -Dprefix=self -Drampup_duration=30 -DtestCase=platform.SelfService -DtestMode=open -Dthroughput=370 -Duser_password=Pa_ssw0rd -Xmx4G" } } ________________________________________________________________________________ [22/Apr/2023 07:44:10] self-service loop_until_ready : Loop until overseer pod is ready to accept order ________________________________________________________________________________ [loop_until]: curl -k https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 31 0 --:--:-- --:--:-- --:--:-- 31 ________________________________________________________________________________ [22/Apr/2023 07:44:10] self-service start_order : Send the order to the overseer pod ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-74fc4c7cd9-5grs6 --- stderr --- [loop_until]: kubectl --namespace=xlou cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform/07_Platform/01_self-service/order.json overseer-0-74fc4c7cd9-5grs6:/results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order has been successfully forwarded to overseer [22/Apr/2023 07:44:12] - INFO: Check if Gatling simulation started successfully [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-74fc4c7cd9-5grs6 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-74fc4c7cd9-5grs6 -- head /results/orders/self-service/stdout.txt | grep "started..." [loop_until]: (max_time=300, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: started... - retry [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: started... - retry [loop_until]: Function succeeded after 12s (rc=0) - failed to find expected output: started... - retry [loop_until]: Function succeeded after 18s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling 08:44:15.487 [WARN ] i.g.c.ZincCompiler$ - -target is deprecated: Use -release instead to compile against the correct platform API. 08:44:21.065 [WARN ] i.g.c.ZincCompiler$ - one warning found Gatling 3.9.3 is available! (you're using 3.9.0) 08:44:24.407 [WARN ] i.g.c.s.e.ElCompiler$ - You're still using the deprecated ${} pattern for Gatling EL. Please use the #{} pattern instead. Simulation com.forgerock.gatling.Loadtest started... ================================================================================ 2023-04-22 08:44:30 5s elapsed ---- Requests ------------------------------------------------------------------ --- stderr --- ________________________________________________________________________________ [22/Apr/2023 07:44:30] self-service wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m Waiting for status (curl --fail -k https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 5s, retry Order is running since 10s, retry Order is running since 15s, retry Order is running since 21s, retry Order is running since 26s, retry Order is running since 31s, retry Order is running since 36s, retry Order is running since 41s, retry Order is running since 47s, retry Order is running since 52s, retry Order is running since 57s, retry Order is running since 1m 02s, retry Order is running since 1m 08s, retry Order is running since 1m 13s, retry Order is running since 1m 18s, retry Order is running since 1m 23s, retry Order is running since 1m 29s, retry Order is running since 1m 34s, retry Order is running since 1m 39s, retry Order is running since 1m 44s, retry Order is running since 1m 49s, retry Order is running since 1m 55s, retry Order is running since 2m, retry Order is running since 2m 05s, retry Order is running since 2m 10s, retry Order is running since 2m 16s, retry Order is running since 2m 21s, retry Order is running since 2m 26s, retry Order is running since 2m 31s, retry Order is running since 2m 37s, retry Order is running since 2m 42s, retry Order is running since 2m 47s, retry Order is running since 2m 52s, retry Order is running since 2m 58s, retry Order is running since 3m 03s, retry Order is running since 3m 08s, retry Order is running since 3m 13s, retry Order is running since 3m 18s, retry Order is running since 3m 24s, retry Order is running since 3m 29s, retry Order is running since 3m 34s, retry Order is running since 3m 39s, retry Order is running since 3m 45s, retry Order is running since 3m 50s, retry Order is running since 3m 55s, retry Order is running since 4m, retry Order is running since 4m 06s, retry Order is running since 4m 11s, retry Order is running since 4m 16s, retry Order is running since 4m 21s, retry Order is running since 4m 26s, retry Order is running since 4m 32s, retry Order is running since 4m 37s, retry Order is running since 4m 42s, retry Order is running since 4m 47s, retry Order is running since 4m 53s, retry Order is running since 4m 58s, retry Order is running since 5m 03s, retry Order is running since 5m 08s, retry Order is running since 5m 14s, retry Order is running since 5m 19s, retry Order is running since 5m 24s, retry Order is running since 5m 29s, retry Order is running since 5m 35s, retry Order is running since 5m 40s, retry Order is running since 5m 45s, retry Order is running since 5m 50s, retry Order is running since 5m 56s, retry Order is running since 6m 01s, retry Order is running since 6m 06s, retry Order is running since 6m 11s, retry Order is running since 6m 16s, retry Order is running since 6m 22s, retry Order is running since 6m 27s, retry Order is running since 6m 32s, retry Order is running since 6m 37s, retry Order is running since 6m 43s, retry Order is running since 6m 48s, retry Order is running since 6m 53s, retry Order is running since 6m 58s, retry Order is running since 7m 04s, retry Order is running since 7m 09s, retry Order is running since 7m 14s, retry Order is running since 7m 19s, retry Order is running since 7m 25s, retry Order is running since 7m 30s, retry Order is running since 7m 35s, retry Order is running since 7m 40s, retry Order is running since 7m 45s, retry Order is running since 7m 51s, retry Order is running since 7m 56s, retry Order is running since 8m 01s, retry Order is running since 8m 06s, retry Order is running since 8m 12s, retry Order is running since 8m 17s, retry Order is running since 8m 22s, retry Order is running since 8m 27s, retry Order is running since 8m 33s, retry Order is running since 8m 38s, retry Order is running since 8m 43s, retry Order is running since 8m 48s, retry Order is running since 8m 53s, retry Order is running since 8m 59s, retry Order is running since 9m 04s, retry Order is running since 9m 09s, retry Order is running since 9m 14s, retry Order is running since 9m 20s, retry Order is running since 9m 25s, retry Order is running since 9m 30s, retry Order is running since 9m 35s, retry Order is running since 9m 41s, retry Order is running since 9m 46s, retry Order is running since 9m 51s, retry Order is running since 9m 56s, retry Order is running since 10m 01s, retry Order is running since 10m 07s, retry Order is running since 10m 12s, retry Order is running since 10m 17s, retry Order is running since 10m 22s, retry Order is running since 10m 28s, retry Order is running since 10m 33s, retry Order is running since 10m 38s, retry Order is running since 10m 43s, retry Order is running since 10m 49s, retry Order is running since 10m 54s, retry Order is running since 10m 59s, retry Order is running since 11m 04s, retry Order is running since 11m 10s, retry Order is running since 11m 15s, retry Order is running since 11m 20s, retry Order is running since 11m 25s, retry Order is running since 11m 30s, retry Order is running since 11m 36s, retry Order is running since 11m 41s, retry Order is running since 11m 46s, retry Order is running since 11m 51s, retry Order is running since 11m 57s, retry Order is running since 12m 02s, retry Order is running since 12m 07s, retry Order is running since 12m 12s, retry Order is running since 12m 18s, retry Order is running since 12m 23s, retry Order is running since 12m 28s, retry Order is running since 12m 33s, retry Order is running since 12m 38s, retry Order is running since 12m 44s, retry Order is running since 12m 49s, retry Order is running since 12m 54s, retry Order is running since 12m 59s, retry Order is running since 13m 05s, retry Order is running since 13m 10s, retry Order is running since 13m 15s, retry Order is running since 13m 20s, retry Order is running since 13m 25s, retry Order is running since 13m 31s, retry Order is running since 13m 36s, retry Order is running since 13m 41s, retry Order is running since 13m 46s, retry Order is running since 13m 52s, retry Order is running since 13m 57s, retry Order is running since 14m 02s, retry Order is running since 14m 07s, retry Order is running since 14m 13s, retry Order is running since 14m 18s, retry Order is running since 14m 23s, retry Order is running since 14m 28s, retry Order is running since 14m 34s, retry Order is running since 14m 39s, retry Order is running since 14m 44s, retry Order is running since 14m 49s, retry Order is running since 14m 54s, retry Order is running since 15m, retry Order is running since 15m 05s, retry Order is running since 15m 10s, retry Order is running since 15m 15s, retry Order is running since 15m 21s, retry Order is running since 15m 26s, retry Order is running since 15m 31s, retry Order is running since 15m 36s, retry Order is running since 15m 42s, retry Order is running since 15m 47s, retry Order is running since 15m 52s, retry Order is running since 15m 57s, retry Order is running since 16m 03s, retry Order is running since 16m 08s, retry Order is running since 16m 13s, retry Order is running since 16m 18s, retry Order is running since 16m 23s, retry Order is running since 16m 29s, retry Order is running since 16m 34s, retry Order is running since 16m 39s, retry Order is running since 16m 44s, retry Order is running since 16m 50s, retry Order is running since 16m 55s, retry Order is running since 17m, retry Order is running since 17m 05s, retry Order is running since 17m 11s, retry Order is running since 17m 16s, retry Order is running since 17m 21s, retry Order is running since 17m 26s, retry Order is running since 17m 32s, retry Order is running since 17m 37s, retry Order is running since 17m 42s, retry Order is running since 17m 47s, retry Order is running since 17m 52s, retry Order is running since 17m 58s, retry Order is running since 18m 03s, retry Order is running since 18m 08s, retry Order is running since 18m 13s, retry Order is running since 18m 19s, retry Order is running since 18m 24s, retry Order is running since 18m 29s, retry Order is running since 18m 34s, retry Order is running since 18m 40s, retry Order is running since 18m 45s, retry Order is running since 18m 50s, retry Order is running since 18m 55s, retry Order is running since 19m, retry Order is running since 19m 06s, retry Order is running since 19m 11s, retry Order is running since 19m 16s, retry Order is running since 19m 21s, retry Order is running since 19m 27s, retry Order is running since 19m 32s, retry Order is running since 19m 37s, retry Order is running since 19m 42s, retry Order is running since 19m 48s, retry Order is running since 19m 53s, retry Order is running since 19m 58s, retry Order is running since 20m 03s, retry Order is running since 20m 09s, retry Order is running since 20m 14s, retry Order is running since 20m 19s, retry Order is running since 20m 24s, retry Order is running since 20m 29s, retry Order is running since 20m 35s, retry Order is running since 20m 40s, retry Order is running since 20m 45s, retry Order is running since 20m 50s, retry Order is running since 20m 56s, retry Order is running since 21m 01s, retry Order is running since 21m 06s, retry Order is running since 21m 11s, retry Order is running since 21m 17s, retry Order is running since 21m 22s, retry Order is running since 21m 27s, retry Order is running since 21m 32s, retry Order is running since 21m 37s, retry Order is running since 21m 43s, retry Order is running since 21m 48s, retry Order is running since 21m 53s, retry Order is running since 21m 58s, retry Order is running since 22m 04s, retry Order is running since 22m 09s, retry Order is running since 22m 14s, retry Order is running since 22m 19s, retry Order is running since 22m 25s, retry Order is running since 22m 30s, retry Order is running since 22m 35s, retry Order is running since 22m 40s, retry Order is running since 22m 45s, retry Order is running since 22m 51s, retry Order is running since 22m 56s, retry Order is running since 23m 01s, retry Order is running since 23m 06s, retry Order is running since 23m 12s, retry Order is running since 23m 17s, retry Order is running since 23m 22s, retry Order is running since 23m 27s, retry Order is running since 23m 33s, retry Order is running since 23m 38s, retry Order is running since 23m 43s, retry Order is running since 23m 48s, retry Order is running since 23m 54s, retry Order is running since 23m 59s, retry Order is running since 24m 04s, retry Order is running since 24m 09s, retry Order is running since 24m 14s, retry Order is running since 24m 20s, retry Order is running since 24m 25s, retry Order is running since 24m 30s, retry Order is running since 24m 35s, retry Order is running since 24m 41s, retry Order is running since 24m 46s, retry Order is running since 24m 51s, retry Order is running since 24m 56s, retry Order is running since 25m 02s, retry Order is running since 25m 07s, retry Order is running since 25m 12s, retry Order is running since 25m 17s, retry Order is running since 25m 22s, retry Order is running since 25m 28s, retry Order is running since 25m 33s, retry Order is running since 25m 38s, retry Order is running since 25m 43s, retry Order is running since 25m 49s, retry Order is running since 25m 54s, retry Order is running since 25m 59s, retry Order is running since 26m 04s, retry Order is running since 26m 10s, retry Order is running since 26m 15s, retry Order is running since 26m 20s, retry Order is running since 26m 25s, retry Order is running since 26m 31s, retry Order is running since 26m 36s, retry Order is running since 26m 41s, retry Order is running since 26m 46s, retry Order is running since 26m 52s, retry Order is running since 26m 57s, retry Order is running since 27m 02s, retry Order is running since 27m 07s, retry Order is running since 27m 12s, retry Order is running since 27m 18s, retry Order is running since 27m 23s, retry Order is running since 27m 28s, retry Order is running since 27m 33s, retry Order is running since 27m 39s, retry Order is running since 27m 44s, retry Order is running since 27m 49s, retry Order is running since 27m 54s, retry Order is running since 28m, retry Order is running since 28m 05s, retry Order is running since 28m 10s, retry Order is running since 28m 15s, retry Order is running since 28m 20s, retry Order is running since 28m 26s, retry Order is running since 28m 31s, retry Order is running since 28m 36s, retry Order is running since 28m 41s, retry Order is running since 28m 47s, retry Order is running since 28m 52s, retry Order is running since 28m 57s, retry Order is running since 29m 02s, retry Order is running since 29m 08s, retry Order is running since 29m 13s, retry Order is running since 29m 18s, retry Order is running since 29m 23s, retry Order is running since 29m 29s, retry Order is running since 29m 34s, retry Order is running since 29m 39s, retry Order is running since 29m 44s, retry Order is running since 29m 49s, retry Order is running since 29m 55s, retry Order is running since 30m, retry Order is running since 30m 05s, retry Order is running since 30m 10s, retry Order is running since 30m 16s, retry Order is running since 30m 21s, retry Order is running since 30m 26s, retry Order is running since 30m 31s, retry Order is running since 30m 37s, retry Order is running since 30m 42s, retry Order is running since 30m 47s, retry Order is running since 30m 52s, retry Order is running since 30m 57s, retry Order is running since 31m 03s, retry Order is running since 31m 08s, retry Order is running since 31m 13s, retry Order is running since 31m 18s, retry Order is running since 31m 24s, retry Order is running since 31m 29s, retry Order is running since 31m 34s, retry Order is running since 31m 39s, retry Order is running since 31m 45s, retry Order is running since 31m 50s, retry Order is running since 31m 55s, retry Order is running since 32m, retry Order is running since 32m 06s, retry Order is running since 32m 11s, retry Order is running since 32m 16s, retry Order is running since 32m 21s, retry Order is running since 32m 26s, retry Order is running since 32m 32s, retry Order is running since 32m 37s, retry Order is running since 32m 42s, retry Order is running since 32m 47s, retry Order is running since 32m 53s, retry Order is running since 32m 58s, retry Order is running since 33m 03s, retry Order is running since 33m 08s, retry Order is running since 33m 14s, retry Order is running since 33m 19s, retry Order is running since 33m 24s, retry Order is running since 33m 29s, retry Order is running since 33m 34s, retry Order is running since 33m 40s, retry Order is running since 33m 45s, retry Order is running since 33m 50s, retry Order is running since 33m 55s, retry Order is running since 34m 01s, retry Order is running since 34m 06s, retry Order is running since 34m 11s, retry Order is running since 34m 16s, retry Order is running since 34m 22s, retry Order is running since 34m 27s, retry Order is running since 34m 32s, retry Order is running since 34m 37s, retry Order is running since 34m 42s, retry Order is running since 34m 48s, retry Order is running since 34m 53s, retry Order is running since 34m 58s, retry Order is running since 35m 03s, retry Order is running since 35m 09s, retry Order is running since 35m 14s, retry Order is running since 35m 19s, retry Order is running since 35m 24s, retry Order is running since 35m 30s, retry Order is running since 35m 35s, retry Order is running since 35m 40s, retry Order is running since 35m 45s, retry Order is running since 35m 51s, retry Order is running since 35m 56s, retry Order is running since 36m 01s, retry Order is running since 36m 06s, retry Order is running since 36m 11s, retry Order is running since 36m 17s, retry Order is running since 36m 22s, retry Order is running since 36m 27s, retry Order is running since 36m 32s, retry Order is running since 36m 38s, retry Order is running since 36m 43s, retry Order is running since 36m 48s, retry Order is running since 36m 53s, retry Order is running since 36m 59s, retry Order is running since 37m 04s, retry Order is running since 37m 09s, retry Order is running since 37m 14s, retry Order is running since 37m 19s, retry Order is running since 37m 25s, retry Order is running since 37m 30s, retry Order is running since 37m 35s, retry Order is running since 37m 40s, retry Order is running since 37m 46s, retry Order is running since 37m 51s, retry Order is running since 37m 56s, retry Order is running since 38m 01s, retry Order is running since 38m 07s, retry Order is running since 38m 12s, retry Order is running since 38m 17s, retry Order is running since 38m 22s, retry Order is running since 38m 27s, retry Order is running since 38m 33s, retry Order is running since 38m 38s, retry Order is running since 38m 43s, retry Order is running since 38m 48s, retry Order is running since 38m 54s, retry Order is running since 38m 59s, retry Order is running since 39m 04s, retry Order is running since 39m 09s, retry Order is running since 39m 15s, retry Order is running since 39m 20s, retry Order is running since 39m 25s, retry Order is running since 39m 30s, retry Order is running since 39m 35s, retry Order is running since 39m 41s, retry Order is running since 39m 46s, retry Order is running since 39m 51s, retry Order is running since 39m 56s, retry Order is running since 40m 02s, retry Order is running since 40m 07s, retry Order is running since 40m 12s, retry Order is running since 40m 17s, retry Order is running since 40m 23s, retry Order is running since 40m 28s, retry Order is running since 40m 33s, retry Order is running since 40m 38s, retry Order is running since 40m 43s, retry Order is running since 40m 49s, retry Order is running since 40m 54s, retry Order is running since 40m 59s, retry Order is running since 41m 04s, retry Order is running since 41m 10s, retry Order is running since 41m 15s, retry Order is running since 41m 20s, retry Order is running since 41m 25s, retry Order is running since 41m 30s, retry Order is running since 41m 36s, retry Order is running since 41m 41s, retry Order is running since 41m 46s, retry Order is running since 41m 51s, retry Order is running since 41m 57s, retry Order is running since 42m 02s, retry Order is running since 42m 07s, retry Order is running since 42m 12s, retry Order is running since 42m 18s, retry Order is running since 42m 23s, retry Order is running since 42m 28s, retry Order is running since 42m 33s, retry Order is running since 42m 39s, retry Order is running since 42m 44s, retry Order is running since 42m 49s, retry Order is running since 42m 54s, retry Order is running since 42m 59s, retry Order is running since 43m 05s, retry Order is running since 43m 10s, retry Order is running since 43m 15s, retry Order is running since 43m 20s, retry Order is running since 43m 26s, retry Order is running since 43m 31s, retry Order is running since 43m 36s, retry Order is running since 43m 41s, retry Order is running since 43m 47s, retry Order is running since 43m 52s, retry Order is running since 43m 57s, retry Order is running since 44m 02s, retry Order is running since 44m 08s, retry Order is running since 44m 13s, retry Order is running since 44m 18s, retry Order is running since 44m 23s, retry Order is running since 44m 28s, retry Order is running since 44m 34s, retry Order is running since 44m 39s, retry Order is running since 44m 44s, retry Order is running since 44m 49s, retry Order is running since 44m 55s, retry Order is running since 45m, retry Order is running since 45m 05s, retry Order is running since 45m 10s, retry Order is running since 45m 16s, retry Order is running since 45m 21s, retry Order is running since 45m 26s, retry Order is running since 45m 31s, retry Order is running since 45m 37s, retry Order is running since 45m 42s, retry Order is running since 45m 47s, retry Order is running since 45m 52s, retry Order is running since 45m 58s, retry Order is running since 46m 03s, retry Order is running since 46m 08s, retry Order is running since 46m 13s, retry Order is running since 46m 18s, retry Order is running since 46m 24s, retry Order is running since 46m 29s, retry Order is running since 46m 34s, retry Order is running since 46m 39s, retry Order is running since 46m 45s, retry Order is running since 46m 50s, retry Order is running since 46m 55s, retry Order is running since 47m, retry Order is running since 47m 05s, retry Order is running since 47m 11s, retry Order is running since 47m 16s, retry Order is running since 47m 21s, retry Order is running since 47m 26s, retry Order is running since 47m 32s, retry Order is running since 47m 37s, retry Order is running since 47m 42s, retry Order is running since 47m 47s, retry Order is running since 47m 53s, retry Order is running since 47m 58s, retry Order is running since 48m 03s, retry Order is running since 48m 08s, retry Order is running since 48m 13s, retry Order is running since 48m 19s, retry Order is running since 48m 24s, retry Order is running since 48m 29s, retry Order is running since 48m 34s, retry Order is running since 48m 40s, retry Order is running since 48m 45s, retry Order is running since 48m 50s, retry Order is running since 48m 55s, retry Order is running since 49m 01s, retry Order is running since 49m 06s, retry Order is running since 49m 11s, retry Order is running since 49m 16s, retry Order is running since 49m 22s, retry Order is running since 49m 27s, retry Order is running since 49m 32s, retry Order is running since 49m 37s, retry Order is running since 49m 42s, retry Order is running since 49m 48s, retry Order is running since 49m 53s, retry Order is running since 49m 58s, retry Order is running since 50m 03s, retry Order is running since 50m 09s, retry Order is running since 50m 14s, retry Order is running since 50m 19s, retry Order is running since 50m 24s, retry Order is running since 50m 30s, retry Order is running since 50m 35s, retry Order is running since 50m 40s, retry Order is running since 50m 45s, retry Order is running since 50m 51s, retry Order is running since 50m 56s, retry Order is running since 51m 01s, retry Order is running since 51m 06s, retry Order is running since 51m 12s, retry Order is running since 51m 17s, retry Order is running since 51m 22s, retry Order is running since 51m 27s, retry Order is running since 51m 32s, retry Order is running since 51m 38s, retry Order is running since 51m 43s, retry Order is running since 51m 48s, retry Order is running since 51m 53s, retry Order is running since 51m 59s, retry Order is running since 52m 04s, retry Order is running since 52m 09s, retry Order is running since 52m 14s, retry Order is running since 52m 20s, retry Order is running since 52m 25s, retry Order is running since 52m 30s, retry Order is running since 52m 35s, retry Order is running since 52m 40s, retry Order is running since 52m 46s, retry Order is running since 52m 51s, retry Order is running since 52m 56s, retry Order is running since 53m 01s, retry Order is running since 53m 07s, retry Order is running since 53m 12s, retry Order is running since 53m 17s, retry Order is running since 53m 22s, retry Order is running since 53m 28s, retry Order is running since 53m 33s, retry Order is running since 53m 38s, retry Order is running since 53m 43s, retry Order is running since 53m 48s, retry Order is running since 53m 54s, retry Order is running since 53m 59s, retry Order is running since 54m 04s, retry Order is running since 54m 09s, retry Order is running since 54m 15s, retry Order is running since 54m 20s, retry Order is running since 54m 25s, retry Order is running since 54m 30s, retry Order is running since 54m 36s, retry Order is running since 54m 41s, retry Order is running since 54m 46s, retry Order is running since 54m 51s, retry Order is running since 54m 57s, retry Order is running since 55m 02s, retry Order is running since 55m 07s, retry Order is running since 55m 12s, retry Order is running since 55m 17s, retry Order is running since 55m 23s, retry Order is running since 55m 28s, retry Order is running since 55m 33s, retry Order is running since 55m 38s, retry Order is running since 55m 44s, retry Order is running since 55m 49s, retry Order is running since 55m 54s, retry Order is running since 55m 59s, retry Order is running since 56m 05s, retry Order is running since 56m 10s, retry Order is running since 56m 15s, retry Order is running since 56m 20s, retry Order is running since 56m 25s, retry Order is running since 56m 31s, retry Order is running since 56m 36s, retry Order is running since 56m 41s, retry Order is running since 56m 46s, retry Order is running since 56m 52s, retry Order is running since 56m 57s, retry Order is running since 57m 02s, retry Order is running since 57m 07s, retry Order is running since 57m 13s, retry Order is running since 57m 18s, retry Order is running since 57m 23s, retry Order is running since 57m 28s, retry Order is running since 57m 33s, retry Order is running since 57m 39s, retry Order is running since 57m 44s, retry Order is running since 57m 49s, retry Order is running since 57m 54s, retry Order is running since 58m, retry Order is running since 58m 05s, retry Order is running since 58m 10s, retry Order is running since 58m 15s, retry Order is running since 58m 21s, retry Order is running since 58m 26s, retry Order is running since 58m 31s, retry Order is running since 58m 36s, retry Order is running since 58m 41s, retry Order is running since 58m 47s, retry Order is running since 58m 52s, retry Order is running since 58m 57s, retry Order is running since 59m 02s, retry Order is running since 59m 08s, retry Order is running since 59m 13s, retry Order is running since 59m 18s, retry Order is running since 59m 23s, retry Order is running since 59m 29s, retry Order is running since 59m 34s, retry Order is running since 59m 39s, retry Order is running since 59m 44s, retry Order is running since 59m 49s, retry Order is running since 59m 55s, retry Order is running since 1h, retry Order is running since 1h, retry Order is running since 1h, retry Order is running since 1h, retry Order is running since 1h, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [22/Apr/2023 08:44:57] self-service stop_order : Stop the order on overseer pod ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-74fc4c7cd9-5grs6 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-74fc4c7cd9-5grs6 -- rm -f /results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order ran during 1h ________________________________________________________________________________ [22/Apr/2023 08:44:58] self-service download_logs : Download order.tar.gz ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-74fc4c7cd9-5grs6 --- stderr --- Checking pod: overseer-0-74fc4c7cd9-5grs6 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-74fc4c7cd9-5grs6 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-74fc4c7cd9-5grs6 -i -- bash -c 'if [ -f "/results/orders/self-service/order.tar.gz" ]; then echo "/results/orders/self-service/order.tar.gz file found"; exit 0; else echo "/results/orders/self-service/order.tar.gz file not found"; exit 1; fi' | grep "/results/orders/self-service/order.tar.gz file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/self-service/order.tar.gz file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-74fc4c7cd9-5grs6 --- stderr --- [run_command]: kubectl --namespace=xlou exec overseer-0-74fc4c7cd9-5grs6 -i -- du -k /results/orders/self-service/order.tar.gz [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 32 /results/orders/self-service/order.tar.gz --- stderr --- - Download file (size 32k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-74fc4c7cd9-5grs6 --- stderr --- source : /results/orders/self-service/order.tar.gz @ overseer-0-74fc4c7cd9-5grs6 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform/07_Platform/01_self-service/order.tar.gz [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-74fc4c7cd9-5grs6 --- stderr --- [loop_until]: kubectl --namespace=xlou cp overseer-0-74fc4c7cd9-5grs6:/results/orders/self-service/order.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform/07_Platform/01_self-service/order.tar.gz [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- - Extract archive zip file : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform/07_Platform/01_self-service/order.tar.gz destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform/07_Platform/01_self-service ________________________________________________________________________________ [22/Apr/2023 08:45:02] self-service show_cmd : Display order command ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform/07_Platform/01_self-service/cmd.txt is small (1 lines), printing all lines: ----- output ----- /lodestar/clients/gatling-for-pyrock.sh --run-mode local --simulation com.forgerock.gatling.Loadtest --simulations-folder /lodestar/pyrock/shared/clients/gatling-open/ --run-description platform.SelfService@medium --results-folder /results/gatling/self-service --no-reports ________________________________________________________________________________ [22/Apr/2023 08:45:02] self-service show_rc : Display rc order ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform/07_Platform/01_self-service/rc.txt is small (1 lines), printing all lines: ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [22/Apr/2023 08:45:02] self-service show_stdout : Display stdout order ________________________________________________________________________________ [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform/07_Platform/01_self-service/stdout.txt is 12372 lines): ----- output ----- GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling 08:44:15.487 [WARN ] i.g.c.ZincCompiler$ - -target is deprecated: Use -release instead to compile against the correct platform API. 08:44:21.065 [WARN ] i.g.c.ZincCompiler$ - one warning found Gatling 3.9.3 is available! (you're using 3.9.0) 08:44:24.407 [WARN ] i.g.c.s.e.ElCompiler$ - You're still using the deprecated ${} pattern for Gatling EL. Please use the #{} pattern instead. Simulation com.forgerock.gatling.Loadtest started... ================================================================================ 2023-04-22 08:44:30 5s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=296 KO=0 ) > restLoginInitiate (OK=153 KO=0 ) > registrationCallback (OK=143 KO=0 ) ---- platform.SelfService ------------------------------------------------------ [- ] 0% waiting: 1337050 / active: 12 / done: 143 ================================================================================ ================================================================================ 2023-04-22 08:44:35 10s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=1214 KO=0 ) > restLoginInitiate (OK=615 KO=0 ) > registrationCallback (OK=599 KO=0 ) ---- platform.SelfService ------------------------------------------------------ [- ] 0% waiting: 1336587 / active: 19 / done: 599 ================================================================================ ================================================================================ 2023-04-22 08:44:40 15s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=2748 KO=0 ) > restLoginInitiate (OK=1385 KO=0 ) > registrationCallback (OK=1363 KO=0 ) ---- platform.SelfService ------------------------------------------------------ [- ] 0% waiting: 1335816 / active: 26 / done: 1363 ================================================================================ ================================================================================ 2023-04-22 08:44:45 20s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=4896 KO=0 ) > restLoginInitiate (OK=2463 KO=0 ) > registrationCallback (OK=2433 KO=0 ) ---- platform.SelfService ------------------------------------------------------ [- ] 0% waiting: 1334736 / active: 36 / done: 2433 ================================================================================ ================================================================================ 2023-04-22 08:44:50 25s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=7549 KO=0 ) > restLoginInitiate (OK=3849 KO=0 ) > registrationCallback (OK=3700 KO=0 ) ---- platform.SelfService ------------------------------------------------------ [- ] 0% waiting: 1333347 / active: 158 / done: 3700 ================================================================================ ================================================================================ 2023-04-22 08:44:55 30s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=10961 KO=0 ) > restLoginInitiate (OK=5541 KO=0 ) > registrationCallback (OK=5420 KO=0 ) ---- platform.SelfService ------------------------------------------------------ [- ] 0% waiting: 1331652 / active: 133 / done: 5420 ================================================================================ ================================================================================ 2023-04-22 08:45:00 35s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=14548 KO=0 ) > restLoginInitiate (OK=7383 KO=0 ) > registrationCallback (OK=7165 KO=0 ) ---- platform.SelfService ------------------------------------------------------ [- ] 0% waiting: 1329804 / active: 236 / done: 7165 ================================================================================ ================================================================================ 2023-04-22 08:45:05 40s elapsed [...] Accept-API-Version: resource=2.1, protocol=1.0 accept: application/json content-type: application/json host: xlou.iam.xlou-cdm.engineeringpit.com content-length: 0 body:StringChunksRequestBody{charset=UTF-8, content=} ========================= HTTP response: status: 502 Bad Gateway headers: Date: Sat, 22 Apr 2023 08:44:49 GMT Content-Type: text/html Content-Length: 150 Connection: keep-alive Set-Cookie: route=1682153090.753.302455.156117|f60edb382037eb2df1e800d563ad78a7; Path=/am; Secure; HttpOnly Strict-Transport-Security: max-age=15724800; includeSubDomains body: 502 Bad Gateway

502 Bad Gateway

nginx
<<<<<<<<<<<<<<<<<<<<<<<<< 09:44:49.757 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-2' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 09:44:49.757 [ERROR] i.g.h.a.HttpRequestAction - 'registrationCallback' failed to execute: No attribute named 'callbacks' is defined ================================================================================ 2023-04-22 09:44:50 3625s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=2670576 KO=2 ) > restLoginInitiate (OK=1335310 KO=2 ) > registrationCallback (OK=1335266 KO=0 ) ---- Errors -------------------------------------------------------------------- > status.find.is(200), but actually found 502 2 (50.00%) > No attribute named 'callbacks' is defined: Failed to build req 2 (50.00%) uest: registrationCallback ---- platform.SelfService ------------------------------------------------------ [#########################################################################-] 99% waiting: 1885 / active: 52 / done: 1335268 ================================================================================ ================================================================================ 2023-04-22 09:44:55 3630s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=2674290 KO=2 ) > restLoginInitiate (OK=1337185 KO=2 ) > registrationCallback (OK=1337105 KO=0 ) ---- Errors -------------------------------------------------------------------- > status.find.is(200), but actually found 502 2 (50.00%) > No attribute named 'callbacks' is defined: Failed to build req 2 (50.00%) uest: registrationCallback ---- platform.SelfService ------------------------------------------------------ [#########################################################################-] 99% waiting: 0 / active: 98 / done: 1337107 ================================================================================ ================================================================================ 2023-04-22 09:44:55 3630s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=2674406 KO=2 ) > restLoginInitiate (OK=1337203 KO=2 ) > registrationCallback (OK=1337203 KO=0 ) ---- Errors -------------------------------------------------------------------- > status.find.is(200), but actually found 502 2 (50.00%) > No attribute named 'callbacks' is defined: Failed to build req 2 (50.00%) uest: registrationCallback ---- platform.SelfService ------------------------------------------------------ [##########################################################################]100% waiting: 0 / active: 0 / done: 1337205 ================================================================================ Simulation com.forgerock.gatling.Loadtest completed in 3630 seconds ---------------------- [22/Apr/2023 09:44:55] Create tar file self-service.tar.gz ---------------------- RESULTS_FOLDER=/results/gatling/ RESULT_FOLDER=self-service SIMULATION_PATH=self-service/loadtest-20230422074424640 PWD=/results/gatling/self-service/loadtest-20230422074424640 [cmd] tar -czvf /results/gatling//self-service.tar.gz --exclude=simulation.log * /results/gatling ---------------------- [22/Apr/2023 09:44:55] Update /results/gatling//latest ---------------------- ---------------------- [22/Apr/2023 09:44:55] Update /results/gatling//latest.tar.gz ---------------------- ________________________________________________________________________________ [22/Apr/2023 08:45:02] self-service show_stderr : Display stderr order ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform/07_Platform/01_self-service/stderr.txt is small (0 lines), printing all lines: ----- output ----- ________________________________________________________________________________ [22/Apr/2023 08:45:02] self-service check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [22/Apr/2023 08:45:02] self-service print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [22/Apr/2023 08:45:02] self-service post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped