--Task-- name: Reporting-login-tree-1000 enabled: True class_name: GatlingResultTask source_name: overseer-0 source_namespace: >default< target_name: overseer-0 target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: ['Logs-parse-login-tree-100', 'Logs-parse-login-tree-400', 'Logs-parse-login-tree-800', 'Logs-parse-login-tree-1000', 'Logs-parse-login-tree-1200', 'Logs-parse-login-tree-1400', 'Logs-parse-login-tree-1500', 'Reporting-login-tree-100', 'Reporting-login-tree-400', 'Reporting-login-tree-800'] preceding_task: None options: {'task_name': 'login-tree-1000'} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock source (overseer-0) is a component 2025-03-16 01:25:01 - INFO: Timeout for this Task has changed to 3h 30m (12600 seconds) 2025-03-16 01:25:01 - INFO: timeout was set to GatlingResultTask default (half of global_duration or 3600 seconds (whatever is higher)), because it was unset Pod stdout file : /results/orders/Reporting-login-tree-1000/stdout.txt Pod stderr file : /results/orders/Reporting-login-tree-1000/stderr.txt Pod log : /results/orders/Reporting-login-tree-1000 ________________________________________________________________________________ [2025-03-16 01:25:01] Reporting-login-tree-1000 step1 : Write order for overseer to generate the report ________________________________________________________________________________ Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-1000/order.json { "name": "Reporting-login-tree-1000", "command": " /lodestar/lodestar.py perf run-gatling --reports-only=\"/results/gatling/login-tree-1000\" --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx8G\" --archive-name=\"login-tree-1000.tar.gz\"", "out-dir": "/results/orders/Reporting-login-tree-1000" } ________________________________________________________________________________ [2025-03-16 01:25:01] Reporting-login-tree-1000 step2 : Make sure overseer is ready to accept order (not already busy) ________________________________________________________________________________ 2025-03-16 01:25:01,180 INFO 2025-03-16 01:25:01,180 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-03-16 01:25:01,180 INFO [loop_until]: (max_time=120, interval=5, expected_rc=[0] 2025-03-16 01:25:01,394 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-16 01:25:01,394 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:25:01,394 DEBUG --- stdout --- 2025-03-16 01:25:01,394 DEBUG WAITING 2025-03-16 01:25:01,394 DEBUG --- stderr --- 2025-03-16 01:25:01,394 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 34 0 --:--:-- --:--:-- --:--:-- 34 ________________________________________________________________________________ [2025-03-16 01:25:01] Reporting-login-tree-1000 step3 : Send order to overseer ________________________________________________________________________________ 2025-03-16 01:25:01,395 INFO 2025-03-16 01:25:01,395 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-16 01:25:01,395 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-16 01:25:01,674 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-16 01:25:01,674 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:25:01,674 DEBUG --- stdout --- 2025-03-16 01:25:01,674 DEBUG overseer-0-59c948f569-rgrkv 2025-03-16 01:25:01,674 DEBUG --- stderr --- 2025-03-16 01:25:01,674 DEBUG 2025-03-16 01:25:01,675 INFO 2025-03-16 01:25:01,675 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-1000/order.json overseer-0-59c948f569-rgrkv:/results/orders/order.json 2025-03-16 01:25:01,675 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-16 01:25:03,027 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:25:03,027 DEBUG --- stdout --- 2025-03-16 01:25:03,027 DEBUG 2025-03-16 01:25:03,028 DEBUG --- stderr --- 2025-03-16 01:25:03,028 DEBUG Order has been successfully forwarded to overseer ________________________________________________________________________________ [2025-03-16 01:25:03] Reporting-login-tree-1000 step4 : Wait order is done ________________________________________________________________________________ Workaround for PERF-1966. Sleeping for 5 seconds. 2025-03-16 01:25:08,028 INFO 2025-03-16 01:25:08,028 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-03-16 01:25:08,028 INFO [loop_until]: (max_time=12600, interval=5, expected_rc=[0] 2025-03-16 01:25:08,241 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:25:13,455 INFO [loop_until]: Function succeeded after 5s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:25:18,667 INFO [loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:25:23,879 INFO [loop_until]: Function succeeded after 15s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:25:29,091 INFO [loop_until]: Function succeeded after 21s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:25:34,304 INFO [loop_until]: Function succeeded after 26s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:25:39,516 INFO [loop_until]: Function succeeded after 31s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:25:44,730 INFO [loop_until]: Function succeeded after 36s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:25:49,986 INFO [loop_until]: Function succeeded after 41s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:25:55,200 INFO [loop_until]: Function succeeded after 47s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:26:00,412 INFO [loop_until]: Function succeeded after 52s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:26:05,624 INFO [loop_until]: Function succeeded after 57s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:26:10,836 INFO [loop_until]: Function succeeded after 1m 02s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:26:16,048 INFO [loop_until]: Function succeeded after 1m 08s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:26:21,265 INFO [loop_until]: Function succeeded after 1m 13s (rc=0) - expected pattern found 2025-03-16 01:26:21,265 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:26:21,265 DEBUG --- stdout --- 2025-03-16 01:26:21,265 DEBUG WAITING 2025-03-16 01:26:21,265 DEBUG --- stderr --- 2025-03-16 01:26:21,265 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33 ________________________________________________________________________________ [2025-03-16 01:26:21] Reporting-login-tree-1000 step5 : Wait until gatling report is generated on overseer ________________________________________________________________________________ 2025-03-16 01:26:21,266 INFO 2025-03-16 01:26:21,266 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-16 01:26:21,266 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-16 01:26:21,571 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-16 01:26:21,571 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:26:21,571 DEBUG --- stdout --- 2025-03-16 01:26:21,571 DEBUG overseer-0-59c948f569-rgrkv 2025-03-16 01:26:21,571 DEBUG --- stderr --- 2025-03-16 01:26:21,571 DEBUG Checking pod: overseer-0-59c948f569-rgrkv for file exists, if not wait. 2025-03-16 01:26:21,572 INFO 2025-03-16 01:26:21,572 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- bash -c 'if [ -f "/results/gatling/login-tree-1000/login-tree-1000.tar.gz" ]; then echo "/results/gatling/login-tree-1000/login-tree-1000.tar.gz file found"; exit 0; else echo "/results/gatling/login-tree-1000/login-tree-1000.tar.gz file not found"; exit 1; fi' | grep "/results/gatling/login-tree-1000/login-tree-1000.tar.gz file found" 2025-03-16 01:26:21,572 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-16 01:26:22,415 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-16 01:26:22,415 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:26:22,415 DEBUG --- stdout --- 2025-03-16 01:26:22,415 DEBUG /results/gatling/login-tree-1000/login-tree-1000.tar.gz file found 2025-03-16 01:26:22,415 DEBUG --- stderr --- 2025-03-16 01:26:22,415 DEBUG 2025-03-16 01:26:22,415 INFO 2025-03-16 01:26:22,415 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- du -k /results/gatling/login-tree-1000/login-tree-1000.tar.gz 2025-03-16 01:26:23,203 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-03-16 01:26:23,204 DEBUG --- stdout --- 2025-03-16 01:26:23,204 DEBUG 252 /results/gatling/login-tree-1000/login-tree-1000.tar.gz 2025-03-16 01:26:23,204 DEBUG --- stderr --- 2025-03-16 01:26:23,204 DEBUG 2025-03-16 01:26:23,204 INFO - Download file (size 252k) source : /results/gatling/login-tree-1000/login-tree-1000.tar.gz @ overseer-0-59c948f569-rgrkv destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-1000.tar.gz 2025-03-16 01:26:23,204 INFO 2025-03-16 01:26:23,204 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-59c948f569-rgrkv:/results/gatling/login-tree-1000/login-tree-1000.tar.gz /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-1000.tar.gz 2025-03-16 01:26:23,204 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-03-16 01:26:24,173 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:26:24,173 DEBUG --- stdout --- 2025-03-16 01:26:24,173 DEBUG tar: Removing leading `/' from member names 2025-03-16 01:26:24,173 DEBUG --- stderr --- 2025-03-16 01:26:24,173 DEBUG ________________________________________________________________________________ [2025-03-16 01:26:24] Reporting-login-tree-1000 step6 : Unzip the result ________________________________________________________________________________ 2025-03-16 01:26:24,174 INFO 2025-03-16 01:26:24,174 INFO [run_command]: tar zxf /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-1000.tar.gz -C /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/07_Scenario_scenario/04_login-tree-1000/gatling 2025-03-16 01:26:24,187 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-03-16 01:26:24,187 DEBUG --- stdout --- 2025-03-16 01:26:24,187 DEBUG 2025-03-16 01:26:24,187 DEBUG --- stderr --- 2025-03-16 01:26:24,187 DEBUG 2025-03-16 01:26:24,187 INFO ________________________________________________________________________________ [2025-03-16 01:26:24] Reporting-login-tree-1000 step7 : Print rc order ________________________________________________________________________________ 2025-03-16 01:26:24,187 INFO 2025-03-16 01:26:24,187 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-16 01:26:24,188 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-16 01:26:24,462 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-16 01:26:24,462 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:26:24,462 DEBUG --- stdout --- 2025-03-16 01:26:24,462 DEBUG overseer-0-59c948f569-rgrkv 2025-03-16 01:26:24,462 DEBUG --- stderr --- 2025-03-16 01:26:24,462 DEBUG Checking pod: overseer-0-59c948f569-rgrkv for file exists, if not wait. 2025-03-16 01:26:24,463 INFO 2025-03-16 01:26:24,464 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-1000/rc.txt" ]; then echo "/results/orders/Reporting-login-tree-1000/rc.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-1000/rc.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-1000/rc.txt file found" 2025-03-16 01:26:24,464 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-16 01:26:25,264 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-16 01:26:25,264 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:26:25,264 DEBUG --- stdout --- 2025-03-16 01:26:25,264 DEBUG /results/orders/Reporting-login-tree-1000/rc.txt file found 2025-03-16 01:26:25,264 DEBUG --- stderr --- 2025-03-16 01:26:25,264 DEBUG 2025-03-16 01:26:25,264 INFO 2025-03-16 01:26:25,264 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- du -k /results/orders/Reporting-login-tree-1000/rc.txt 2025-03-16 01:26:26,073 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-03-16 01:26:26,073 DEBUG --- stdout --- 2025-03-16 01:26:26,074 DEBUG 4 /results/orders/Reporting-login-tree-1000/rc.txt 2025-03-16 01:26:26,074 DEBUG --- stderr --- 2025-03-16 01:26:26,074 DEBUG 2025-03-16 01:26:26,074 INFO - Download file (size 4k) source : /results/orders/Reporting-login-tree-1000/rc.txt @ overseer-0-59c948f569-rgrkv destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-1000/rc.txt 2025-03-16 01:26:26,075 INFO 2025-03-16 01:26:26,075 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-59c948f569-rgrkv:/results/orders/Reporting-login-tree-1000/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-1000/rc.txt 2025-03-16 01:26:26,075 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-03-16 01:26:26,784 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:26:26,784 DEBUG --- stdout --- 2025-03-16 01:26:26,784 DEBUG tar: Removing leading `/' from member names 2025-03-16 01:26:26,784 DEBUG --- stderr --- 2025-03-16 01:26:26,784 DEBUG 2025-03-16 01:26:26,784 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-1000/rc.txt is small (1 lines), printing all lines: 2025-03-16 01:26:26,784 INFO ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [2025-03-16 01:26:26] Reporting-login-tree-1000 step8 : Check rc log ________________________________________________________________________________ CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) PASS: no error found in rc log ________________________________________________________________________________ [2025-03-16 01:26:27] Reporting-login-tree-1000 step9 : Print stdout order ________________________________________________________________________________ 2025-03-16 01:26:27,019 INFO 2025-03-16 01:26:27,019 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-16 01:26:27,019 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-16 01:26:27,296 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-16 01:26:27,296 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:26:27,296 DEBUG --- stdout --- 2025-03-16 01:26:27,296 DEBUG overseer-0-59c948f569-rgrkv 2025-03-16 01:26:27,296 DEBUG --- stderr --- 2025-03-16 01:26:27,296 DEBUG Checking pod: overseer-0-59c948f569-rgrkv for file exists, if not wait. 2025-03-16 01:26:27,298 INFO 2025-03-16 01:26:27,298 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-1000/stdout.txt" ]; then echo "/results/orders/Reporting-login-tree-1000/stdout.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-1000/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-1000/stdout.txt file found" 2025-03-16 01:26:27,298 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-16 01:26:28,091 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-16 01:26:28,091 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:26:28,091 DEBUG --- stdout --- 2025-03-16 01:26:28,091 DEBUG /results/orders/Reporting-login-tree-1000/stdout.txt file found 2025-03-16 01:26:28,091 DEBUG --- stderr --- 2025-03-16 01:26:28,091 DEBUG 2025-03-16 01:26:28,092 INFO 2025-03-16 01:26:28,092 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- du -k /results/orders/Reporting-login-tree-1000/stdout.txt 2025-03-16 01:26:28,877 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-03-16 01:26:28,878 DEBUG --- stdout --- 2025-03-16 01:26:28,878 DEBUG 8 /results/orders/Reporting-login-tree-1000/stdout.txt 2025-03-16 01:26:28,878 DEBUG --- stderr --- 2025-03-16 01:26:28,878 DEBUG 2025-03-16 01:26:28,878 INFO - Download file (size 8k) source : /results/orders/Reporting-login-tree-1000/stdout.txt @ overseer-0-59c948f569-rgrkv destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-1000/stdout.txt 2025-03-16 01:26:28,878 INFO 2025-03-16 01:26:28,878 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-59c948f569-rgrkv:/results/orders/Reporting-login-tree-1000/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-1000/stdout.txt 2025-03-16 01:26:28,878 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-03-16 01:26:29,596 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:26:29,596 DEBUG --- stdout --- 2025-03-16 01:26:29,596 DEBUG tar: Removing leading `/' from member names 2025-03-16 01:26:29,596 DEBUG --- stderr --- 2025-03-16 01:26:29,596 DEBUG 2025-03-16 01:26:29,597 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-1000/stdout.txt is small (97 lines), printing all lines: 2025-03-16 01:26:29,597 INFO ----- output ----- 2025-03-16 01:25:04,058 INFO pom.xml copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpg39_chuq 2025-03-16 01:25:04,060 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.reportsOnly="/results/gatling/login-tree-1000/loadtest-20250315211857101" -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx8G" [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmpg39_chuq/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmpg39_chuq/src/test/resources [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compile in 0.0 s [INFO] No sources to compile [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 01:25:05,894 |-INFO in ch.qos.logback.classic.LoggerContext[default] - This is logback-classic version 1.5.8 01:25:05,896 |-INFO in ch.qos.logback.classic.util.ContextInitializer@12d3a4e9 - No custom configurators were discovered as a service. 01:25:05,896 |-INFO in ch.qos.logback.classic.util.ContextInitializer@12d3a4e9 - Trying to configure with ch.qos.logback.classic.joran.SerializedModelConfigurator 01:25:05,896 |-INFO in ch.qos.logback.classic.util.ContextInitializer@12d3a4e9 - Constructed configurator of type class ch.qos.logback.classic.joran.SerializedModelConfigurator 01:25:05,902 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.scmo] 01:25:05,902 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.scmo] 01:25:05,909 |-INFO in ch.qos.logback.classic.util.ContextInitializer@12d3a4e9 - ch.qos.logback.classic.joran.SerializedModelConfigurator.configure() call lasted 6 milliseconds. ExecutionStatus=INVOKE_NEXT_IF_ANY 01:25:05,909 |-INFO in ch.qos.logback.classic.util.ContextInitializer@12d3a4e9 - Trying to configure with ch.qos.logback.classic.util.DefaultJoranConfigurator 01:25:05,910 |-INFO in ch.qos.logback.classic.util.ContextInitializer@12d3a4e9 - Constructed configurator of type class ch.qos.logback.classic.util.DefaultJoranConfigurator 01:25:05,910 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml] 01:25:05,913 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [jar:file:/home/jenkins/.m2/repository/io/gatling/gatling-maven-plugin/4.9.6/gatling-maven-plugin-4.9.6.jar!/logback.xml] 01:25:05,917 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@240237d2 - URL [jar:file:/home/jenkins/.m2/repository/io/gatling/gatling-maven-plugin/4.9.6/gatling-maven-plugin-4.9.6.jar!/logback.xml] is not of type file 01:25:05,961 |-WARN in ch.qos.logback.classic.joran.action.LevelAction - element is deprecated. Near [level] on line 12 01:25:05,961 |-WARN in ch.qos.logback.classic.joran.action.LevelAction - Please use "level" attribute within or elements instead. 01:25:06,001 |-INFO in ch.qos.logback.core.model.processor.AppenderModelHandler - Processing appender named [CONSOLE] 01:25:06,001 |-INFO in ch.qos.logback.core.model.processor.AppenderModelHandler - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 01:25:06,008 |-INFO in ch.qos.logback.core.model.processor.ImplicitModelHandler - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 01:25:06,029 |-INFO in ch.qos.logback.classic.model.processor.LevelModelHandler - ROOT level set to WARN 01:25:06,029 |-INFO in ch.qos.logback.core.model.processor.AppenderRefModelHandler - Attaching appender named [CONSOLE] to Logger[ROOT] 01:25:06,029 |-INFO in ch.qos.logback.core.model.processor.DefaultProcessor@25a65b77 - End of configuration. 01:25:06,030 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2ed0fbae - Registering current configuration as safe fallback point 01:25:06,030 |-INFO in ch.qos.logback.classic.util.ContextInitializer@12d3a4e9 - ch.qos.logback.classic.util.DefaultJoranConfigurator.configure() call lasted 120 milliseconds. ExecutionStatus=DO_NOT_INVOKE_NEXT_IF_ANY Parsing log file(s)... Parsing log file(s) done in 68s. Generating reports... ================================================================================ ---- Global Information -------------------------------------------------------- > request count 7170682 (OK=7170647 KO=35 ) > min response time 36 (OK=42 KO=36 ) > max response time 60000 (OK=27979 KO=60000 ) > mean response time 60 (OK=60 KO=6141 ) > std deviation 42 (OK=25 KO=13920 ) > response time 50th percentile 57 (OK=57 KO=205 ) > response time 75th percentile 66 (OK=66 KO=10000 ) > response time 95th percentile 79 (OK=79 KO=25015 ) > response time 99th percentile 116 (OK=116 KO=60000 ) > mean requests/sec 1991.86 (OK=1991.85 KO=0.01 ) ---- Response Time Distribution ------------------------------------------------ > t < 800 ms 7170374 ( 100%) > 800 ms <= t < 1200 ms 238 ( 0%) > t >= 1200 ms 35 ( 0%) > failed 35 ( 0%) ---- Errors -------------------------------------------------------------------- > status.find.is(200), but actually found 503 21 (60.00%) > i.n.h.s.SslHandshakeTimeoutException: handshake timed out afte 6 (17.14%) r 10000ms > status.find.is(200), but actually found 502 3 ( 8.57%) > j.i.IOException: Premature close 2 ( 5.71%) > Request timeout to openam-perf-200m.forgeblocks.com/34.107.203 2 ( 5.71%) .37:443 after 60000 ms > i.n.c.ConnectTimeoutException: connection timed out after 1000 1 ( 2.86%) 0 ms: openam-perf-200m.forgeblocks.com/34.107.203.37:443 ================================================================================ Reports generated, please open the following file: file:///results/gatling/login-tree-1000/loadtest-20250315211857101/index.html [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 01:10 min [INFO] Finished at: 2025-03-16T01:26:15Z [INFO] ------------------------------------------------------------------------ 2025-03-16 01:26:15,368 INFO Gatling simulation run ended successfully 2025-03-16 01:26:15,369 INFO Creating archive login-tree-1000.tar.gz with report files 2025-03-16 01:26:15,449 INFO Archive /results/gatling/login-tree-1000/login-tree-1000.tar.gz successfully created ________________________________________________________________________________ [2025-03-16 01:26:29] Reporting-login-tree-1000 step10 : Check stdout log and parse its content ________________________________________________________________________________ PASS: no error found in stdout log ________________________________________________________________________________ [2025-03-16 01:26:29] Reporting-login-tree-1000 step11 : Print stderr order ________________________________________________________________________________ 2025-03-16 01:26:29,598 INFO 2025-03-16 01:26:29,598 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-16 01:26:29,598 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-16 01:26:29,875 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-16 01:26:29,875 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:26:29,875 DEBUG --- stdout --- 2025-03-16 01:26:29,875 DEBUG overseer-0-59c948f569-rgrkv 2025-03-16 01:26:29,875 DEBUG --- stderr --- 2025-03-16 01:26:29,875 DEBUG Checking pod: overseer-0-59c948f569-rgrkv for file exists, if not wait. 2025-03-16 01:26:29,877 INFO 2025-03-16 01:26:29,877 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-1000/stderr.txt" ]; then echo "/results/orders/Reporting-login-tree-1000/stderr.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-1000/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-1000/stderr.txt file found" 2025-03-16 01:26:29,877 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-16 01:26:30,671 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-16 01:26:30,671 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:26:30,671 DEBUG --- stdout --- 2025-03-16 01:26:30,671 DEBUG /results/orders/Reporting-login-tree-1000/stderr.txt file found 2025-03-16 01:26:30,671 DEBUG --- stderr --- 2025-03-16 01:26:30,671 DEBUG 2025-03-16 01:26:30,671 INFO 2025-03-16 01:26:30,672 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- du -k /results/orders/Reporting-login-tree-1000/stderr.txt 2025-03-16 01:26:31,481 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-03-16 01:26:31,481 DEBUG --- stdout --- 2025-03-16 01:26:31,481 DEBUG 0 /results/orders/Reporting-login-tree-1000/stderr.txt 2025-03-16 01:26:31,481 DEBUG --- stderr --- 2025-03-16 01:26:31,481 DEBUG 2025-03-16 01:26:31,481 INFO - Download file (size 0k) source : /results/orders/Reporting-login-tree-1000/stderr.txt @ overseer-0-59c948f569-rgrkv destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-1000/stderr.txt 2025-03-16 01:26:31,482 INFO 2025-03-16 01:26:31,482 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-59c948f569-rgrkv:/results/orders/Reporting-login-tree-1000/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-1000/stderr.txt 2025-03-16 01:26:31,482 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-03-16 01:26:32,237 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:26:32,237 DEBUG --- stdout --- 2025-03-16 01:26:32,238 DEBUG tar: Removing leading `/' from member names 2025-03-16 01:26:32,238 DEBUG --- stderr --- 2025-03-16 01:26:32,238 DEBUG 2025-03-16 01:26:32,238 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-1000/stderr.txt is small (0 lines), printing all lines: 2025-03-16 01:26:32,238 INFO ----- output ----- ________________________________________________________________________________ [2025-03-16 01:26:32] Reporting-login-tree-1000 step12 : Check stderr log ________________________________________________________________________________ PASS: no error found in stderr log ________________________________________________________________________________ [2025-03-16 01:26:32] Reporting-login-tree-1000 step13 : Analyze graphs for spikes ________________________________________________________________________________ Analyze Gatling graphs for spikes checking parameters open overall stats JSON file checking simulation request restLoginInitiate [warn] responseTimePercentiles was not found in /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/07_Scenario_scenario/04_login-tree-1000/gatling/req_restlogininitia--1466099282.html - cannot check for spikes checking simulation request restLoginUsernamePasswordCallback [warn] responseTimePercentiles was not found in /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/07_Scenario_scenario/04_login-tree-1000/gatling/req_restloginuserna-1671926283.html - cannot check for spikes no spikes found ________________________________________________________________________________ [2025-03-16 01:26:32] Reporting-login-tree-1000 step14 : Collect Gatling simulation data ________________________________________________________________________________ collected stats : { "global": { "name": "All Requests", "numberOfRequests": { "total": 7170682, "ok": 7170647, "ko": 35 }, "minResponseTime": { "total": 36, "ok": 42, "ko": 36 }, "maxResponseTime": { "total": 60000, "ok": 27979, "ko": 60000 }, "meanResponseTime": { "total": 60, "ok": 60, "ko": 6141 }, "standardDeviation": { "total": 42, "ok": 25, "ko": 13920 }, "percentiles1": { "total": 57, "ok": 57, "ko": 205 }, "percentiles2": { "total": 66, "ok": 66, "ko": 10000 }, "percentiles3": { "total": 79, "ok": 79, "ko": 25015 }, "percentiles4": { "total": 116, "ok": 116, "ko": 60000 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 7170374, "percentage": 99.9957047321301 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 238, "percentage": 0.0033190706267548884 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 35, "percentage": 0.0004880986215816013 }, "group4": { "name": "failed", "htmlName": "failed", "count": 35, "percentage": 0.0004880986215816013 }, "meanNumberOfRequestsPerSecond": { "total": 1991.8561111111112, "ok": 1991.846388888889, "ko": 0.009722222222222222 } }, "details": [ { "name": "restLoginInitiate", "numberOfRequests": { "total": 3585381, "ok": 3585358, "ko": 23 }, "minResponseTime": { "total": 41, "ok": 42, "ko": 41 }, "maxResponseTime": { "total": 60000, "ok": 26573, "ko": 60000 }, "meanResponseTime": { "total": 50, "ok": 50, "ko": 6640 }, "standardDeviation": { "total": 41, "ok": 21, "ko": 12314 }, "percentiles1": { "total": 49, "ok": 49, "ko": 235 }, "percentiles2": { "total": 51, "ok": 51, "ko": 10000 }, "percentiles3": { "total": 54, "ok": 54, "ko": 10021 }, "percentiles4": { "total": 78, "ok": 78, "ko": 49005 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 3585167, "percentage": 99.99403131773164 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 163, "percentage": 0.004546239297859837 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 28, "percentage": 0.0007809490818409535 }, "group4": { "name": "failed", "htmlName": "failed", "count": 23, "percentage": 0.000641493888655069 }, "meanNumberOfRequestsPerSecond": { "total": 995.9391666666667, "ok": 995.9327777777778, "ko": 0.006388888888888889 }, "spikes": [] }, { "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "total": 3585301, "ok": 3585289, "ko": 12 }, "minResponseTime": { "total": 36, "ok": 50, "ko": 36 }, "maxResponseTime": { "total": 60000, "ok": 27979, "ko": 60000 }, "meanResponseTime": { "total": 70, "ok": 70, "ko": 5186 }, "standardDeviation": { "total": 40, "ok": 25, "ko": 16527 }, "percentiles1": { "total": 65, "ok": 65, "ko": 201 }, "percentiles2": { "total": 74, "ok": 74, "ko": 300 }, "percentiles3": { "total": 85, "ok": 85, "ko": 27193 }, "percentiles4": { "total": 146, "ok": 146, "ko": 53439 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 3585207, "percentage": 99.99737818386797 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 75, "percentage": 0.00209187457343191 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 7, "percentage": 0.00019524162685364492 }, "group4": { "name": "failed", "htmlName": "failed", "count": 12, "percentage": 0.0003346999317491056 }, "meanNumberOfRequestsPerSecond": { "total": 995.9169444444444, "ok": 995.9136111111111, "ko": 0.0033333333333333335 }, "spikes": [] } ] } { "concurrency": null, "generic_stats": { "avg_num_of_requests_per_second": 1992, "avg_response_time": 60, "max_response_time": 27979, "min_response_time": 42, "num_requests": 7170682, "num_requests_pass": 7170647, "num_requests_percent_pass": 100.0 }, "options": "; testCase:idc.login; throughput:1000; duration:3600; testMode:open", "stats": { "details": [ { "group1": { "count": 3585167, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 99.99403131773164 }, "group2": { "count": 163, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0.004546239297859837 }, "group3": { "count": 28, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 0.0007809490818409535 }, "group4": { "count": 23, "htmlName": "failed", "name": "failed", "percentage": 0.000641493888655069 }, "maxResponseTime": { "ko": 60000, "ok": 26573, "total": 60000 }, "meanNumberOfRequestsPerSecond": { "ko": 0.006388888888888889, "ok": 995.9327777777778, "total": 995.9391666666667 }, "meanResponseTime": { "ko": 6640, "ok": 50, "total": 50 }, "minResponseTime": { "ko": 41, "ok": 42, "total": 41 }, "name": "restLoginInitiate", "numberOfRequests": { "ko": 23, "ok": 3585358, "total": 3585381 }, "percentiles1": { "ko": 235, "ok": 49, "total": 49 }, "percentiles2": { "ko": 10000, "ok": 51, "total": 51 }, "percentiles3": { "ko": 10021, "ok": 54, "total": 54 }, "percentiles4": { "ko": 49005, "ok": 78, "total": 78 }, "spikes": [], "standardDeviation": { "ko": 12314, "ok": 21, "total": 41 } }, { "group1": { "count": 3585207, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 99.99737818386797 }, "group2": { "count": 75, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0.00209187457343191 }, "group3": { "count": 7, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 0.00019524162685364492 }, "group4": { "count": 12, "htmlName": "failed", "name": "failed", "percentage": 0.0003346999317491056 }, "maxResponseTime": { "ko": 60000, "ok": 27979, "total": 60000 }, "meanNumberOfRequestsPerSecond": { "ko": 0.0033333333333333335, "ok": 995.9136111111111, "total": 995.9169444444444 }, "meanResponseTime": { "ko": 5186, "ok": 70, "total": 70 }, "minResponseTime": { "ko": 36, "ok": 50, "total": 36 }, "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "ko": 12, "ok": 3585289, "total": 3585301 }, "percentiles1": { "ko": 201, "ok": 65, "total": 65 }, "percentiles2": { "ko": 300, "ok": 74, "total": 74 }, "percentiles3": { "ko": 27193, "ok": 85, "total": 85 }, "percentiles4": { "ko": 53439, "ok": 146, "total": 146 }, "spikes": [], "standardDeviation": { "ko": 16527, "ok": 25, "total": 40 } } ], "global": { "group1": { "count": 7170374, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 99.9957047321301 }, "group2": { "count": 238, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0.0033190706267548884 }, "group3": { "count": 35, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 0.0004880986215816013 }, "group4": { "count": 35, "htmlName": "failed", "name": "failed", "percentage": 0.0004880986215816013 }, "maxResponseTime": { "ko": 60000, "ok": 27979, "total": 60000 }, "meanNumberOfRequestsPerSecond": { "ko": 0.009722222222222222, "ok": 1991.846388888889, "total": 1991.8561111111112 }, "meanResponseTime": { "ko": 6141, "ok": 60, "total": 60 }, "minResponseTime": { "ko": 36, "ok": 42, "total": 36 }, "name": "All Requests", "numberOfRequests": { "ko": 35, "ok": 7170647, "total": 7170682 }, "percentiles1": { "ko": 205, "ok": 57, "total": 57 }, "percentiles2": { "ko": 10000, "ok": 66, "total": 66 }, "percentiles3": { "ko": 25015, "ok": 79, "total": 79 }, "percentiles4": { "ko": 60000, "ok": 116, "total": 116 }, "standardDeviation": { "ko": 13920, "ok": 25, "total": 42 } } }, "target_hostname": "openam-perf-200m.forgeblocks.com", "tool_name": "gatling" } ________________________________________________________________________________ [2025-03-16 01:26:32] Reporting-login-tree-1000 step15 : Update run description in the Gatling HTML report ________________________________________________________________________________ ________________________________________________________________________________ [2025-03-16 01:26:32] Reporting-login-tree-1000 step16 : Remove gatling task's stdout file ________________________________________________________________________________ Cleanup of Gatling stdout file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-1000/stdout.txt Gatling stdout.txt found, but is small - leave it intact. ________________________________________________________________________________ [2025-03-16 01:26:32] Reporting-login-tree-1000 post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped