--Task-- name: Reporting-login-tree-1200 enabled: True class_name: GatlingResultTask source_name: overseer-0 source_namespace: >default< target_name: overseer-0 target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: ['Logs-parse-login-tree-100', 'Logs-parse-login-tree-400', 'Logs-parse-login-tree-800', 'Logs-parse-login-tree-1000', 'Logs-parse-login-tree-1200', 'Logs-parse-login-tree-1400', 'Logs-parse-login-tree-1500', 'Reporting-login-tree-100', 'Reporting-login-tree-400', 'Reporting-login-tree-800', 'Reporting-login-tree-1000'] preceding_task: None options: {'task_name': 'login-tree-1200'} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock source (overseer-0) is a component 2025-03-16 01:26:32 - INFO: Timeout for this Task has changed to 3h 30m (12600 seconds) 2025-03-16 01:26:32 - INFO: timeout was set to GatlingResultTask default (half of global_duration or 3600 seconds (whatever is higher)), because it was unset Pod stdout file : /results/orders/Reporting-login-tree-1200/stdout.txt Pod stderr file : /results/orders/Reporting-login-tree-1200/stderr.txt Pod log : /results/orders/Reporting-login-tree-1200 ________________________________________________________________________________ [2025-03-16 01:26:32] Reporting-login-tree-1200 step1 : Write order for overseer to generate the report ________________________________________________________________________________ Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-1200/order.json { "name": "Reporting-login-tree-1200", "command": " /lodestar/lodestar.py perf run-gatling --reports-only=\"/results/gatling/login-tree-1200\" --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx8G\" --archive-name=\"login-tree-1200.tar.gz\"", "out-dir": "/results/orders/Reporting-login-tree-1200" } ________________________________________________________________________________ [2025-03-16 01:26:32] Reporting-login-tree-1200 step2 : Make sure overseer is ready to accept order (not already busy) ________________________________________________________________________________ 2025-03-16 01:26:32,246 INFO 2025-03-16 01:26:32,246 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-03-16 01:26:32,246 INFO [loop_until]: (max_time=120, interval=5, expected_rc=[0] 2025-03-16 01:26:32,458 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-16 01:26:32,458 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:26:32,458 DEBUG --- stdout --- 2025-03-16 01:26:32,458 DEBUG WAITING 2025-03-16 01:26:32,458 DEBUG --- stderr --- 2025-03-16 01:26:32,458 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 34 0 --:--:-- --:--:-- --:--:-- 34 ________________________________________________________________________________ [2025-03-16 01:26:32] Reporting-login-tree-1200 step3 : Send order to overseer ________________________________________________________________________________ 2025-03-16 01:26:32,459 INFO 2025-03-16 01:26:32,459 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-16 01:26:32,459 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-16 01:26:32,736 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-16 01:26:32,736 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:26:32,736 DEBUG --- stdout --- 2025-03-16 01:26:32,736 DEBUG overseer-0-59c948f569-rgrkv 2025-03-16 01:26:32,736 DEBUG --- stderr --- 2025-03-16 01:26:32,736 DEBUG 2025-03-16 01:26:32,737 INFO 2025-03-16 01:26:32,737 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-1200/order.json overseer-0-59c948f569-rgrkv:/results/orders/order.json 2025-03-16 01:26:32,737 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-16 01:26:34,070 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:26:34,071 DEBUG --- stdout --- 2025-03-16 01:26:34,071 DEBUG 2025-03-16 01:26:34,071 DEBUG --- stderr --- 2025-03-16 01:26:34,071 DEBUG Order has been successfully forwarded to overseer ________________________________________________________________________________ [2025-03-16 01:26:34] Reporting-login-tree-1200 step4 : Wait order is done ________________________________________________________________________________ Workaround for PERF-1966. Sleeping for 5 seconds. 2025-03-16 01:26:39,071 INFO 2025-03-16 01:26:39,071 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-03-16 01:26:39,071 INFO [loop_until]: (max_time=12600, interval=5, expected_rc=[0] 2025-03-16 01:26:39,283 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:26:44,496 INFO [loop_until]: Function succeeded after 5s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:26:49,707 INFO [loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:26:54,962 INFO [loop_until]: Function succeeded after 15s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:27:00,174 INFO [loop_until]: Function succeeded after 21s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:27:05,386 INFO [loop_until]: Function succeeded after 26s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:27:10,598 INFO [loop_until]: Function succeeded after 31s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:27:15,810 INFO [loop_until]: Function succeeded after 36s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:27:21,021 INFO [loop_until]: Function succeeded after 41s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:27:26,235 INFO [loop_until]: Function succeeded after 47s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:27:31,513 INFO [loop_until]: Function succeeded after 52s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:27:36,725 INFO [loop_until]: Function succeeded after 57s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:27:41,938 INFO [loop_until]: Function succeeded after 1m 02s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:27:47,149 INFO [loop_until]: Function succeeded after 1m 08s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:27:52,361 INFO [loop_until]: Function succeeded after 1m 13s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:27:57,573 INFO [loop_until]: Function succeeded after 1m 18s (rc=0) - failed to find expected output: WAITING - retry 2025-03-16 01:28:02,830 INFO [loop_until]: Function succeeded after 1m 23s (rc=0) - expected pattern found 2025-03-16 01:28:02,831 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:28:02,831 DEBUG --- stdout --- 2025-03-16 01:28:02,831 DEBUG WAITING 2025-03-16 01:28:02,831 DEBUG --- stderr --- 2025-03-16 01:28:02,831 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 28 0 --:--:-- --:--:-- --:--:-- 28 ________________________________________________________________________________ [2025-03-16 01:28:02] Reporting-login-tree-1200 step5 : Wait until gatling report is generated on overseer ________________________________________________________________________________ 2025-03-16 01:28:02,831 INFO 2025-03-16 01:28:02,831 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-16 01:28:02,831 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-16 01:28:03,107 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-16 01:28:03,107 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:28:03,107 DEBUG --- stdout --- 2025-03-16 01:28:03,107 DEBUG overseer-0-59c948f569-rgrkv 2025-03-16 01:28:03,108 DEBUG --- stderr --- 2025-03-16 01:28:03,108 DEBUG Checking pod: overseer-0-59c948f569-rgrkv for file exists, if not wait. 2025-03-16 01:28:03,109 INFO 2025-03-16 01:28:03,109 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- bash -c 'if [ -f "/results/gatling/login-tree-1200/login-tree-1200.tar.gz" ]; then echo "/results/gatling/login-tree-1200/login-tree-1200.tar.gz file found"; exit 0; else echo "/results/gatling/login-tree-1200/login-tree-1200.tar.gz file not found"; exit 1; fi' | grep "/results/gatling/login-tree-1200/login-tree-1200.tar.gz file found" 2025-03-16 01:28:03,109 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-16 01:28:03,903 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-16 01:28:03,903 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:28:03,903 DEBUG --- stdout --- 2025-03-16 01:28:03,903 DEBUG /results/gatling/login-tree-1200/login-tree-1200.tar.gz file found 2025-03-16 01:28:03,903 DEBUG --- stderr --- 2025-03-16 01:28:03,903 DEBUG 2025-03-16 01:28:03,903 INFO 2025-03-16 01:28:03,903 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- du -k /results/gatling/login-tree-1200/login-tree-1200.tar.gz 2025-03-16 01:28:04,686 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-03-16 01:28:04,686 DEBUG --- stdout --- 2025-03-16 01:28:04,686 DEBUG 252 /results/gatling/login-tree-1200/login-tree-1200.tar.gz 2025-03-16 01:28:04,686 DEBUG --- stderr --- 2025-03-16 01:28:04,686 DEBUG 2025-03-16 01:28:04,686 INFO - Download file (size 252k) source : /results/gatling/login-tree-1200/login-tree-1200.tar.gz @ overseer-0-59c948f569-rgrkv destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-1200.tar.gz 2025-03-16 01:28:04,687 INFO 2025-03-16 01:28:04,687 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-59c948f569-rgrkv:/results/gatling/login-tree-1200/login-tree-1200.tar.gz /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-1200.tar.gz 2025-03-16 01:28:04,687 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-03-16 01:28:05,668 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:28:05,668 DEBUG --- stdout --- 2025-03-16 01:28:05,668 DEBUG tar: Removing leading `/' from member names 2025-03-16 01:28:05,668 DEBUG --- stderr --- 2025-03-16 01:28:05,668 DEBUG ________________________________________________________________________________ [2025-03-16 01:28:05] Reporting-login-tree-1200 step6 : Unzip the result ________________________________________________________________________________ 2025-03-16 01:28:05,669 INFO 2025-03-16 01:28:05,669 INFO [run_command]: tar zxf /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-1200.tar.gz -C /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/07_Scenario_scenario/05_login-tree-1200/gatling 2025-03-16 01:28:05,682 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-03-16 01:28:05,682 DEBUG --- stdout --- 2025-03-16 01:28:05,682 DEBUG 2025-03-16 01:28:05,682 DEBUG --- stderr --- 2025-03-16 01:28:05,682 DEBUG 2025-03-16 01:28:05,682 INFO ________________________________________________________________________________ [2025-03-16 01:28:05] Reporting-login-tree-1200 step7 : Print rc order ________________________________________________________________________________ 2025-03-16 01:28:05,682 INFO 2025-03-16 01:28:05,682 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-16 01:28:05,683 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-16 01:28:05,958 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-16 01:28:05,958 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:28:05,958 DEBUG --- stdout --- 2025-03-16 01:28:05,958 DEBUG overseer-0-59c948f569-rgrkv 2025-03-16 01:28:05,958 DEBUG --- stderr --- 2025-03-16 01:28:05,958 DEBUG Checking pod: overseer-0-59c948f569-rgrkv for file exists, if not wait. 2025-03-16 01:28:05,959 INFO 2025-03-16 01:28:05,960 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-1200/rc.txt" ]; then echo "/results/orders/Reporting-login-tree-1200/rc.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-1200/rc.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-1200/rc.txt file found" 2025-03-16 01:28:05,960 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-16 01:28:06,743 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-16 01:28:06,743 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:28:06,743 DEBUG --- stdout --- 2025-03-16 01:28:06,743 DEBUG /results/orders/Reporting-login-tree-1200/rc.txt file found 2025-03-16 01:28:06,743 DEBUG --- stderr --- 2025-03-16 01:28:06,743 DEBUG 2025-03-16 01:28:06,743 INFO 2025-03-16 01:28:06,744 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- du -k /results/orders/Reporting-login-tree-1200/rc.txt 2025-03-16 01:28:07,533 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-03-16 01:28:07,533 DEBUG --- stdout --- 2025-03-16 01:28:07,533 DEBUG 4 /results/orders/Reporting-login-tree-1200/rc.txt 2025-03-16 01:28:07,533 DEBUG --- stderr --- 2025-03-16 01:28:07,534 DEBUG 2025-03-16 01:28:07,534 INFO - Download file (size 4k) source : /results/orders/Reporting-login-tree-1200/rc.txt @ overseer-0-59c948f569-rgrkv destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-1200/rc.txt 2025-03-16 01:28:07,534 INFO 2025-03-16 01:28:07,534 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-59c948f569-rgrkv:/results/orders/Reporting-login-tree-1200/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-1200/rc.txt 2025-03-16 01:28:07,534 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-03-16 01:28:08,249 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:28:08,249 DEBUG --- stdout --- 2025-03-16 01:28:08,249 DEBUG tar: Removing leading `/' from member names 2025-03-16 01:28:08,249 DEBUG --- stderr --- 2025-03-16 01:28:08,249 DEBUG 2025-03-16 01:28:08,249 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-1200/rc.txt is small (1 lines), printing all lines: 2025-03-16 01:28:08,249 INFO ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [2025-03-16 01:28:08] Reporting-login-tree-1200 step8 : Check rc log ________________________________________________________________________________ CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) PASS: no error found in rc log ________________________________________________________________________________ [2025-03-16 01:28:08] Reporting-login-tree-1200 step9 : Print stdout order ________________________________________________________________________________ 2025-03-16 01:28:08,484 INFO 2025-03-16 01:28:08,484 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-16 01:28:08,484 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-16 01:28:08,760 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-16 01:28:08,760 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:28:08,760 DEBUG --- stdout --- 2025-03-16 01:28:08,760 DEBUG overseer-0-59c948f569-rgrkv 2025-03-16 01:28:08,760 DEBUG --- stderr --- 2025-03-16 01:28:08,760 DEBUG Checking pod: overseer-0-59c948f569-rgrkv for file exists, if not wait. 2025-03-16 01:28:08,761 INFO 2025-03-16 01:28:08,761 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-1200/stdout.txt" ]; then echo "/results/orders/Reporting-login-tree-1200/stdout.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-1200/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-1200/stdout.txt file found" 2025-03-16 01:28:08,761 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-16 01:28:09,573 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-16 01:28:09,573 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:28:09,573 DEBUG --- stdout --- 2025-03-16 01:28:09,573 DEBUG /results/orders/Reporting-login-tree-1200/stdout.txt file found 2025-03-16 01:28:09,573 DEBUG --- stderr --- 2025-03-16 01:28:09,573 DEBUG 2025-03-16 01:28:09,573 INFO 2025-03-16 01:28:09,574 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- du -k /results/orders/Reporting-login-tree-1200/stdout.txt 2025-03-16 01:28:10,374 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-03-16 01:28:10,374 DEBUG --- stdout --- 2025-03-16 01:28:10,374 DEBUG 8 /results/orders/Reporting-login-tree-1200/stdout.txt 2025-03-16 01:28:10,375 DEBUG --- stderr --- 2025-03-16 01:28:10,375 DEBUG 2025-03-16 01:28:10,375 INFO - Download file (size 8k) source : /results/orders/Reporting-login-tree-1200/stdout.txt @ overseer-0-59c948f569-rgrkv destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-1200/stdout.txt 2025-03-16 01:28:10,376 INFO 2025-03-16 01:28:10,376 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-59c948f569-rgrkv:/results/orders/Reporting-login-tree-1200/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-1200/stdout.txt 2025-03-16 01:28:10,376 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-03-16 01:28:11,118 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:28:11,118 DEBUG --- stdout --- 2025-03-16 01:28:11,118 DEBUG tar: Removing leading `/' from member names 2025-03-16 01:28:11,118 DEBUG --- stderr --- 2025-03-16 01:28:11,118 DEBUG 2025-03-16 01:28:11,118 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-1200/stdout.txt is small (92 lines), printing all lines: 2025-03-16 01:28:11,118 INFO ----- output ----- 2025-03-16 01:26:35,086 INFO pom.xml copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpp760n_1f 2025-03-16 01:26:35,088 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.reportsOnly="/results/gatling/login-tree-1200/loadtest-20250315221939203" -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx8G" [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmpp760n_1f/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmpp760n_1f/src/test/resources [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compile in 0.0 s [INFO] No sources to compile [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 01:26:36,930 |-INFO in ch.qos.logback.classic.LoggerContext[default] - This is logback-classic version 1.5.8 01:26:36,931 |-INFO in ch.qos.logback.classic.util.ContextInitializer@12d3a4e9 - No custom configurators were discovered as a service. 01:26:36,932 |-INFO in ch.qos.logback.classic.util.ContextInitializer@12d3a4e9 - Trying to configure with ch.qos.logback.classic.joran.SerializedModelConfigurator 01:26:36,932 |-INFO in ch.qos.logback.classic.util.ContextInitializer@12d3a4e9 - Constructed configurator of type class ch.qos.logback.classic.joran.SerializedModelConfigurator 01:26:36,938 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.scmo] 01:26:36,939 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.scmo] 01:26:36,946 |-INFO in ch.qos.logback.classic.util.ContextInitializer@12d3a4e9 - ch.qos.logback.classic.joran.SerializedModelConfigurator.configure() call lasted 7 milliseconds. ExecutionStatus=INVOKE_NEXT_IF_ANY 01:26:36,946 |-INFO in ch.qos.logback.classic.util.ContextInitializer@12d3a4e9 - Trying to configure with ch.qos.logback.classic.util.DefaultJoranConfigurator 01:26:36,947 |-INFO in ch.qos.logback.classic.util.ContextInitializer@12d3a4e9 - Constructed configurator of type class ch.qos.logback.classic.util.DefaultJoranConfigurator 01:26:36,947 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml] 01:26:36,950 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [jar:file:/home/jenkins/.m2/repository/io/gatling/gatling-maven-plugin/4.9.6/gatling-maven-plugin-4.9.6.jar!/logback.xml] 01:26:36,954 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@240237d2 - URL [jar:file:/home/jenkins/.m2/repository/io/gatling/gatling-maven-plugin/4.9.6/gatling-maven-plugin-4.9.6.jar!/logback.xml] is not of type file 01:26:37,000 |-WARN in ch.qos.logback.classic.joran.action.LevelAction - element is deprecated. Near [level] on line 12 01:26:37,000 |-WARN in ch.qos.logback.classic.joran.action.LevelAction - Please use "level" attribute within or elements instead. 01:26:37,041 |-INFO in ch.qos.logback.core.model.processor.AppenderModelHandler - Processing appender named [CONSOLE] 01:26:37,041 |-INFO in ch.qos.logback.core.model.processor.AppenderModelHandler - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 01:26:37,048 |-INFO in ch.qos.logback.core.model.processor.ImplicitModelHandler - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property 01:26:37,069 |-INFO in ch.qos.logback.classic.model.processor.LevelModelHandler - ROOT level set to WARN 01:26:37,070 |-INFO in ch.qos.logback.core.model.processor.AppenderRefModelHandler - Attaching appender named [CONSOLE] to Logger[ROOT] 01:26:37,070 |-INFO in ch.qos.logback.core.model.processor.DefaultProcessor@25a65b77 - End of configuration. 01:26:37,071 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2ed0fbae - Registering current configuration as safe fallback point 01:26:37,071 |-INFO in ch.qos.logback.classic.util.ContextInitializer@12d3a4e9 - ch.qos.logback.classic.util.DefaultJoranConfigurator.configure() call lasted 124 milliseconds. ExecutionStatus=DO_NOT_INVOKE_NEXT_IF_ANY Parsing log file(s)... Parsing log file(s) done in 82s. Generating reports... ================================================================================ ---- Global Information -------------------------------------------------------- > request count 8610016 (OK=8610011 KO=5 ) > min response time 4 (OK=42 KO=4 ) > max response time 10001 (OK=7191 KO=10001 ) > mean response time 61 (OK=61 KO=2025 ) > std deviation 21 (OK=21 KO=3988 ) > response time 50th percentile 58 (OK=58 KO=39 ) > response time 75th percentile 67 (OK=67 KO=41 ) > response time 95th percentile 83 (OK=83 KO=8009 ) > response time 99th percentile 143 (OK=143 KO=9603 ) > mean requests/sec 2391.67 (OK=2391.67 KO=0 ) ---- Response Time Distribution ------------------------------------------------ > t < 800 ms 8609850 ( 100%) > 800 ms <= t < 1200 ms 128 ( 0%) > t >= 1200 ms 33 ( 0%) > failed 5 ( 0%) ---- Errors -------------------------------------------------------------------- > status.find.is(200), but actually found 502 3 (60.00%) > i.n.h.s.SslHandshakeTimeoutException: handshake timed out afte 1 (20.00%) r 10000ms > j.i.IOException: Premature close 1 (20.00%) ================================================================================ Reports generated, please open the following file: file:///results/gatling/login-tree-1200/loadtest-20250315221939203/index.html [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 01:24 min [INFO] Finished at: 2025-03-16T01:28:00Z [INFO] ------------------------------------------------------------------------ 2025-03-16 01:28:00,892 INFO Gatling simulation run ended successfully 2025-03-16 01:28:00,893 INFO Creating archive login-tree-1200.tar.gz with report files 2025-03-16 01:28:00,978 INFO Archive /results/gatling/login-tree-1200/login-tree-1200.tar.gz successfully created ________________________________________________________________________________ [2025-03-16 01:28:11] Reporting-login-tree-1200 step10 : Check stdout log and parse its content ________________________________________________________________________________ PASS: no error found in stdout log ________________________________________________________________________________ [2025-03-16 01:28:11] Reporting-login-tree-1200 step11 : Print stderr order ________________________________________________________________________________ 2025-03-16 01:28:11,119 INFO 2025-03-16 01:28:11,119 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-16 01:28:11,119 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-16 01:28:11,409 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-16 01:28:11,409 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:28:11,409 DEBUG --- stdout --- 2025-03-16 01:28:11,409 DEBUG overseer-0-59c948f569-rgrkv 2025-03-16 01:28:11,409 DEBUG --- stderr --- 2025-03-16 01:28:11,409 DEBUG Checking pod: overseer-0-59c948f569-rgrkv for file exists, if not wait. 2025-03-16 01:28:11,410 INFO 2025-03-16 01:28:11,410 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-1200/stderr.txt" ]; then echo "/results/orders/Reporting-login-tree-1200/stderr.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-1200/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-1200/stderr.txt file found" 2025-03-16 01:28:11,410 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-16 01:28:12,200 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-16 01:28:12,200 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:28:12,200 DEBUG --- stdout --- 2025-03-16 01:28:12,200 DEBUG /results/orders/Reporting-login-tree-1200/stderr.txt file found 2025-03-16 01:28:12,200 DEBUG --- stderr --- 2025-03-16 01:28:12,200 DEBUG 2025-03-16 01:28:12,200 INFO 2025-03-16 01:28:12,200 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- du -k /results/orders/Reporting-login-tree-1200/stderr.txt 2025-03-16 01:28:12,989 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-03-16 01:28:12,989 DEBUG --- stdout --- 2025-03-16 01:28:12,989 DEBUG 0 /results/orders/Reporting-login-tree-1200/stderr.txt 2025-03-16 01:28:12,989 DEBUG --- stderr --- 2025-03-16 01:28:12,989 DEBUG 2025-03-16 01:28:12,989 INFO - Download file (size 0k) source : /results/orders/Reporting-login-tree-1200/stderr.txt @ overseer-0-59c948f569-rgrkv destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-1200/stderr.txt 2025-03-16 01:28:12,990 INFO 2025-03-16 01:28:12,990 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-59c948f569-rgrkv:/results/orders/Reporting-login-tree-1200/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-1200/stderr.txt 2025-03-16 01:28:12,990 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-03-16 01:28:13,791 INFO [loop_until]: OK (rc = 0) 2025-03-16 01:28:13,791 DEBUG --- stdout --- 2025-03-16 01:28:13,791 DEBUG tar: Removing leading `/' from member names 2025-03-16 01:28:13,791 DEBUG --- stderr --- 2025-03-16 01:28:13,791 DEBUG 2025-03-16 01:28:13,791 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-1200/stderr.txt is small (0 lines), printing all lines: 2025-03-16 01:28:13,791 INFO ----- output ----- ________________________________________________________________________________ [2025-03-16 01:28:13] Reporting-login-tree-1200 step12 : Check stderr log ________________________________________________________________________________ PASS: no error found in stderr log ________________________________________________________________________________ [2025-03-16 01:28:13] Reporting-login-tree-1200 step13 : Analyze graphs for spikes ________________________________________________________________________________ Analyze Gatling graphs for spikes checking parameters open overall stats JSON file checking simulation request restLoginInitiate [warn] responseTimePercentiles was not found in /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/07_Scenario_scenario/05_login-tree-1200/gatling/req_restlogininitia--1466099282.html - cannot check for spikes checking simulation request restLoginUsernamePasswordCallback [warn] responseTimePercentiles was not found in /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/07_Scenario_scenario/05_login-tree-1200/gatling/req_restloginuserna-1671926283.html - cannot check for spikes no spikes found ________________________________________________________________________________ [2025-03-16 01:28:13] Reporting-login-tree-1200 step14 : Collect Gatling simulation data ________________________________________________________________________________ collected stats : { "global": { "name": "All Requests", "numberOfRequests": { "total": 8610016, "ok": 8610011, "ko": 5 }, "minResponseTime": { "total": 4, "ok": 42, "ko": 4 }, "maxResponseTime": { "total": 10001, "ok": 7191, "ko": 10001 }, "meanResponseTime": { "total": 61, "ok": 61, "ko": 2025 }, "standardDeviation": { "total": 21, "ok": 21, "ko": 3988 }, "percentiles1": { "total": 58, "ok": 58, "ko": 39 }, "percentiles2": { "total": 67, "ok": 67, "ko": 41 }, "percentiles3": { "total": 83, "ok": 83, "ko": 8009 }, "percentiles4": { "total": 143, "ok": 143, "ko": 9603 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 8609850, "percentage": 99.9980720128743 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 128, "percentage": 0.0014866406752321946 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 33, "percentage": 0.0003832745490833002 }, "group4": { "name": "failed", "htmlName": "failed", "count": 5, "percentage": 5.807190137625761e-05 }, "meanNumberOfRequestsPerSecond": { "total": 2391.6711111111113, "ok": 2391.6697222222224, "ko": 0.001388888888888889 } }, "details": [ { "name": "restLoginInitiate", "numberOfRequests": { "total": 4305052, "ok": 4305050, "ko": 2 }, "minResponseTime": { "total": 16, "ok": 42, "ko": 4 }, "maxResponseTime": { "total": 10001, "ok": 7191, "ko": 10001 }, "meanResponseTime": { "total": 51, "ok": 51, "ko": 5003 }, "standardDeviation": { "total": 15, "ok": 14, "ko": 4999 }, "percentiles1": { "total": 50, "ok": 50, "ko": 5003 }, "percentiles2": { "total": 52, "ok": 52, "ko": 7502 }, "percentiles3": { "total": 56, "ok": 56, "ko": 9501 }, "percentiles4": { "total": 88, "ok": 88, "ko": 9901 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 4304902, "percentage": 99.99651572152904 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 123, "percentage": 0.0028571083461941924 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 25, "percentage": 0.0005807130784947545 }, "group4": { "name": "failed", "htmlName": "failed", "count": 2, "percentage": 4.645704627958036e-05 }, "meanNumberOfRequestsPerSecond": { "total": 1195.8477777777778, "ok": 1195.8472222222222, "ko": 0.0005555555555555556 }, "spikes": [] }, { "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "total": 4304964, "ok": 4304961, "ko": 3 }, "minResponseTime": { "total": 39, "ok": 50, "ko": 39 }, "maxResponseTime": { "total": 6465, "ok": 6465, "ko": 41 }, "meanResponseTime": { "total": 71, "ok": 71, "ko": 40 }, "standardDeviation": { "total": 22, "ok": 22, "ko": 1 }, "percentiles1": { "total": 66, "ok": 66, "ko": 39 }, "percentiles2": { "total": 74, "ok": 74, "ko": 40 }, "percentiles3": { "total": 99, "ok": 99, "ko": 41 }, "percentiles4": { "total": 172, "ok": 172, "ko": 41 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 4304948, "percentage": 99.99962833603254 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 5, "percentage": 0.0001161449898303447 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 8, "percentage": 0.00018583198372855152 }, "group4": { "name": "failed", "htmlName": "failed", "count": 3, "percentage": 6.968699389820682e-05 }, "meanNumberOfRequestsPerSecond": { "total": 1195.8233333333333, "ok": 1195.8225, "ko": 0.0008333333333333334 }, "spikes": [] } ] } { "concurrency": null, "generic_stats": { "avg_num_of_requests_per_second": 2392, "avg_response_time": 61, "max_response_time": 7191, "min_response_time": 42, "num_requests": 8610016, "num_requests_pass": 8610011, "num_requests_percent_pass": 100.0 }, "options": "; testCase:idc.login; throughput:1200; duration:3600; testMode:open", "stats": { "details": [ { "group1": { "count": 4304902, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 99.99651572152904 }, "group2": { "count": 123, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0.0028571083461941924 }, "group3": { "count": 25, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 0.0005807130784947545 }, "group4": { "count": 2, "htmlName": "failed", "name": "failed", "percentage": 4.645704627958036e-05 }, "maxResponseTime": { "ko": 10001, "ok": 7191, "total": 10001 }, "meanNumberOfRequestsPerSecond": { "ko": 0.0005555555555555556, "ok": 1195.8472222222222, "total": 1195.8477777777778 }, "meanResponseTime": { "ko": 5003, "ok": 51, "total": 51 }, "minResponseTime": { "ko": 4, "ok": 42, "total": 16 }, "name": "restLoginInitiate", "numberOfRequests": { "ko": 2, "ok": 4305050, "total": 4305052 }, "percentiles1": { "ko": 5003, "ok": 50, "total": 50 }, "percentiles2": { "ko": 7502, "ok": 52, "total": 52 }, "percentiles3": { "ko": 9501, "ok": 56, "total": 56 }, "percentiles4": { "ko": 9901, "ok": 88, "total": 88 }, "spikes": [], "standardDeviation": { "ko": 4999, "ok": 14, "total": 15 } }, { "group1": { "count": 4304948, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 99.99962833603254 }, "group2": { "count": 5, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0.0001161449898303447 }, "group3": { "count": 8, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 0.00018583198372855152 }, "group4": { "count": 3, "htmlName": "failed", "name": "failed", "percentage": 6.968699389820682e-05 }, "maxResponseTime": { "ko": 41, "ok": 6465, "total": 6465 }, "meanNumberOfRequestsPerSecond": { "ko": 0.0008333333333333334, "ok": 1195.8225, "total": 1195.8233333333333 }, "meanResponseTime": { "ko": 40, "ok": 71, "total": 71 }, "minResponseTime": { "ko": 39, "ok": 50, "total": 39 }, "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "ko": 3, "ok": 4304961, "total": 4304964 }, "percentiles1": { "ko": 39, "ok": 66, "total": 66 }, "percentiles2": { "ko": 40, "ok": 74, "total": 74 }, "percentiles3": { "ko": 41, "ok": 99, "total": 99 }, "percentiles4": { "ko": 41, "ok": 172, "total": 172 }, "spikes": [], "standardDeviation": { "ko": 1, "ok": 22, "total": 22 } } ], "global": { "group1": { "count": 8609850, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 99.9980720128743 }, "group2": { "count": 128, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0.0014866406752321946 }, "group3": { "count": 33, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 0.0003832745490833002 }, "group4": { "count": 5, "htmlName": "failed", "name": "failed", "percentage": 5.807190137625761e-05 }, "maxResponseTime": { "ko": 10001, "ok": 7191, "total": 10001 }, "meanNumberOfRequestsPerSecond": { "ko": 0.001388888888888889, "ok": 2391.6697222222224, "total": 2391.6711111111113 }, "meanResponseTime": { "ko": 2025, "ok": 61, "total": 61 }, "minResponseTime": { "ko": 4, "ok": 42, "total": 4 }, "name": "All Requests", "numberOfRequests": { "ko": 5, "ok": 8610011, "total": 8610016 }, "percentiles1": { "ko": 39, "ok": 58, "total": 58 }, "percentiles2": { "ko": 41, "ok": 67, "total": 67 }, "percentiles3": { "ko": 8009, "ok": 83, "total": 83 }, "percentiles4": { "ko": 9603, "ok": 143, "total": 143 }, "standardDeviation": { "ko": 3988, "ok": 21, "total": 21 } } }, "target_hostname": "openam-perf-200m.forgeblocks.com", "tool_name": "gatling" } ________________________________________________________________________________ [2025-03-16 01:28:13] Reporting-login-tree-1200 step15 : Update run description in the Gatling HTML report ________________________________________________________________________________ ________________________________________________________________________________ [2025-03-16 01:28:13] Reporting-login-tree-1200 step16 : Remove gatling task's stdout file ________________________________________________________________________________ Cleanup of Gatling stdout file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-1200/stdout.txt Gatling stdout.txt found, but is small - leave it intact. ________________________________________________________________________________ [2025-03-16 01:28:13] Reporting-login-tree-1200 post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped