--Task-- name: Logs-parse-query-10 enabled: True class_name: GatlingParseStdOutTask source_name: overseer-0 source_namespace: >default< target_name: overseer-0 target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: [] preceding_task: None options: {'task_name': 'query-10'} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock source (overseer-0) is a component 2025-03-28 19:56:41 - INFO: Timeout for this Task has changed to 10m (600 seconds) 2025-03-28 19:56:41 - INFO: timeout was set to GatlingParseStdOutTask default - 10 minutes ________________________________________________________________________________ [2025-03-28 19:56:41] Logs-parse-query-10 step1 : Write order for overseer to parse Gatling task stdout ________________________________________________________________________________ Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/08_Verification/02_Logs-parse-query-10/order.json { "name": "Logs-parse-query-10", "command": " /lodestar/pyrock/shared/scripts/logs_parser.py --non-interactive --input-file /results/orders/query-10/stdout.txt", "out-dir": "/results/orders/Logs-parse-query-10" } ________________________________________________________________________________ [2025-03-28 19:56:41] Logs-parse-query-10 step2 : Make sure overseer is ready to accept order (not already busy) ________________________________________________________________________________ 2025-03-28 19:56:41,683 INFO 2025-03-28 19:56:41,683 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-03-28 19:56:41,683 INFO [loop_until]: (max_time=120, interval=5, expected_rc=[0] 2025-03-28 19:56:41,899 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-28 19:56:41,899 INFO [loop_until]: OK (rc = 0) 2025-03-28 19:56:41,899 DEBUG --- stdout --- 2025-03-28 19:56:41,899 DEBUG WAITING 2025-03-28 19:56:41,899 DEBUG --- stderr --- 2025-03-28 19:56:41,899 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33 ________________________________________________________________________________ [2025-03-28 19:56:41] Logs-parse-query-10 step3 : Send order to overseer ________________________________________________________________________________ 2025-03-28 19:56:41,900 INFO 2025-03-28 19:56:41,900 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-28 19:56:41,900 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-28 19:56:42,177 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-28 19:56:42,177 INFO [loop_until]: OK (rc = 0) 2025-03-28 19:56:42,177 DEBUG --- stdout --- 2025-03-28 19:56:42,177 DEBUG overseer-0-59c948f569-rgrkv 2025-03-28 19:56:42,177 DEBUG --- stderr --- 2025-03-28 19:56:42,177 DEBUG 2025-03-28 19:56:42,178 INFO 2025-03-28 19:56:42,178 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/08_Verification/02_Logs-parse-query-10/order.json overseer-0-59c948f569-rgrkv:/results/orders/order.json 2025-03-28 19:56:42,178 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-28 19:56:43,540 INFO [loop_until]: OK (rc = 0) 2025-03-28 19:56:43,540 DEBUG --- stdout --- 2025-03-28 19:56:43,540 DEBUG 2025-03-28 19:56:43,540 DEBUG --- stderr --- 2025-03-28 19:56:43,540 DEBUG Order has been successfully forwarded to overseer ________________________________________________________________________________ [2025-03-28 19:56:43] Logs-parse-query-10 step4 : Wait order is done ________________________________________________________________________________ 2025-03-28 19:56:46,541 INFO 2025-03-28 19:56:46,541 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-03-28 19:56:46,541 INFO [loop_until]: (max_time=600, interval=5, expected_rc=[0] 2025-03-28 19:56:46,824 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-28 19:56:46,824 INFO [loop_until]: OK (rc = 0) 2025-03-28 19:56:46,824 DEBUG --- stdout --- 2025-03-28 19:56:46,824 DEBUG WAITING 2025-03-28 19:56:46,824 DEBUG --- stderr --- 2025-03-28 19:56:46,824 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 25 0 --:--:-- --:--:-- --:--:-- 25 ________________________________________________________________________________ [2025-03-28 19:56:46] Logs-parse-query-10 step5 : Get and log parsed logs ________________________________________________________________________________ Log parsing order succeeded, parsed log content: 2025-03-28 19:56:47,062 INFO 2025-03-28 19:56:47,062 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-28 19:56:47,062 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-28 19:56:47,416 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-28 19:56:47,416 INFO [loop_until]: OK (rc = 0) 2025-03-28 19:56:47,416 DEBUG --- stdout --- 2025-03-28 19:56:47,416 DEBUG overseer-0-59c948f569-rgrkv 2025-03-28 19:56:47,416 DEBUG --- stderr --- 2025-03-28 19:56:47,416 DEBUG Checking pod: overseer-0-59c948f569-rgrkv for file exists, if not wait. 2025-03-28 19:56:47,417 INFO 2025-03-28 19:56:47,417 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- bash -c 'if [ -f "/results/orders/query-10/stdout_parsed.txt" ]; then echo "/results/orders/query-10/stdout_parsed.txt file found"; exit 0; else echo "/results/orders/query-10/stdout_parsed.txt file not found"; exit 1; fi' | grep "/results/orders/query-10/stdout_parsed.txt file found" 2025-03-28 19:56:47,417 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-28 19:56:48,252 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-28 19:56:48,252 INFO [loop_until]: OK (rc = 0) 2025-03-28 19:56:48,252 DEBUG --- stdout --- 2025-03-28 19:56:48,252 DEBUG /results/orders/query-10/stdout_parsed.txt file found 2025-03-28 19:56:48,252 DEBUG --- stderr --- 2025-03-28 19:56:48,252 DEBUG 2025-03-28 19:56:48,252 INFO 2025-03-28 19:56:48,252 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- du -k /results/orders/query-10/stdout_parsed.txt 2025-03-28 19:56:49,055 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-03-28 19:56:49,055 DEBUG --- stdout --- 2025-03-28 19:56:49,055 DEBUG 4 /results/orders/query-10/stdout_parsed.txt 2025-03-28 19:56:49,055 DEBUG --- stderr --- 2025-03-28 19:56:49,055 DEBUG 2025-03-28 19:56:49,055 INFO - Download file (size 4k) source : /results/orders/query-10/stdout_parsed.txt @ overseer-0-59c948f569-rgrkv destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/01_query-10/stdout_parsed.txt 2025-03-28 19:56:49,056 INFO 2025-03-28 19:56:49,056 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-59c948f569-rgrkv:/results/orders/query-10/stdout_parsed.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/01_query-10/stdout_parsed.txt 2025-03-28 19:56:49,056 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-03-28 19:56:49,784 INFO [loop_until]: OK (rc = 0) 2025-03-28 19:56:49,784 DEBUG --- stdout --- 2025-03-28 19:56:49,784 DEBUG tar: Removing leading `/' from member names 2025-03-28 19:56:49,784 DEBUG --- stderr --- 2025-03-28 19:56:49,784 DEBUG 2025-03-28 19:56:49,784 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/01_query-10/stdout_parsed.txt is small (1 lines), printing all lines: 2025-03-28 19:56:49,784 INFO ----- output ----- No logged requests found. ________________________________________________________________________________ [2025-03-28 19:56:49] Logs-parse-query-10 post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped