--Task-- name: authn-users-1500 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 80 stop: 100 timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: [] options: {'simulation': 'com.forgerock.gatling.Loadtest', 'testCase': 'idc.login', 'testMode': 'open', 'throughput': 1500, 'rampup-duration': 30, 'java-opts': '-Dnum_users=200000 -Drealm=alpha -Duser_password=T35tr0ck123*'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [27/Sep/2022 23:45:40] authn-users-1500 pre : N/A ________________________________________________________________________________ [27/Sep/2022 23:45:40] - INFO: setting default timeout for task - 2x global_duration or 300 seconds (whatever is higher): [27/Sep/2022 23:45:40] - INFO: Timeout for this Task has changed to 10h (36000 seconds) Pod log file : /results/orders/authn-users-1500/stdout.txt Pod log : /results/orders/authn-users-1500 ________________________________________________________________________________ [27/Sep/2022 23:45:40] authn-users-1500 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ /lodestar/clients/gatling-for-pyrock.sh -s com.forgerock.gatling.Loadtest -sf /lodestar/pyrock/shared/clients/gatling-open/ -rd com.forgerock.gatling.Loadtest@IDC -rf /results/gatling/authn-users-1500 --no-reports ________________________________________________________________________________ [27/Sep/2022 23:45:40] authn-users-1500 create_order : Create order for overseer with the command to run ________________________________________________________________________________ Userpool size is not defined for the task in conf.yaml and cannot find how many users (entries) are in id-repo, please check the conf.yaml file. Default for selected Gatling simulation will be used. [27/Sep/2022 23:45:40] - INFO: Get overseer pod resources requests memory [loop_until]: kubectl --namespace=xlou get pods overseer-0-c7fc5cc47-x4c97 -o jsonpath={.spec.containers[].resources.requests.memory} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 4Gi --- stderr --- Order file : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/05_authn-users-1500/order.json { "name": "authn-users-1500", "command": "/lodestar/clients/gatling-for-pyrock.sh -s com.forgerock.gatling.Loadtest -sf /lodestar/pyrock/shared/clients/gatling-open/ -rd com.forgerock.gatling.Loadtest@IDC -rf /results/gatling/authn-users-1500 --no-reports", "out-dir": "/results/orders/authn-users-1500", "environment": { "JAVA_OPTS": "-Dam_host=openam-perf-100m-testing.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@forgerock.com -Didc=true -Dnum_users=200000 -Doauth2_client_id=idmAdminClient -Doauth2_redirect_uri=/platform/appAuthHelperRedirect.html -Drampup_duration=30 -Drealm=alpha -DtestCase=idc.login -DtestMode=open -Dthroughput=1500 -Duser_password=T35tr0ck123* -Xmx4G -Dduration=39960" } } ________________________________________________________________________________ [27/Sep/2022 23:45:40] authn-users-1500 loop_until_ready : Loop until overseer pod is ready to accept order ________________________________________________________________________________ [loop_until]: curl -k https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 5s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 15s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33 ________________________________________________________________________________ [27/Sep/2022 23:45:56] authn-users-1500 start_order : Send the order to the overseer pod ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/05_authn-users-1500/order.json overseer-0-c7fc5cc47-x4c97:/results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order has been successfully forwarded to overseer [27/Sep/2022 23:45:58] - INFO: Check if Gatling simulation started successfully [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -- head /results/orders/authn-users-1500/stdout.txt | grep "started..." [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: started... - retry [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: started... - retry [loop_until]: Function succeeded after 12s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling Simulation com.forgerock.gatling.Loadtest started... --- stderr --- Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. ________________________________________________________________________________ [28/Sep/2022 00:45:45] authn-users-1500 stop_order : Stop the order on overseer pod ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -- rm -f /results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order ran during 59m 47s ________________________________________________________________________________ [28/Sep/2022 00:45:46] authn-users-1500 download_logs : Download order.tar.gz ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- Checking pod: overseer-0-c7fc5cc47-x4c97 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -i -- bash -c 'if [ -f "/results/orders/authn-users-1500/order.tar.gz" ]; then echo "/results/orders/authn-users-1500/order.tar.gz file found"; exit 0; else echo "/results/orders/authn-users-1500/order.tar.gz file not found"; exit 1; fi' | grep "/results/orders/authn-users-1500/order.tar.gz file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function failed after 0s (rc=1 - expected to be in [0]) - retry [loop_until]: Function failed after 6s (rc=1 - expected to be in [0]) - retry [loop_until]: Function failed after 12s (rc=1 - expected to be in [0]) - retry [loop_until]: Function failed after 18s (rc=1 - expected to be in [0]) - retry [loop_until]: Function failed after 24s (rc=1 - expected to be in [0]) - retry [loop_until]: Function failed after 30s (rc=1 - expected to be in [0]) - retry [loop_until]: Function failed after 36s (rc=1 - expected to be in [0]) - retry [loop_until]: Function failed after 42s (rc=1 - expected to be in [0]) - retry [loop_until]: Function failed after 48s (rc=1 - expected to be in [0]) - retry [loop_until]: Function failed after 54s (rc=1 - expected to be in [0]) - retry [loop_until]: Function failed after 1m (rc=1 - expected to be in [0]) - retry [loop_until]: Function failed after 1m 05s (rc=1 - expected to be in [0]) - retry [loop_until]: Function failed after 1m 11s (rc=1 - expected to be in [0]) - retry [loop_until]: Function failed after 1m 17s (rc=1 - expected to be in [0]) - retry [loop_until]: Function failed after 1m 23s (rc=1 - expected to be in [0]) - retry [loop_until]: Function failed after 1m 29s (rc=1 - expected to be in [0]) - retry [loop_until]: Function succeeded after 1m 34s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/authn-users-1500/order.tar.gz file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [run_command]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -i -- du -k /results/orders/authn-users-1500/order.tar.gz [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 907716 /results/orders/authn-users-1500/order.tar.gz --- stderr --- - Download file (size 907716k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- source : /results/orders/authn-users-1500/order.tar.gz @ overseer-0-c7fc5cc47-x4c97 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/05_authn-users-1500/order.tar.gz [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou cp overseer-0-c7fc5cc47-x4c97:/results/orders/authn-users-1500/order.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/05_authn-users-1500/order.tar.gz [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- - Extract archive zip file : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/05_authn-users-1500/order.tar.gz destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/05_authn-users-1500 ________________________________________________________________________________ [28/Sep/2022 00:48:07] authn-users-1500 show_cmd : Display order command ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/05_authn-users-1500/cmd.txt is small (1 lines), printing all lines: ----- output ----- /lodestar/clients/gatling-for-pyrock.sh -s com.forgerock.gatling.Loadtest -sf /lodestar/pyrock/shared/clients/gatling-open/ -rd com.forgerock.gatling.Loadtest@IDC -rf /results/gatling/authn-users-1500 --no-reports ________________________________________________________________________________ [28/Sep/2022 00:48:07] authn-users-1500 show_rc : Display rc order ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/05_authn-users-1500/rc.txt is small (1 lines), printing all lines: ----- output ----- CMD SUCCESS: command returns code -9 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [28/Sep/2022 00:48:07] authn-users-1500 show_stdout : Display stdout order ________________________________________________________________________________ [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/05_authn-users-1500/stdout.txt is 53275472 lines): ----- output ----- GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling Simulation com.forgerock.gatling.Loadtest started... ================================================================================ 2022-09-28 00:46:15 5s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=1226 KO=0 ) > restLoginInitiate (OK=616 KO=0 ) > restLoginUsernamePasswordCallback (OK=610 KO=0 ) ---- idc.login ----------------------------------------------------------------- [- ] 0% waiting: 59963977 / active: 11 / done: 610 ================================================================================ 00:46:16.861 [INFO ] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginUsernamePasswordCallback' failed for user 855: status.find.is(200), but actually found 401 00:46:16.871 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: restLoginUsernamePasswordCallback: KO status.find.is(200), but actually found 401 ========================= Session: Session(idc.login,855,1664322376808,Map(gatling.http.cache.baseUrl -> https://openam-perf-100m-testing.forgeblocks.com:443, gatling.http.cache.dns -> io.gatling.http.cache.DnsCacheSupport$$anon$1@468cbc1f, username -> user.855, gatling.http.ssl.sslContexts -> SslContexts(io.netty.handler.ssl.ReferenceCountedOpenSslClientContext@5e5211b,None), callbacks -> {"code":401,"reason":"Unauthorized","message":"Login failure"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-100m-testing.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-100m-testing.forgeblocks.com, path=/, secure, HTTPOnly,false,false,1664322376830))), password -> T35tr0ck123*),1,KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$788/0x0000000800846840@37d06bbb) ========================= HTTP request: POST https://openam-perf-100m-testing.forgeblocks.com/am/json/realms/alpha/authenticate?authIndexType=service&authIndexValue=SimpleLogin headers= Accept-API-Version: resource=2.0, protocol=1.0 Accept: application/json cookie: amlbcookie=01 host: openam-perf-100m-testing.forgeblocks.com content-type: application/json content-length: 2190 cookies= amlbcookie=01, domain=openam-perf-100m-testing.forgeblocks.com, path=/, secure, HTTPOnly byteArraysBody={"authId":"eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJhdXRoSW5kZXhWYWx1ZSI6IlNpbXBsZUxvZ2luIiwib3RrIjoiYWZsMmoyYXZpaXJmdGY4dWloNnIzb2lhc2wiLCJhdXRoSW5kZXhUeXBlIjoic2VydmljZSIsInJlYWxtIjoiL2FscGhhIiwic2Vzc2lvbklkIjoiKkFBSlRTUUFDTURJQUJIUjVjR1VBQ0VwWFZGOUJWVlJJQUFKVE1RQUNNREUuKmV5SjBlWEFpT2lKS1YxUWlMQ0pqZEhraU9pSktWMVFpTENKaGJHY2lPaUpJVXpJMU5pSjkuWlhsS01HVllRV2xQYVVwTFZqRlJhVXhEU214aWJVMXBUMmxLUWsxVVNUUlJNRXBFVEZWb1ZFMXFWVEpKYVhkcFdWZDRia2xxYjJsYVIyeDVTVzR3TGk1R1RsOHpSVmRxV1VablpsUk5Za3QwZG5sSlRIcFJMbnBTVTBwYVZIUjBVbTF6UzNoaU5tVXpYME5HYW5KeWRXcElaVE5zYUZCR1NFMVdkWFpxYkd0M1ZWSk9WbTVQV201U2RtTm9ZMHBVV0RCVGEwOVNTRzF1YjFwSGFHVTFjakZFU2tSeFlYRmxUMEZCVjI5dVQzWjJNMVZKY0doblFpMVVaMmxyVm1VMmJVdE1URTVwYlRWQlpEZFRjRUpPWm1OZk9IVk9iRUkzYUU5dFRrSTRPR3N3V0hJdE9HUk5YMVZrTVdSRldEbHVWMVpDWkVKYVF6TmpaMDV4Y1RWV2NUUnVNM05wYTBJemJXZ3lNa1phZWtJdFYwTk9hRmt6ZUhOVlYzSnNVVlE0Tkhabk1tSnBlVkJNYURJM1ZISkNPRVZmV1RWa1ZqQkJXbU5rVldrM1JuRmtlbmh4VW5adlVsWk1NM3BhZFRWQlJGVm9NbmxzZUc0MlIyZHJTelZpWVZaRk5GQjZRakpIVEdoWFNuWllZMVJxTW5kS2FsZDBNMUUwVFZkTU5rVktYMTlaYmxnMmExQTVjazV2TURaMFlrWXdjVFprUVU5ZmNFSlZlVVp4Wm1KcFdXbFBhV3MwYVhOdVJtaGxSSEE1Y0ZRMmVsZHdOMDF3VmxocmVEVjZjRnBSV2pKb1QxRTFUMFZ4WDFGaVl6aHRiRlZ3YUU5V2RVbGhSRnBKZGxkSk9VVXplbEp0ZEZSRlNYRk5lVTQzWm5ocldGVjRlbXgzTUVReWJIVkVhRVpwUWtveFlteHBZbTlLVWxOblV6ZHpWbFJ5UVZaSFNUaElNRWRrYTJaNFNXWjJSVEZ0VG5JM01VdDNUbGN5YmxZNGNtOVJUMU0zYTBsNGFtWXhkSGxEVlV0dmEzTk1lalozUldGMFpXaE5RVXB0TWtOUE5IRnlUMjlYYkVRMVNXZDJhR1p1VVhSUVRVcHBlbE5DYjNOc2NVOWZUa2t0VFdWRFUxUXdhV1IxTmtWSWRFeG9Va1JYVWpSbFdWRmxWMFZDU1U5S1REZDNYM1pzV0dwSFZ6QnZTSEphUjFSU2FWQlhkbEpYTkZGa2RpMURlV3Q2Yms1d1NuQnBWVEpCU0hsTmFrdG9TaTFDVlZreldWSk9iblJFVUVWeldHUnhZMjlHYjB4M1ZuUnpTVUYxTkd4M2JXVkZORXRHU21OaVpuSnhXV042Um1GemRtUnFjVTlTYkRKb2JrNU5Ma2Q2Y1hGdWJUVTNYMnBIWHpoVk1pMUJNRzlpUWtFLi1heWd3c19VTFU5N3NRcjUxVmF5eEJXQmotbUZ0alZ1RW1TUHJmY3p6dWsiLCJleHAiOjE2NjQzMjI2NzYsImlhdCI6MTY2NDMyMjM3Nn0.Poy5iEqjOLgs_QM8LiPfrGfqtA8rYYITxnzmn2fNklU","callbacks":[{"type":"NameCallback","output":[{"name":"prompt","value":"User Name"}],"input":[{"name":"IDToken1","value":"user.855"}],"_id":0},{"type":"PasswordCallback","output":[{"name":"prompt","value":"Password"}],"input":[{"name":"IDToken2","value":"T35tr0ck123*"}],"_id":1}]} ========================= HTTP response: status= 401 headers= x-frame-options: SAMEORIGIN x-content-type-options: nosniff cache-control: private content-api-version: resource=2.1 expires: 0 pragma: no-cache content-type: application/json content-length: 62 date: Tue, 27 Sep 2022 23:46:16 GMT x-forgerock-transactionid: 1664322349003-5ce4211d8c2004f69d84-6327530 strict-transport-security: max-age=31536000; includeSubDomains; preload; Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 body= {"code":401,"reason":"Unauthorized","message":"Login failure"} <<<<<<<<<<<<<<<<<<<<<<<<< 00:46:16.877 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-3' crashed with 'j.u.NoSuchElementException: key not found: callbacks', forwarding to the next one 00:46:16.896 [INFO ] i.g.h.e.r.DefaultStatsProcessor - Request 'restloginProgressiveProfileCallback' failed for user 855: jsonPath($.tokenId).find.exists, found nothing 00:46:16.897 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: restloginProgressiveProfileCallback: KO jsonPath($.tokenId).find.exists, found nothing ========================= Session: Session(idc.login,855,1664322376808,Map(gatling.http.cache.baseUrl -> https://openam-perf-100m-testing.forgeblocks.com:443, gatling.http.cache.dns -> io.gatling.http.cache.DnsCacheSupport$$anon$1@468cbc1f, username -> user.855, gatling.http.ssl.sslContexts -> SslContexts(io.netty.handler.ssl.ReferenceCountedOpenSslClientContext@5e5211b,None), callbacks -> {"code":401,"reason":"Unauthorized","message":"Login failure"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-100m-testing.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-100m-testing.forgeblocks.com, path=/, secure, HTTPOnly,false,false,1664322376896))), password -> T35tr0ck123*),15,KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$788/0x0000000800846840@37d06bbb) ========================= HTTP request: POST https://openam-perf-100m-testing.forgeblocks.com/am/json/realms/alpha/authenticate?authIndexType=service&authIndexValue=SimpleLogin headers= Accept-API-Version: protocol=2.1,resource=1.0 Accept: application/json cookie: amlbcookie=01 host: openam-perf-100m-testing.forgeblocks.com content-type: application/json content-length: 62 cookies= amlbcookie=01, domain=openam-perf-100m-testing.forgeblocks.com, path=/, secure, HTTPOnly byteArraysBody={"code":401,"reason":"Unauthorized","message":"Login failure"} ========================= HTTP response: status= 200 headers= x-frame-options: SAMEORIGIN x-content-type-options: nosniff cache-control: private content-api-version: resource=1.2 expires: 0 pragma: no-cache set-cookie: amlbcookie=01; Path=/; Domain=openam-perf-100m-testing.forgeblocks.com; Secure; HttpOnly; SameSite=none content-type: application/json content-length: 2170 date: Tue, 27 Sep 2022 23:46:16 GMT x-forgerock-transactionid: 1664322375524-5ce4211d8c2004f69d84-6327541 strict-transport-security: max-age=31536000; includeSubDomains; preload; Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 [...] <<<<<<<<<<<<<<<<<<<<<<<<< 01:45:48.336 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-3' crashed with 'j.u.NoSuchElementException: key not found: callbacks', forwarding to the next one 01:45:48.479 [INFO ] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 5253548: i.g.h.c.i.RequestTimeoutException: Request timeout to openam-perf-100m-testing.forgeblocks.com/34.111.179.107:443 after 60000 ms 01:45:48.479 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: restLoginInitiate: KO i.g.h.c.i.RequestTimeoutException: Request timeout to openam-perf-100m-testing.forgeblocks.com/34.111.179.107:443 after 60000 ms ========================= Session: Session(idc.login,5253548,1664325888478,Map(gatling.http.cache.baseUrl -> https://openam-perf-100m-testing.forgeblocks.com:443, gatling.http.cache.dns -> io.gatling.http.cache.DnsCacheSupport$$anon$1@468cbc1f, username -> user.53547, gatling.http.ssl.sslContexts -> SslContexts(io.netty.handler.ssl.ReferenceCountedOpenSslClientContext@25c2e707,None), password -> T35tr0ck123*),0,KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$788/0x0000000800846840@37d06bbb) ========================= HTTP request: POST https://openam-perf-100m-testing.forgeblocks.com/am/json/realms/alpha/authenticate?authIndexType=service&authIndexValue=SimpleLogin headers= Accept-API-Version: resource=2.0, protocol=1.0 Accept: application/json host: openam-perf-100m-testing.forgeblocks.com content-type: application/json content-length: 0 byteArraysBody= ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 01:45:48.479 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-6' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 01:45:48.479 [ERROR] i.g.h.a.HttpRequestAction - 'httpRequest-5' failed to execute: No attribute named 'callbacks' is defined 01:45:48.479 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-3' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 01:45:48.479 [ERROR] i.g.h.a.HttpRequestAction - 'httpRequest-2' failed to execute: No attribute named 'callbacks' is defined 01:45:48.479 [ERROR] i.g.h.a.c.AddCookieBuilder$$anon$1 - 'addCookie-1' failed to execute: No attribute named 'tokenId' is defined 01:45:48.489 [INFO ] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 5253571: i.g.h.c.i.RequestTimeoutException: Request timeout to openam-perf-100m-testing.forgeblocks.com/34.111.179.107:443 after 60000 ms 01:45:48.489 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: restLoginInitiate: KO i.g.h.c.i.RequestTimeoutException: Request timeout to openam-perf-100m-testing.forgeblocks.com/34.111.179.107:443 after 60000 ms ========================= Session: Session(idc.login,5253571,1664325888488,Map(gatling.http.cache.baseUrl -> https://openam-perf-100m-testing.forgeblocks.com:443, gatling.http.cache.dns -> io.gatling.http.cache.DnsCacheSupport$$anon$1@468cbc1f, username -> user.53565, gatling.http.ssl.sslContexts -> SslContexts(io.netty.handler.ssl.ReferenceCountedOpenSslClientContext@30146e3d,None), password -> T35tr0ck123*),0,KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$788/0x0000000800846840@37d06bbb) ========================= HTTP request: POST https://openam-perf-100m-testing.forgeblocks.com/am/json/realms/alpha/authenticate?authIndexType=service&authIndexValue=SimpleLogin headers= Accept-API-Version: resource=2.0, protocol=1.0 Accept: application/json host: openam-perf-100m-testing.forgeblocks.com content-type: application/json content-length: 0 byteArraysBody= ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 01:45:48.489 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-6' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 01:45:48.489 [ERROR] i.g.h.a.HttpRequestAction - 'httpRequest-5' failed to execute: No attribute named 'callbacks' is defined 01:45:48.489 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-3' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 01:45:48.489 [ERROR] i.g.h.a.HttpRequestAction - 'httpRequest-2' failed to execute: No attribute named 'callbacks' is defined 01:45:48.489 [ERROR] i.g.h.a.c.AddCookieBuilder$$anon$1 - 'addCookie-1' failed to execute: No attribute named 'tokenId' is defined 01:45:48.598 [INFO ] i.g.h.e.r.DefaultStatsProcessor - Request 'restloginProgressiveProfileCallback' failed for user 5300666: status.find.is(200), but actually found 400 01:45:48.598 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: restloginProgressiveProfileCallback: KO status.find.is(200), but actually found 400 ========================= Session: Session(idc.login,5300666,1664325920088,Map(gatling.http.cache.baseUrl -> https://openam-perf-100m-testing.forgeblocks.com:443, gatling.http.cache.dns -> io.gatling.http.cache.DnsCacheSupport$$anon$1@468cbc1f, username -> user.100669, gatling.http.ssl.sslContexts -> SslContexts(io.netty.handler.ssl.ReferenceCountedOpenSslClientContext@43abbbcb,None), gatling.http.referer -> https://openam-perf-100m-testing.forgeblocks.com/am/json/realms/alpha/authenticate?authIndexType=service&authIndexValue=SimpleLogin, callbacks -> {"authId":"eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJhdXRoSW5kZXhWYWx1ZSI6IlNpbXBsZUxvZ2luIiwib3RrIjoicG80N200amxrZDNwNTFmdWIxaTJxbG9odHIiLCJhdXRoSW5kZXhUeXBlIjoic2VydmljZSIsInJlYWxtIjoiL2FscGhhIiwic2Vzc2lvbklkIjoiKkFBSlRTUUFDTURJQUJIUjVjR1VBQ0VwWFZGOUJWVlJJQUFKVE1RQUNNREUuKmV5SjBlWEFpT2lKS1YxUWlMQ0pqZEhraU9pSktWMVFpTENKaGJHY2lPaUpJVXpJMU5pSjkuWlhsS01HVllRV2xQYVVwTFZqRlJhVXhEU214aWJVMXBUMmxLUWsxVVNUUlJNRXBFVEZWb1ZFMXFWVEpKYVhkcFdWZDRia2xxYjJsYVIyeDVTVzR3TGk1QlRXazJWblJJUTI1aFdYUXdkVlJGY0ZONVlXeDNMbGwxY1dsSVJGbDZPSGRGVm1VdFMzSkVXR3RqUVVSd2RuUkVXa0ZLU0dSNU1sQkRha2hGZDBGSmVYZGpVRVZNVEVaUGNtdERTRTlDUzA5bmNIWmhTV0Z0ZERKQk5ESlFja1pCT0RkaFlrSk5VMnN5VWxKU2IwZENkMUZwU0VGMlRUbHdRalpHVG5SVVEwMVlNbTUwUnkxdlptY3lNSE41ZDBwbk5XOWFkbFkxTURaRmJIUXpTRVZHVlZGWldsb3dWbU10YVhGTVZUbEJiV2cyV2toVE1VeFdlbUpLWlhkdWNqSnlNMUZPWTFaR2RXaHVTbmxyWjBGQ2MxRlRNR2t3U0ZKRFRURXhWRTlaVTNSVVNtVlROMUo2YUhwMldXVjJjVVpIWjJSR0xWOVdlRmRoY2toT1RFcG9lbGxwWDJobVoxTnNORjlWWjB0ZlQxVTVUV0Z2TUVscFMyZGFUSEJaVDFOUFVuQndOa1JxU0dWc1JIVTFZVFl3Y1V4V1JqSnpiWEo1Y2pGcVYyeDNhR3BqYTBGeFltWnVYemQzWm1neGFIbERhbWRuUzFkdWExQktiVzlvUWtwdlIyUkZjRnBIVDJwbFMxRlJjMnh6VW1kZmFVVmpZMGszZERNd2FFVmtRMFYxTTFwNmQyODVhMlp5WWpCSlNGTlVjMmxVYTNKSE5WODFVV2RMTjJKRFVXVjJhWE5NTW5FdGQzcGpWMVJzVUVOdGJFaEViMTh6WkZOWGFVRlpWVUl0VkdOWlFqUXhhSHBWTVRWaWFGbzFhR3RNWjAxVWVqQmxiVjh5TVRGUmJtUlliMEU1ZDFKUlRuRldWRzkxVkRSVmFHUXRXakIwT0ZrMVNXeHVUVTlzV1dad05rTjZNVVUyU2xBNFFUbHJTbWw1YUZWTVRYTmhRbmwxUzJ0WVdFd3dVVzFYTVVKTFMwWjZhVmxEWjBaeU5YZEZhamhzVVdOUlRGTmpWRXMwUzI5eGJsUldiRnBGU3pOM1JDMHpWekJXTmtsVWIyazJSMnhFUVU5VFVFUkZlR1ptUTI5TWRIbG1ZVTFCVjBFdFpWUlplamR2VVhoVGVEUkNVMWxzY1U1MVdsOUlSMDh5YlUxMGNGRnZZM1pGYmxaa2NXMVBRMko1WjBjekxWaEpkakJQTVRWV1JYVjBOa1p0VVZwV1EwVmlVR0k0ZFhvMFZrbFVOVWM0ZW1oTWRFMW5MbWxKTUY5Q1JGTnhNalF0V0ZReE9TMDRUemhRUzFFLlB3R19sZWhkb09pRHM5ZkhfRDhiUHhocFpJYm1oOERzeFFPRERVcU5WUVEiLCJleHAiOjE2NjQzMjYyMzEsImlhdCI6MTY2NDMyNTkzMX0.FxZ3mRrgwIz_p4XMiGZRcIdDxVNKOgBmUf9HKMbvvac","callbacks":[{"type":"NameCallback","output":[{"name":"prompt","value":"User Name"}],"input":[{"name":"IDToken1","value":true}],"_id":0},{"type":"PasswordCallback","output":[{"name":"prompt","value":"Password"}],"input":[{"name":"IDToken2","value":true}],"_id":1}]}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-100m-testing.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-100m-testing.forgeblocks.com, path=/, secure, HTTPOnly,false,false,1664325931674))), password -> T35tr0ck123*),0,KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$788/0x0000000800846840@37d06bbb) ========================= HTTP request: POST https://openam-perf-100m-testing.forgeblocks.com/am/json/realms/alpha/authenticate?authIndexType=service&authIndexValue=SimpleLogin headers= Accept-API-Version: protocol=2.1,resource=1.0 Accept: application/json Referer: https://openam-perf-100m-testing.forgeblocks.com/am/json/realms/alpha/authenticate?authIndexType=service&authIndexValue=SimpleLogin cookie: amlbcookie=01 origin: https://openam-perf-100m-testing.forgeblocks.com host: openam-perf-100m-testing.forgeblocks.com content-type: application/json content-length: 2174 cookies= amlbcookie=01, domain=openam-perf-100m-testing.forgeblocks.com, path=/, secure, HTTPOnly byteArraysBody={"authId":"eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJhdXRoSW5kZXhWYWx1ZSI6IlNpbXBsZUxvZ2luIiwib3RrIjoicG80N200amxrZDNwNTFmdWIxaTJxbG9odHIiLCJhdXRoSW5kZXhUeXBlIjoic2VydmljZSIsInJlYWxtIjoiL2FscGhhIiwic2Vzc2lvbklkIjoiKkFBSlRTUUFDTURJQUJIUjVjR1VBQ0VwWFZGOUJWVlJJQUFKVE1RQUNNREUuKmV5SjBlWEFpT2lKS1YxUWlMQ0pqZEhraU9pSktWMVFpTENKaGJHY2lPaUpJVXpJMU5pSjkuWlhsS01HVllRV2xQYVVwTFZqRlJhVXhEU214aWJVMXBUMmxLUWsxVVNUUlJNRXBFVEZWb1ZFMXFWVEpKYVhkcFdWZDRia2xxYjJsYVIyeDVTVzR3TGk1QlRXazJWblJJUTI1aFdYUXdkVlJGY0ZONVlXeDNMbGwxY1dsSVJGbDZPSGRGVm1VdFMzSkVXR3RqUVVSd2RuUkVXa0ZLU0dSNU1sQkRha2hGZDBGSmVYZGpVRVZNVEVaUGNtdERTRTlDUzA5bmNIWmhTV0Z0ZERKQk5ESlFja1pCT0RkaFlrSk5VMnN5VWxKU2IwZENkMUZwU0VGMlRUbHdRalpHVG5SVVEwMVlNbTUwUnkxdlptY3lNSE41ZDBwbk5XOWFkbFkxTURaRmJIUXpTRVZHVlZGWldsb3dWbU10YVhGTVZUbEJiV2cyV2toVE1VeFdlbUpLWlhkdWNqSnlNMUZPWTFaR2RXaHVTbmxyWjBGQ2MxRlRNR2t3U0ZKRFRURXhWRTlaVTNSVVNtVlROMUo2YUhwMldXVjJjVVpIWjJSR0xWOVdlRmRoY2toT1RFcG9lbGxwWDJobVoxTnNORjlWWjB0ZlQxVTVUV0Z2TUVscFMyZGFUSEJaVDFOUFVuQndOa1JxU0dWc1JIVTFZVFl3Y1V4V1JqSnpiWEo1Y2pGcVYyeDNhR3BqYTBGeFltWnVYemQzWm1neGFIbERhbWRuUzFkdWExQktiVzlvUWtwdlIyUkZjRnBIVDJwbFMxRlJjMnh6VW1kZmFVVmpZMGszZERNd2FFVmtRMFYxTTFwNmQyODVhMlp5WWpCSlNGTlVjMmxVYTNKSE5WODFVV2RMTjJKRFVXVjJhWE5NTW5FdGQzcGpWMVJzVUVOdGJFaEViMTh6WkZOWGFVRlpWVUl0VkdOWlFqUXhhSHBWTVRWaWFGbzFhR3RNWjAxVWVqQmxiVjh5TVRGUmJtUlliMEU1ZDFKUlRuRldWRzkxVkRSVmFHUXRXakIwT0ZrMVNXeHVUVTlzV1dad05rTjZNVVUyU2xBNFFUbHJTbWw1YUZWTVRYTmhRbmwxUzJ0WVdFd3dVVzFYTVVKTFMwWjZhVmxEWjBaeU5YZEZhamhzVVdOUlRGTmpWRXMwUzI5eGJsUldiRnBGU3pOM1JDMHpWekJXTmtsVWIyazJSMnhFUVU5VFVFUkZlR1ptUTI5TWRIbG1ZVTFCVjBFdFpWUlplamR2VVhoVGVEUkNVMWxzY1U1MVdsOUlSMDh5YlUxMGNGRnZZM1pGYmxaa2NXMVBRMko1WjBjekxWaEpkakJQTVRWV1JYVjBOa1p0VVZwV1EwVmlVR0k0ZFhvMFZrbFVOVWM0ZW1oTWRFMW5MbWxKTUY5Q1JGTnhNalF0V0ZReE9TMDRUemhRUzFFLlB3R19sZWhkb09pRHM5ZkhfRDhiUHhocFpJYm1oOERzeFFPRERVcU5WUVEiLCJleHAiOjE2NjQzMjYyMzEsImlhdCI6MTY2NDMyNTkzMX0.FxZ3mRrgwIz_p4XMiGZRcIdDxVNKOgBmUf9HKMbvvac","callbacks":[{"type":"NameCallback","output":[{"name":"prompt","value":"User Name"}],"input":[{"name":"IDToken1","value":true}],"_id":0},{"type":"PasswordCallback","output":[{"name":"prompt","value":"Password"}],"input":[{"name":"IDToken2","value":true}],"_id":1}]} ========================= HTTP response: status= 400 headers= x-frame-options: SAMEORIGIN x-content-type-options: nosniff cache-control: private content-api-version: resource=1.2 expires: 0 pragma: no-cache content-type: application/json;charset=UTF-8 content-length: 30 date: Wed, 28 Sep 2022 00:45:47 GMT x-forgerock-transactionid: 1664325944629-9904d50b9dc81591815f-9878471 strict-transport-security: max-age=31536000; includeSubDomains; preload; Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 body= {"errorMessage":"Bad Request"} <<<<<<<<<<<<<<<<<<<<<<<<< 01:45:48.598 [ERROR] i.g.h.a.c.AddCookieBuilder$$anon$1 - 'addCookie-1' failed to execute: No attribute named 'tokenId' is defined ________________________________________________________________________________ [28/Sep/2022 00:48:21] authn-users-1500 show_stderr : Display stderr order ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/05_authn-users-1500/stderr.txt is small (0 lines), printing all lines: ----- output ----- ________________________________________________________________________________ [28/Sep/2022 00:48:21] authn-users-1500 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [28/Sep/2022 00:49:34] authn-users-1500 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [28/Sep/2022 00:49:34] authn-users-1500 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped