--Task-- name: authn-users-100 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0 stop: 20 timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: [] options: {'simulation': 'com.forgerock.gatling.Loadtest', 'testCase': 'idc.login', 'testMode': 'open', 'throughput': 100, 'rampup-duration': 30, 'java-opts': '-Dnum_users=200000 -Drealm=alpha -Duser_password=T35tr0ck123*'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [27/Sep/2022 19:45:40] authn-users-100 pre : N/A ________________________________________________________________________________ [27/Sep/2022 19:45:40] - INFO: setting default timeout for task - 2x global_duration or 300 seconds (whatever is higher): [27/Sep/2022 19:45:40] - INFO: Timeout for this Task has changed to 10h (36000 seconds) Pod log file : /results/orders/authn-users-100/stdout.txt Pod log : /results/orders/authn-users-100 ________________________________________________________________________________ [27/Sep/2022 19:45:40] authn-users-100 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ /lodestar/clients/gatling-for-pyrock.sh -s com.forgerock.gatling.Loadtest -sf /lodestar/pyrock/shared/clients/gatling-open/ -rd com.forgerock.gatling.Loadtest@IDC -rf /results/gatling/authn-users-100 --no-reports ________________________________________________________________________________ [27/Sep/2022 19:45:40] authn-users-100 create_order : Create order for overseer with the command to run ________________________________________________________________________________ Userpool size is not defined for the task in conf.yaml and cannot find how many users (entries) are in id-repo, please check the conf.yaml file. Default for selected Gatling simulation will be used. [27/Sep/2022 19:45:40] - INFO: Get overseer pod resources requests memory [loop_until]: kubectl --namespace=xlou get pods overseer-0-c7fc5cc47-x4c97 -o jsonpath={.spec.containers[].resources.requests.memory} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 4Gi --- stderr --- Order file : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/01_authn-users-100/order.json { "name": "authn-users-100", "command": "/lodestar/clients/gatling-for-pyrock.sh -s com.forgerock.gatling.Loadtest -sf /lodestar/pyrock/shared/clients/gatling-open/ -rd com.forgerock.gatling.Loadtest@IDC -rf /results/gatling/authn-users-100 --no-reports", "out-dir": "/results/orders/authn-users-100", "environment": { "JAVA_OPTS": "-Dam_host=openam-perf-100m-testing.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@forgerock.com -Didc=true -Dnum_users=200000 -Doauth2_client_id=idmAdminClient -Doauth2_redirect_uri=/platform/appAuthHelperRedirect.html -Drampup_duration=30 -Drealm=alpha -DtestCase=idc.login -DtestMode=open -Dthroughput=100 -Duser_password=T35tr0ck123* -Xmx4G -Dduration=39960" } } ________________________________________________________________________________ [27/Sep/2022 19:45:40] authn-users-100 loop_until_ready : Loop until overseer pod is ready to accept order ________________________________________________________________________________ [loop_until]: curl -k https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 30 0 --:--:-- --:--:-- --:--:-- 30 ________________________________________________________________________________ [27/Sep/2022 19:45:40] authn-users-100 start_order : Send the order to the overseer pod ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/01_authn-users-100/order.json overseer-0-c7fc5cc47-x4c97:/results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order has been successfully forwarded to overseer [27/Sep/2022 19:45:42] - INFO: Check if Gatling simulation started successfully [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -- head /results/orders/authn-users-100/stdout.txt | grep "started..." [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: started... - retry [loop_until]: Function succeeded after 6s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling Simulation com.forgerock.gatling.Loadtest started... --- stderr --- Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. Checking if the task is still running... Task is still running as expected. ________________________________________________________________________________ [27/Sep/2022 20:45:40] authn-users-100 stop_order : Stop the order on overseer pod ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -- rm -f /results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order ran during 59m 59s ________________________________________________________________________________ [27/Sep/2022 20:45:41] authn-users-100 download_logs : Download order.tar.gz ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- Checking pod: overseer-0-c7fc5cc47-x4c97 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -i -- bash -c 'if [ -f "/results/orders/authn-users-100/order.tar.gz" ]; then echo "/results/orders/authn-users-100/order.tar.gz file found"; exit 0; else echo "/results/orders/authn-users-100/order.tar.gz file not found"; exit 1; fi' | grep "/results/orders/authn-users-100/order.tar.gz file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function failed after 0s (rc=1 - expected to be in [0]) - retry [loop_until]: Function succeeded after 6s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/authn-users-100/order.tar.gz file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [run_command]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -i -- du -k /results/orders/authn-users-100/order.tar.gz [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 2332 /results/orders/authn-users-100/order.tar.gz --- stderr --- - Download file (size 2332k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- source : /results/orders/authn-users-100/order.tar.gz @ overseer-0-c7fc5cc47-x4c97 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/01_authn-users-100/order.tar.gz [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou cp overseer-0-c7fc5cc47-x4c97:/results/orders/authn-users-100/order.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/01_authn-users-100/order.tar.gz [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- - Extract archive zip file : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/01_authn-users-100/order.tar.gz destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/01_authn-users-100 ________________________________________________________________________________ [27/Sep/2022 20:45:51] authn-users-100 show_cmd : Display order command ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/01_authn-users-100/cmd.txt is small (1 lines), printing all lines: ----- output ----- /lodestar/clients/gatling-for-pyrock.sh -s com.forgerock.gatling.Loadtest -sf /lodestar/pyrock/shared/clients/gatling-open/ -rd com.forgerock.gatling.Loadtest@IDC -rf /results/gatling/authn-users-100 --no-reports ________________________________________________________________________________ [27/Sep/2022 20:45:51] authn-users-100 show_rc : Display rc order ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/01_authn-users-100/rc.txt is small (1 lines), printing all lines: ----- output ----- CMD SUCCESS: command returns code -9 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [27/Sep/2022 20:45:51] authn-users-100 show_stdout : Display stdout order ________________________________________________________________________________ [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/01_authn-users-100/stdout.txt is 104663 lines): ----- output ----- GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling Simulation com.forgerock.gatling.Loadtest started... ================================================================================ 2022-09-27 20:45:53 5s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=81 KO=0 ) > restLoginInitiate (OK=41 KO=0 ) > restLoginUsernamePasswordCallback (OK=40 KO=0 ) ---- idc.login ----------------------------------------------------------------- [- ] 0% waiting: 3997963 / active: 1 / done: 40 ================================================================================ ================================================================================ 2022-09-27 20:45:58 10s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=329 KO=0 ) > restLoginInitiate (OK=165 KO=0 ) > restLoginUsernamePasswordCallback (OK=164 KO=0 ) ---- idc.login ----------------------------------------------------------------- [- ] 0% waiting: 3997838 / active: 2 / done: 164 ================================================================================ ================================================================================ 2022-09-27 20:46:03 15s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=746 KO=0 ) > restLoginInitiate (OK=374 KO=0 ) > restLoginUsernamePasswordCallback (OK=372 KO=0 ) ---- idc.login ----------------------------------------------------------------- [- ] 0% waiting: 3997629 / active: 3 / done: 372 ================================================================================ ================================================================================ 2022-09-27 20:46:08 20s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=1326 KO=0 ) > restLoginInitiate (OK=664 KO=0 ) > restLoginUsernamePasswordCallback (OK=662 KO=0 ) ---- idc.login ----------------------------------------------------------------- [- ] 0% waiting: 3997338 / active: 4 / done: 662 ================================================================================ 20:46:11.524 [INFO ] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginUsernamePasswordCallback' failed for user 855: status.find.is(200), but actually found 401 20:46:11.537 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: restLoginUsernamePasswordCallback: KO status.find.is(200), but actually found 401 ========================= Session: Session(idc.login,855,1664307971459,Map(gatling.http.cache.baseUrl -> https://openam-perf-100m-testing.forgeblocks.com:443, gatling.http.cache.dns -> io.gatling.http.cache.DnsCacheSupport$$anon$1@1ea97626, username -> user.855, gatling.http.ssl.sslContexts -> SslContexts(io.netty.handler.ssl.ReferenceCountedOpenSslClientContext@40bf1261,None), callbacks -> {"code":401,"reason":"Unauthorized","message":"Login failure"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-100m-testing.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-100m-testing.forgeblocks.com, path=/, secure, HTTPOnly,false,false,1664307971482))), password -> T35tr0ck123*),1,KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$787/0x0000000800846840@5b19477) ========================= HTTP request: POST https://openam-perf-100m-testing.forgeblocks.com/am/json/realms/alpha/authenticate?authIndexType=service&authIndexValue=SimpleLogin headers= Accept-API-Version: resource=2.0, protocol=1.0 Accept: application/json cookie: amlbcookie=01 host: openam-perf-100m-testing.forgeblocks.com content-type: application/json content-length: 2190 cookies= amlbcookie=01, domain=openam-perf-100m-testing.forgeblocks.com, path=/, secure, HTTPOnly byteArraysBody={"authId":"eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJhdXRoSW5kZXhWYWx1ZSI6IlNpbXBsZUxvZ2luIiwib3RrIjoiZjFrY2VsaXNmdm5xaDc2c2U2NGppYXFnZm8iLCJhdXRoSW5kZXhUeXBlIjoic2VydmljZSIsInJlYWxtIjoiL2FscGhhIiwic2Vzc2lvbklkIjoiKkFBSlRTUUFDTURJQUJIUjVjR1VBQ0VwWFZGOUJWVlJJQUFKVE1RQUNNREUuKmV5SjBlWEFpT2lKS1YxUWlMQ0pqZEhraU9pSktWMVFpTENKaGJHY2lPaUpJVXpJMU5pSjkuWlhsS01HVllRV2xQYVVwTFZqRlJhVXhEU214aWJVMXBUMmxLUWsxVVNUUlJNRXBFVEZWb1ZFMXFWVEpKYVhkcFdWZDRia2xxYjJsYVIyeDVTVzR3TGk1aVNtRjZOVGxKTTA5Rk9GQmtZa3BCVkd0SFVrbG5Ma1I0VEZVeGFVeFVPRmR4ZWtvNGIzVndaa3QxUVZoeGMzSnFXakZuUVhwaFRVMUVPRUp5VDJVMVJtdFRSMDlrYkVkWVdVb3lWWFZXVmtRNVdHbFJTRFJUZEdSeVZWaFVaamhRTUd4VFVGVXlabnBxWkZCUVVUZEZNa1JmT0ZKNVdHeDRNRGRzY0U1cWNsVkZOMnhYV25wNE0xVnRTbUZUWkVGdVMzZEZPWE5KYmtkeWNXMXZTRmhFU210d1gzTjFhVmhxTjNwUmJuQllXVFJRVTNCcWQxUmxVekoxTVV4RFRXbFVZbVpuU3pWZk9VSm5XblpqUVZSNGJVWndjbVk0TW1sRmIzbzVia2xmVTFscVQyOTVNamh2VFdzNWVpMHRMVlJGVEUxWVEwbFlRMnRSUTBGcExUTlhjMUZzT0ZwSVdYbElka0pMWldSa1JUVjRVbUUzUlVKdVUyMXFkR054ZDJsU2RsTTFlakJNZFdKbWRqQlRlRTFWZDBKTFRFOTNNMmhIYjJvdFRuZzVhMU5uZUhsT01FeFNOMjlMTmtJeVkwMUlTVUpqVEZwNFdsZHBkMWw0ZWtacE5rWlplakl4VDNOYWJVbFZWVWwwWXkweVp6Rm5kMWhwV2pkMVNrOXRkVk5wVm5GMmRVZFdkR0pSUkdWc2FWUkNlWEJWWDA5MlZsUkJUREl4YWtKMVYwbGhSakJVVUhCS1kwSmZRVzFNWVZwRlpVVlpjM0pCTkc1dVJDMTVZVWhSVFdvdE1VRm9jVGRSVWxKVmNIQlZSVGM1TTFkb1VGWlZiM0ZXYVdoemMzaENiRlZ5Tm5SM2VHOXNPRTFYVEUxRkxUaHlTMHBOZVdoelRtVmFWbFpwWmt4MGRXaDBSM1pXZURWMk1FZElMVVIwVXpoaE0zVkZaR2xpYTBKMmJtWmxMVE00VTFwR1p6VkphVEp3VTFsT1RGcGxabTB4Y2tOUmRFWkxUVWhGY25SMFUyMUNkblZUUlVKbU5VSktaRjl0UzA0eFFqbHdObGQyVDNaM1JsRk5XRWxGVWpWRE5FMDFaMlZDZWxjeVdTMTFjM0ZwYnpZM04yaEdaVVp6VW1wS1pYWkJWVTVDYUhFNGVESjZiRGhmVGs4eGVHbHdURzV6YVRGUWFqRkpiRzh3YWtNeFN6RTVUV2RzUmxSNVoweENWbnB3VERWbE5XTlJYMDlFT0haaUxTMTNMbFZVTkdOQ2FtbEtjSEoxTkhKWmMwUjROSEJSVGxFLkUwd1I0RDVIM0NRX0M3Nm5Fekh6S0YwY3lRd2p5aXN5ODE3eHBqWXJVeXciLCJleHAiOjE2NjQzMDgyNzEsImlhdCI6MTY2NDMwNzk3MX0.FWVJ88XDMy-JCLLqV5-gM76_vI7q-DBzAG_6PxBxRdQ","callbacks":[{"type":"NameCallback","output":[{"name":"prompt","value":"User Name"}],"input":[{"name":"IDToken1","value":"user.855"}],"_id":0},{"type":"PasswordCallback","output":[{"name":"prompt","value":"Password"}],"input":[{"name":"IDToken2","value":"T35tr0ck123*"}],"_id":1}]} ========================= HTTP response: status= 401 headers= x-frame-options: SAMEORIGIN x-content-type-options: nosniff cache-control: private content-api-version: resource=2.1 expires: 0 pragma: no-cache content-type: application/json content-length: 62 date: Tue, 27 Sep 2022 19:46:11 GMT x-forgerock-transactionid: 1664307969571-58e312683e938b85b769-253365 strict-transport-security: max-age=31536000; includeSubDomains; preload; Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 body= {"code":401,"reason":"Unauthorized","message":"Login failure"} <<<<<<<<<<<<<<<<<<<<<<<<< 20:46:11.539 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-3' crashed with 'j.u.NoSuchElementException: key not found: callbacks', forwarding to the next one 20:46:11.558 [INFO ] i.g.h.e.r.DefaultStatsProcessor - Request 'restloginProgressiveProfileCallback' failed for user 855: jsonPath($.tokenId).find.exists, found nothing 20:46:11.559 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - [...] content-length: 2170 date: Tue, 27 Sep 2022 20:45:40 GMT x-forgerock-transactionid: 1664311540666-9904d50b9dc81591815f-537422 strict-transport-security: max-age=31536000; includeSubDomains; preload; Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 body= {"authId":"eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJhdXRoSW5kZXhWYWx1ZSI6IlNpbXBsZUxvZ2luIiwib3RrIjoiZXVpc2c1YXRxaWM3NGlvOThmMDNyZThwcGwiLCJhdXRoSW5kZXhUeXBlIjoic2VydmljZSIsInJlYWxtIjoiL2FscGhhIiwic2Vzc2lvbklkIjoiKkFBSlRTUUFDTURJQUJIUjVjR1VBQ0VwWFZGOUJWVlJJQUFKVE1RQUNNREUuKmV5SjBlWEFpT2lKS1YxUWlMQ0pqZEhraU9pSktWMVFpTENKaGJHY2lPaUpJVXpJMU5pSjkuWlhsS01HVllRV2xQYVVwTFZqRlJhVXhEU214aWJVMXBUMmxLUWsxVVNUUlJNRXBFVEZWb1ZFMXFWVEpKYVhkcFdWZDRia2xxYjJsYVIyeDVTVzR3TGk1UVowMVljVU5EVW5kNFFtUlJhbVkzU2xkM2QwTkJMa0pFU2tKR01YRm9Sa2x3WDJVMVJFMWpiSGt4VW1jdFozTkJkMlZyVWpoMVdFOXJVMGRpVG5KWVdIUnVWMkY1ZG5wdmFURllVbmRKVG1wNU1VWkVSbHBTYjFGeVlqSjFVa0pTTFdNME1rNVJMVTlZZUdaa1luWkpSVEJLVG5KUWQycFhlR3BzZERWSGRsTnBlazUxZEhCT2JXMUVkamxCWTBoWmNqTlBialpLVm14aFNsSnJaWEp2VFRSUGVIVnFNelZwZEZKbWVVbzFWVkZaZDNsRk1rdFdaREZ3VlZwa2NXNHdjMFkwWXpsVU5FMXdiVTg0T0Y4dFQxaHVYMHRNTTBWUFNUVXlWWEo0TjNSeFJYRkdPVnBIVUVoelVrRlhWSHBSVlcxa1JVUjRZV1ZWWjNaak1tcHlTWGx6U1dGNmVtcGlTMHhHTVhGdVRVSTVialZQVDNoS1ZqRlBXa1JYYWxwSVVuTlNiRXhrWVdkVWFXbFhPVkprWjB0U2RVaHpSVkJrU0hOSGRteHNVa2RoU0RZd1VsbDBSRXBTUkVKUE5WbG1la0pKZWxBMGJ6VTFTVkZoUzAxWU1FWkpkV2QyVFZGWk9IcFhWR2d0YlUxMFFsOXdiMVJGVEU1Rk5HNXNhSEJRU3kxNGJYSklTV1IwTjJkYU1GRnlkM0ZVTVVKV1ZpMXJVaTFqVmtreWFWQnBORE50VlVGRFlXa3RTM1pmVFV0R2FtRjFSblkzWnpKTFJ5MVZWMDF6VGtZMVdISXRMVVV3VnpSWmEycHhkRVZsVms5SWVuZzFWSEZ3YUhWM1NqVktZVTl4VUZoTGVUZDJhM3BDVnkxUFlrNUtaRGw0VERkaVlsVTVWR3h0ZDI0dFptTnJTR015U0RWMlprdFVPRzkxVlMxaWRIaFNaVmwyTWtwek4yVk5TMFJxZGxsNFFtMUtZMk5WT0ZReGRsQXpabW94ZVdsRmVEVlJaRlJDUkVjMVZscEVTRkZ6TWtsaGNIQnRiM2REUjJoUGFIbHhRbmR4VjJWVVZGVkxjSE5QZG01T1oxOUljbVJuZG5wV1MyaGhSMjVzUkhOS2MycFRNbEZ0UlZZek1rWnVjMVZqTjJONVVGcHhVR013UjFOSFkwMWphak4yWDB3eVJHRlZiRWc0VjNGbU9WOWhlbFJGVEdoVFdGZHZZVko1Vm5OTVJHa3pjMTk0V0VoQ1lXZE5Ma3R4VkMxNGRGRTBlRXB1VlZCeU1WQnRXWE0yTlhjLnJRd3kwS1FLa0RkeWh3SVFKcE4zblhORVg5UFlZUVNXMElqUndwLU9pdDAiLCJleHAiOjE2NjQzMTE4NDEsImlhdCI6MTY2NDMxMTU0MX0.LYFGIBLpPPlFtX8kzhrSK1ZsGzLRNQLCfHhXw63VcqA","callbacks":[{"type":"NameCallback","output":[{"name":"prompt","value":"User Name"}],"input":[{"name":"IDToken1","value":""}],"_id":0},{"type":"PasswordCallback","output":[{"name":"prompt","value":"Password"}],"input":[{"name":"IDToken2","value":""}],"_id":1}]} <<<<<<<<<<<<<<<<<<<<<<<<< 21:45:41.057 [ERROR] i.g.h.a.c.AddCookieBuilder$$anon$1 - 'addCookie-1' failed to execute: No attribute named 'tokenId' is defined 21:45:41.893 [INFO ] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginUsernamePasswordCallback' failed for user 357082: status.find.is(200), but actually found 401 21:45:41.893 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: restLoginUsernamePasswordCallback: KO status.find.is(200), but actually found 401 ========================= Session: Session(idc.login,357082,1664311541840,Map(gatling.http.cache.baseUrl -> https://openam-perf-100m-testing.forgeblocks.com:443, gatling.http.cache.dns -> io.gatling.http.cache.DnsCacheSupport$$anon$1@1ea97626, username -> user.157082, gatling.http.ssl.sslContexts -> SslContexts(io.netty.handler.ssl.ReferenceCountedOpenSslClientContext@2c4db88e,None), callbacks -> {"code":401,"reason":"Unauthorized","message":"Login failure"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-100m-testing.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-100m-testing.forgeblocks.com, path=/, secure, HTTPOnly,false,false,1664311541863))), password -> T35tr0ck123*),1,KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$787/0x0000000800846840@5b19477) ========================= HTTP request: POST https://openam-perf-100m-testing.forgeblocks.com/am/json/realms/alpha/authenticate?authIndexType=service&authIndexValue=SimpleLogin headers= Accept-API-Version: resource=2.0, protocol=1.0 Accept: application/json cookie: amlbcookie=01 host: openam-perf-100m-testing.forgeblocks.com content-type: application/json content-length: 2193 cookies= amlbcookie=01, domain=openam-perf-100m-testing.forgeblocks.com, path=/, secure, HTTPOnly byteArraysBody={"authId":"eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJhdXRoSW5kZXhWYWx1ZSI6IlNpbXBsZUxvZ2luIiwib3RrIjoiZ3FlNGpzMWM2NmEydThqanZnNzhrYWN2a24iLCJhdXRoSW5kZXhUeXBlIjoic2VydmljZSIsInJlYWxtIjoiL2FscGhhIiwic2Vzc2lvbklkIjoiKkFBSlRTUUFDTURJQUJIUjVjR1VBQ0VwWFZGOUJWVlJJQUFKVE1RQUNNREUuKmV5SjBlWEFpT2lKS1YxUWlMQ0pqZEhraU9pSktWMVFpTENKaGJHY2lPaUpJVXpJMU5pSjkuWlhsS01HVllRV2xQYVVwTFZqRlJhVXhEU214aWJVMXBUMmxLUWsxVVNUUlJNRXBFVEZWb1ZFMXFWVEpKYVhkcFdWZDRia2xxYjJsYVIyeDVTVzR3TGk1VE56QmFjR2xqU2pRdE4wRmlRbVJQWm01UlFYVm5MbkpCWjFrM1RrcE5lRk5aYUhkT1Z6UjNWMk0yVFRoYWFWTXdkVmhwU2t0SlJrMVdZaTFpTFhKaFlWWklVM3BZVFc1bWNYbEtNV1F6Um1SeExXTm9UVXRFYW5Wa1lXMUhjbEpYY0hCRGVYTkdaV0pDUVVFMmRYUTRibGh1Y21GVU9VSm1jRlp5WkdGcWFsOHdNWGhYWW5kaVJUbG5aRVpwZDE5Q1JtSXdWMGwxYkhwd1NEZFdjMjlTZURacVpGaEVaa1I2YUVWSVoxcDNSRTF1UTJOaVZrdGtVblZYT1VaV1VtbzFaMEppUTJOTVRreDNXR1JDVGtKNmVucEVTbWQ1UzJacVFtTmlNbWRWUkVKSFdFZE1TVVZJZGpCSmVFMDNORkoxVmxwcFgxaFFUbkZGYVRaMmNGWklVbDlmWXpaNGNWOXJabkU1UlhKNlNXRllhalkwZUUxclltZ3pkVVEyU2tOclluSjVNamhuWVhKME1uRnlNM0pSYjFGak9FeE9WRU5vZW1oalduRnFjR2R3VkhWT04wcGlaV2hOWVhkelptaHJiWGd3VjNWa1dYWkJPVk5RUVUxUFJIRktUazVvU2tzMlVUTjVSVWxQUlVwQmQxSnZNM1JyWDJKc1IyTk9PVWR0VmtSUFYzZEZjMjlyYUdoU00yOUdZMHhMT0VORmNYUnJhMDU1YjJGb2RERTVSMmhSVGpaWVVEbFlkbk5NYlZOc1ptVkNUazluYWpsTlYwTlNZUzFzWVdGT1REZDNiR2w0WTNkWU1HMVBhSEZ2ZVVaNGNrUndjVTlSUTB4S2JISnZSM1U1VmpaVWVIVm5NVGRJWWtaUlIwbERabEZwWVdaSlN6azNaWFV0TFZFeVVUQm5XRUp4ZFRkaWFHcGZhRFJWTlRCWloxQjZOa0phT1hJd1dHZzFWRVZNU0RScGRWWjBYemhaUm5WV1NVWnlUa0pxTW5ZMmJ5MW1OMjVaYkRCZlpuRk9TazVCYVMxTFJEaFhkVjl4V21OSlpVeHRXRTR4UlZKd2RYZHJaV1JxTUdkM2F6aHRZVlJJZVMweFVFMVVTV1F6U1ZsTWVYWkZjelpYUWpSNGFHbHJSazVoZURaVFUzQnJTblYyVWtSMFYyZHZNM0ZJTWtsUVJVRnBObkZUUVMxM1ZtdDRSMTgwVVVNek5ucDFXalpWVmtWVU5WbEZjRGRwTUVobVVuaHZMbTVDYm5CaVdEUnVTSEJCVkhoSVJtMTZNbmQyWVZFLnJFVTFlYVo4aFlLZzBKQTBQWERqLUVST3Nzbkg0Zm5yUUszUVVsV0FCNkEiLCJleHAiOjE2NjQzMTE4NDEsImlhdCI6MTY2NDMxMTU0MX0.yFAg2UlE2WM8TRdcTFd09-C_xO8NCuvur51jSS2dHe4","callbacks":[{"type":"NameCallback","output":[{"name":"prompt","value":"User Name"}],"input":[{"name":"IDToken1","value":"user.157082"}],"_id":0},{"type":"PasswordCallback","output":[{"name":"prompt","value":"Password"}],"input":[{"name":"IDToken2","value":"T35tr0ck123*"}],"_id":1}]} ========================= HTTP response: status= 401 headers= x-frame-options: SAMEORIGIN x-content-type-options: nosniff cache-control: private content-api-version: resource=2.1 expires: 0 pragma: no-cache content-type: application/json content-length: 62 date: Tue, 27 Sep 2022 20:45:41 GMT x-forgerock-transactionid: 1664311541516-58e312683e938b85b769-493889 strict-transport-security: max-age=31536000; includeSubDomains; preload; Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 body= {"code":401,"reason":"Unauthorized","message":"Login failure"} <<<<<<<<<<<<<<<<<<<<<<<<< 21:45:41.894 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-3' crashed with 'j.u.NoSuchElementException: key not found: callbacks', forwarding to the next one 21:45:41.912 [INFO ] i.g.h.e.r.DefaultStatsProcessor - Request 'restloginProgressiveProfileCallback' failed for user 357082: jsonPath($.tokenId).find.exists, found nothing 21:45:41.912 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: restloginProgressiveProfileCallback: KO jsonPath($.tokenId).find.exists, found nothing ========================= Session: Session(idc.login,357082,1664311541840,Map(gatling.http.cache.baseUrl -> https://openam-perf-100m-testing.forgeblocks.com:443, gatling.http.cache.dns -> io.gatling.http.cache.DnsCacheSupport$$anon$1@1ea97626, username -> user.157082, gatling.http.ssl.sslContexts -> SslContexts(io.netty.handler.ssl.ReferenceCountedOpenSslClientContext@2c4db88e,None), callbacks -> {"code":401,"reason":"Unauthorized","message":"Login failure"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-100m-testing.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-100m-testing.forgeblocks.com, path=/, secure, HTTPOnly,false,false,1664311541911))), password -> T35tr0ck123*),3,KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$787/0x0000000800846840@5b19477) ========================= HTTP request: POST https://openam-perf-100m-testing.forgeblocks.com/am/json/realms/alpha/authenticate?authIndexType=service&authIndexValue=SimpleLogin headers= Accept-API-Version: protocol=2.1,resource=1.0 Accept: application/json cookie: amlbcookie=01 host: openam-perf-100m-testing.forgeblocks.com content-type: application/json content-length: 62 cookies= amlbcookie=01, domain=openam-perf-100m-testing.forgeblocks.com, path=/, secure, HTTPOnly byteArraysBody={"code":401,"reason":"Unauthorized","message":"Login failure"} ========================= HTTP response: status= 200 headers= x-frame-options: SAMEORIGIN x-content-type-options: nosniff cache-control: private content-api-version: resource=1.2 expires: 0 pragma: no-cache set-cookie: amlbcookie=01; Path=/; Domain=openam-perf-100m-testing.forgeblocks.com; Secure; HttpOnly; SameSite=none content-type: application/json content-length: 2170 date: Tue, 27 Sep 2022 20:45:41 GMT x-forgerock-transactionid: 1664311538026-5ce4211d8c2004f69d84-508790 strict-transport-security: max-age=31536000; includeSubDomains; preload; Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 body= {"authId":"eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJhdXRoSW5kZXhWYWx1ZSI6IlNpbXBsZUxvZ2luIiwib3RrIjoiOHNiZnB1MWtwNnRiN3Y3bG9qN2txZzN1YjIiLCJhdXRoSW5kZXhUeXBlIjoic2VydmljZSIsInJlYWxtIjoiL2FscGhhIiwic2Vzc2lvbklkIjoiKkFBSlRTUUFDTURJQUJIUjVjR1VBQ0VwWFZGOUJWVlJJQUFKVE1RQUNNREUuKmV5SjBlWEFpT2lKS1YxUWlMQ0pqZEhraU9pSktWMVFpTENKaGJHY2lPaUpJVXpJMU5pSjkuWlhsS01HVllRV2xQYVVwTFZqRlJhVXhEU214aWJVMXBUMmxLUWsxVVNUUlJNRXBFVEZWb1ZFMXFWVEpKYVhkcFdWZDRia2xxYjJsYVIyeDVTVzR3TGk1UWRHOW1OM3B5ZFU1MU5YRjBkelJxTW1OQ0xYVlJMblZKUkZWcE4wZDJOSE5WY1ZSaldrUjJlWE5OV1cxTlZrbzRhREpWTkhoTGQyazFZVVpuUlVoRmVtNWtOMUZaVW1OcU1FZFVOekpxWVhOb1FqTTVNa3B1VDBOeFVWcGtObkZVUlV4dFMzaHFSRVE0YzJsc04yczBhRGQzTTNKcGRVbzJWM3BCWjB3NVkwODJOSFJFZGpaRVJrTTRWM0U1U2pOTVppMXpNRmt6YlcxMWRVeEpTRzFWUm14cVlUbGZNalZ0VUVacGJuTnFXa1psTWtJMGMwOTBTMGRhWVVGVGFuZEdMVnBmUkdjdGRrVklXWFZTWTNaYVdIVTNiVFpXV2pFdFdqUkRiREJuYTJ0aWNYbFBaakk0U0hZdFFtODFXVk56WjFKV1RHZFpNbWhuZGxkalUwbExXVk5uTUVoV2FWQk5USGcwWTBsbVoxSkVSRFJpTUhsWlkwa3RUM0JDYzNOUmFXOVdXazlKUlhSdFdXMTRlRkZ2U25kVVMxOWxRVkpZYXpkUE4yMWhjRlUyVGtOQmNsQkNSR3R2TjNwQkxVOVVjVzk0UzBoT1pXZFJNMmR6TW5OSFJFRk1ibWd0VVZSMGNFUjJXVGxCWlRSU2IybE1OSE4wYnpGeFdIQnFlV0ZTVGpsV056aHRZelZCWkVKVVRFRmFiV1JEUzBJdE5uTnFXa2d3YTJkRWJVRm1hVlpOTVcxWmJHbFdXRkZyWVdoVFJVWTJOV0Y2YWpkVlgxUnZObFIzYlRsUU5rczFkV2RWTjFaNFFqZE9abVpFTkY5Sk1YSXRjRUpCYTFoSE1tTlFjemQ2WlVKSlNrRm1iVjlyUWxJNVNVZG9Ra0ZoWmpSV1pWTnFjRUU1Y1ZSNE4zWTRUMHBmY2s5cGFXNXpSSE0zVDFOM2NuSlhjMHhTUTNaQ2NEUllXVzR3VUhSb01XMWpXblkxTFhvMGVIaGtkekJtYVhOaVpXRmlZbGcwYmw5aVFXMXFjRzQyYTNaWFNuZFhkelUyYWxrMWVsaG5Tak5GVVV0cmFYQlNhMHRhYWtsWGJVNVplV2N6Um1wSlJsQnJkWFpUTlhWT2VEUjVNelZSYkVWalJGSjNaMEZIWHpGV1MwZDZSbTl3TW1GdlVWRkRZa2hHUjBKbWFFUkpRblV0UkhoME1sQkxlVzFaWVZrM1ptWTNPV2hTZDNCWmNIcFBTbGRoYUdKWWFtMUJMakIyYW1STlp6SkdVMjlWUjFoS1pEQTROR3QwY0VFLldYSVpYYjc1T0lBNE5SbS16TEh6Mm5qRldkU19EY0FfSC1tcEVNdlpPTFEiLCJleHAiOjE2NjQzMTE4NDEsImlhdCI6MTY2NDMxMTU0MX0.Mpf2mn8ALXA24hmI5dE2_Q_NRHR2FVbdp3uMdAR46Ns","callbacks":[{"type":"NameCallback","output":[{"name":"prompt","value":"User Name"}],"input":[{"name":"IDToken1","value":""}],"_id":0},{"type":"PasswordCallback","output":[{"name":"prompt","value":"Password"}],"input":[{"name":"IDToken2","value":""}],"_id":1}]} <<<<<<<<<<<<<<<<<<<<<<<<< 21:45:41.912 [ERROR] i.g.h.a.c.AddCookieBuilder$$anon$1 - 'addCookie-1' failed to execute: No attribute named 'tokenId' is defined ________________________________________________________________________________ [27/Sep/2022 20:45:51] authn-users-100 show_stderr : Display stderr order ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/01_authn-users-100/stderr.txt is small (0 lines), printing all lines: ----- output ----- ________________________________________________________________________________ [27/Sep/2022 20:45:51] authn-users-100 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [27/Sep/2022 20:45:51] authn-users-100 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [27/Sep/2022 20:45:51] authn-users-100 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped