--Task-- name: MakeUsers_ds-idrepo enabled: True class_name: MakeUsersTask source_name: overseer-0 source_namespace: >default< target_name: ds-idrepo target_namespace: >default< start: 0 stop: None timeout: no timeout loop: False interval: None dependencies: [] wait_for: [] options: {'out_dir': '/results/ds-idrepo', 'ldif_file': '/results/ds-idrepo/user_entries.ldif', 'num_entries': 1000000} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [20/Sep/2022 01:59:07] MakeUsers_ds-idrepo pre : N/A ________________________________________________________________________________ source (overseer-0) is a component ________________________________________________________________________________ [20/Sep/2022 01:59:07] MakeUsers_ds-idrepo step1 : Make sure overseer is not busy ________________________________________________________________________________ [loop_until]: curl -k https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 30 0 --:--:-- --:--:-- --:--:-- 30 ________________________________________________________________________________ [20/Sep/2022 01:59:07] MakeUsers_ds-idrepo step2 : Generate ldif template ________________________________________________________________________________ location : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/shared/ds-idrepo.template ------------ define suffix=ou=identities define maildomain=example.com define numusers=1000000 branch: [suffix] objectClass: top objectClass: organizationalUnit branch: ou=Groups,[suffix] objectClass: top objectClass: organizationalUnit branch: ou=People,[suffix] objectClass: top objectClass: organizationalUnit subordinateTemplate: person:[numusers] template: person rdnAttr: fr-idm-uuid objectClass: top objectClass: person objectClass: organizationalPerson objectClass: inetOrgPerson objectClass: iplanet-am-user-service objectClass: devicePrintProfilesContainer objectClass: kbaInfoContainer objectClass: fr-idm-managed-user-explicit objectClass: forgerock-am-dashboard-service objectClass: inetuser objectClass: iplanet-am-auth-configuration-service objectClass: iplanet-am-managed-person objectClass: iPlanetPreferences objectClass: oathDeviceProfilesContainer objectClass: pushDeviceProfilesContainer objectClass: sunAMAuthAccountLockout objectClass: sunFMSAML2NameIdentifier objectClass: webauthnDeviceProfilesContainer fr-idm-uuid: givenName: sn: cn: {givenName} {sn} description: This is the description for {cn}. inetUserStatus: active uid: user. mail: {uid}@[maildomain] telephoneNumber: userPassword: T35tr0ck123 ------------ ________________________________________________________________________________ [20/Sep/2022 01:59:07] MakeUsers_ds-idrepo step3 : Create folder on overseer ________________________________________________________________________________ [loop_until]: kubectl --namespace=xlou exec overseer-0-64c569ddd-slh59 -- mkdir -p /results/ds-idrepo/template [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- ________________________________________________________________________________ [20/Sep/2022 01:59:08] MakeUsers_ds-idrepo step4 : Copy template to overseer ________________________________________________________________________________ [loop_until]: kubectl --namespace=xlou cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/shared/ds-idrepo.template overseer-0-64c569ddd-slh59:/results/ds-idrepo/template [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- ________________________________________________________________________________ [20/Sep/2022 01:59:10] MakeUsers_ds-idrepo step5 : Generate ldif file on overseer ________________________________________________________________________________ [loop_until]: kubectl --namespace=xlou exec overseer-0-64c569ddd-slh59 -- /lodestar/clients/ds/bin/makeldif -o /results/ds-idrepo/user_entries.ldif /results/ds-idrepo/template/ds-idrepo.template [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- [print_head_tail]: Print head (100 lines) and tail (100 lines) of input string (1001 lines): ----- output ----- Processed 1000 entries Processed 2000 entries Processed 3000 entries Processed 4000 entries Processed 5000 entries Processed 6000 entries Processed 7000 entries Processed 8000 entries Processed 9000 entries Processed 10000 entries Processed 11000 entries Processed 12000 entries Processed 13000 entries Processed 14000 entries Processed 15000 entries Processed 16000 entries Processed 17000 entries Processed 18000 entries Processed 19000 entries Processed 20000 entries Processed 21000 entries Processed 22000 entries Processed 23000 entries Processed 24000 entries Processed 25000 entries Processed 26000 entries Processed 27000 entries Processed 28000 entries Processed 29000 entries Processed 30000 entries Processed 31000 entries Processed 32000 entries Processed 33000 entries Processed 34000 entries Processed 35000 entries Processed 36000 entries Processed 37000 entries Processed 38000 entries Processed 39000 entries Processed 40000 entries Processed 41000 entries Processed 42000 entries Processed 43000 entries Processed 44000 entries Processed 45000 entries Processed 46000 entries Processed 47000 entries Processed 48000 entries Processed 49000 entries Processed 50000 entries Processed 51000 entries Processed 52000 entries Processed 53000 entries Processed 54000 entries Processed 55000 entries Processed 56000 entries Processed 57000 entries Processed 58000 entries Processed 59000 entries Processed 60000 entries Processed 61000 entries Processed 62000 entries Processed 63000 entries Processed 64000 entries Processed 65000 entries Processed 66000 entries Processed 67000 entries Processed 68000 entries Processed 69000 entries Processed 70000 entries Processed 71000 entries Processed 72000 entries Processed 73000 entries Processed 74000 entries Processed 75000 entries Processed 76000 entries Processed 77000 entries Processed 78000 entries Processed 79000 entries Processed 80000 entries Processed 81000 entries Processed 82000 entries Processed 83000 entries Processed 84000 entries Processed 85000 entries Processed 86000 entries Processed 87000 entries Processed 88000 entries Processed 89000 entries Processed 90000 entries Processed 91000 entries Processed 92000 entries Processed 93000 entries Processed 94000 entries Processed 95000 entries Processed 96000 entries Processed 97000 entries Processed 98000 entries Processed 99000 entries Processed 100000 entries [...] Processed 902000 entries Processed 903000 entries Processed 904000 entries Processed 905000 entries Processed 906000 entries Processed 907000 entries Processed 908000 entries Processed 909000 entries Processed 910000 entries Processed 911000 entries Processed 912000 entries Processed 913000 entries Processed 914000 entries Processed 915000 entries Processed 916000 entries Processed 917000 entries Processed 918000 entries Processed 919000 entries Processed 920000 entries Processed 921000 entries Processed 922000 entries Processed 923000 entries Processed 924000 entries Processed 925000 entries Processed 926000 entries Processed 927000 entries Processed 928000 entries Processed 929000 entries Processed 930000 entries Processed 931000 entries Processed 932000 entries Processed 933000 entries Processed 934000 entries Processed 935000 entries Processed 936000 entries Processed 937000 entries Processed 938000 entries Processed 939000 entries Processed 940000 entries Processed 941000 entries Processed 942000 entries Processed 943000 entries Processed 944000 entries Processed 945000 entries Processed 946000 entries Processed 947000 entries Processed 948000 entries Processed 949000 entries Processed 950000 entries Processed 951000 entries Processed 952000 entries Processed 953000 entries Processed 954000 entries Processed 955000 entries Processed 956000 entries Processed 957000 entries Processed 958000 entries Processed 959000 entries Processed 960000 entries Processed 961000 entries Processed 962000 entries Processed 963000 entries Processed 964000 entries Processed 965000 entries Processed 966000 entries Processed 967000 entries Processed 968000 entries Processed 969000 entries Processed 970000 entries Processed 971000 entries Processed 972000 entries Processed 973000 entries Processed 974000 entries Processed 975000 entries Processed 976000 entries Processed 977000 entries Processed 978000 entries Processed 979000 entries Processed 980000 entries Processed 981000 entries Processed 982000 entries Processed 983000 entries Processed 984000 entries Processed 985000 entries Processed 986000 entries Processed 987000 entries Processed 988000 entries Processed 989000 entries Processed 990000 entries Processed 991000 entries Processed 992000 entries Processed 993000 entries Processed 994000 entries Processed 995000 entries Processed 996000 entries Processed 997000 entries Processed 998000 entries Processed 999000 entries Processed 1000000 entries LDIF processing complete. 1000003 entries written --- stderr --- ________________________________________________________________________________ [20/Sep/2022 01:59:32] MakeUsers_ds-idrepo step6 : Add or Import entries on ds-idrepo pod ________________________________________________________________________________ [loop_until]: kubectl --namespace=xlou exec overseer-0-64c569ddd-slh59 -- /lodestar/clients/ds/bin/ldapsearch -h "ds-idrepo-0.ds-idrepo" -p 1389 --useStartTls --trustAll -D "uid=admin" -w "x7P88geZkPyMduSTUD32ntX8YYsW7y0e" --noPropertiesFile -b "" -s base "(&)" alive [loop_until]: (max_time=60, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- dn: alive: true --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-64c569ddd-slh59 -- /lodestar/clients/ds/bin/ldapmodify -h "ds-idrepo-0.ds-idrepo" -p 1389 --useStartTls --trustAll -D "uid=admin" -w "x7P88geZkPyMduSTUD32ntX8YYsW7y0e" --noPropertiesFile --no-prompt --continueOnError --numConnections 10 /results/ds-idrepo/user_entries.ldif [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- [print_head_tail]: Print head (100 lines) and tail (100 lines) of input string (2000009 lines): ----- output ----- # The LDAP modify request failed: 68 (Entry Already Exists) # Additional Information: The entry ou=identities cannot be added because an entry with that name already exists # The LDAP modify request failed: 68 (Entry Already Exists) # Additional Information: The entry ou=Groups,ou=identities cannot be added because an entry with that name already exists # The LDAP modify request failed: 68 (Entry Already Exists) # Additional Information: The entry ou=People,ou=identities cannot be added because an entry with that name already exists # ADD operation successful for DN fr-idm-uuid=85871e17-d81b-4454-aa55-9a08eb54dcac,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=8d5c8fe7-6796-4cb3-8627-283973a264d5,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=3525a3ee-4265-4824-9d1d-c389575d5896,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=baba2837-e32b-421f-bac2-fe381d1e229b,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=7f994c3f-5651-4094-a1d8-a18371e865d3,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=a7bbef29-f58c-4dc7-8af3-62f9df8ba1f0,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=175d827c-fe71-4f3f-80c1-17909e0ef4da,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=f205145b-ae76-4aa5-ac3b-5a9579af4760,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=8eb1b177-20c3-4027-af38-7b502b3627fd,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=1ae6993c-3a9f-4631-a8b7-b973bd15b023,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=5bff4aa6-e558-4911-a409-9aaba7211ce7,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=f5d14187-0820-4d25-a6da-6afebd5e1fc7,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=0544aa7a-f309-47d2-b397-9d76280b508e,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=c9ef1f7f-bd55-4f01-8ea5-dab544c5ac12,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=8f530986-af71-4f15-ba24-ec6e97bf5d85,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=602d364a-037f-4448-ab16-9a99a686c396,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=2846b704-b415-47e0-8a53-2297b72dc79b,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=246754fe-4d68-431c-a6e5-c244c0baf4ea,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=6230cd45-e7ae-444f-b131-f92d398dc3dc,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=adbaa8ed-bf62-400b-9053-c6f358e344cb,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=eedbdcba-673d-4f59-8aa5-ab7015d487d9,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=309c67f9-921d-4d14-a456-6b053e4136a5,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=30126cff-7a7f-4e5c-9400-5f6dafc51df1,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=d4e66016-7092-484f-9945-0f6e97fc6f84,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=4abd5977-db85-491b-9eac-a75175ddf335,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=b3bb4602-0659-4e25-86b6-c30c81e060a1,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=2c8529f5-f054-4773-aa70-4c9fffe4746d,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=6dab10f6-dafa-47bc-8177-68e9a56bcbdb,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=6216844c-e6f3-450a-aa83-5763d044d2a7,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=dd4877d6-58cd-4713-8878-0a118d4494ae,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=0e431837-abab-477c-b3a5-00b39b9ad361,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=ac12e70c-8042-4fe2-a8dd-d385eba87807,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=2cbf8d4b-a88a-46e8-90af-fe7fb1bc881f,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=7c02bd1d-8029-4402-9b5e-bbd7ad45abdc,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=50836483-fdab-491d-ab7b-238442811268,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=f5fd275a-7912-4a03-a316-02a927f5a00f,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=838baa3c-8818-4038-85f3-7e5e3758d72e,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=3334fccd-b065-4203-937c-bedeac8c0a8e,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=c3b91072-bf48-4fd2-816f-85ec9c2ccc1a,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=344942a6-f640-42a6-8179-1005e71873c8,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=537ae46e-ef4d-4d10-a85d-aaf0bab59a67,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=4f58fc84-ab07-42d9-a963-cf959ae5b787,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=3fe56fcc-4007-4dc7-9788-1b22b9a8a4bd,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=d021d813-01e5-4d13-b47b-9c40a24d82a4,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=5b98b10c-d5c5-4110-beb9-fcecb9e2398d,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=58339056-90a6-4e4f-a747-880492bd2865,ou=People,ou=identities [...] # ADD operation successful for DN fr-idm-uuid=2aaf8503-390b-4ffe-9d25-e86ebdfcf516,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=bba1cbca-946c-40b7-8f8f-ea54ca940264,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=a3b14a86-856a-48b0-a03c-1e7ac739f863,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=1930ed15-eb49-4b4f-8356-209b7f818979,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=33fb8953-3ba2-4619-81dc-9f2e19254907,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=246b8433-fa51-4dea-861a-b4f88a89bcf7,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=f1f5da20-06ac-4b4c-9cb2-28cfb7ed4ea5,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=7e70f3a4-4b4e-44e9-ab83-d8bd0eec934d,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=6e64834d-daff-46d1-848d-6cb0c3669a20,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=72535deb-94a6-4089-833c-fe5e988db29f,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=642a47cc-9cdf-4b0c-b10f-9819a4337896,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=9ea35aaf-213d-401b-baf7-fef937eb536e,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=6a61021f-489b-496f-b925-59d3e8b47d4f,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=33f5b793-ea7f-413d-96e2-4a95c34d04fe,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=7f18686b-23d1-4d4a-97dd-2f61a5be886d,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=ecc3f537-ee11-4601-ba1e-f710a839c215,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=a0a48763-2c68-4227-9f0c-8e5f4439e30b,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=fddacc0e-62f0-48a5-bdf0-f3a3eb1ca04f,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=4ffa890c-0f85-4a9b-8dcd-236286392380,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=72af7951-0079-4c93-93e5-8e42ce74e158,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=1718a938-7700-4b79-80f0-3857c2839218,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=8da21352-e8c7-4622-bfc5-19145cba4840,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=687c5da0-7d0e-471d-a146-a2f86c9ca584,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=d631a3bf-b2ab-4e59-835b-950d2734a382,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=812e2dd4-e099-4c0c-aef5-4722df624d14,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=fea6d7f3-3d2d-4717-b3cb-d22f1ddd275f,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=d6898402-61b9-4430-8da8-8fe7276cf44e,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=1dce25bf-e3e8-4401-abb2-610f7e4ecbd1,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=de85e890-ee0a-444b-80cb-9c6f61f2b4f5,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=00b3ba2d-06aa-400f-952b-ed473b41d366,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=4912356b-38d6-4a96-9770-a772e505592c,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=10e76c47-a7ff-4dd6-9335-179e9df225a4,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=fd6cbc66-693d-4856-9975-772f8585899e,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=331035e5-b25d-4675-865e-40cc26cb147f,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=11f3bd52-0f71-4637-bdff-32d2a584583e,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=9c41d23d-d1a1-48aa-94fd-a074b0f226d6,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=a9faa0f2-73e5-499a-bd97-0552eac098ac,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=0470adf5-8efb-4fc8-b5a6-472aa5b306ce,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=ae338311-4cc9-4d85-bb36-680267039812,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=17105d1c-90fc-45b6-acf5-5eb3fb65af5a,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=c9d7f47e-f8cb-4a8b-a84a-016943d9f859,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=23400378-e5df-4107-81be-1734cd4c9537,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=9b55cdf8-8407-44e6-b49a-c4b16ee278cd,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=bc78acb7-236e-42d3-9f81-99a5a747e09b,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=29c986c7-1259-4943-bfa1-af0a9bddbbb8,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=eb620fce-950b-4110-88cc-0bbd42b78329,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=0c9aedc4-40a3-47bf-83fa-489e51fbad94,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=8b8dbf56-2da8-4e25-878e-9d0584265c0d,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=798b721d-1ed6-479c-a609-a8d041c82dbb,ou=People,ou=identities # ADD operation successful for DN fr-idm-uuid=bb706027-880a-4a96-aede-15694a4dab24,ou=People,ou=identities --- stderr --- ________________________________________________________________________________ [20/Sep/2022 02:09:16] MakeUsers_ds-idrepo post : Post method ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped