2021-03-24T11:54:24.299 INFO:root:teuthology version: 1.1.0-6b3150e9 2021-03-24T11:54:24.301 DEBUG:teuthology.run:Teuthology command: teuthology --name sage-2021-03-24_06:13:24-upgrade:octopus-x-wip-sage-testing-2021-03-23-2309-distro-basic-smithi --verbose --description upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} --archive /home/teuthworker/archive/sage-2021-03-24_06:13:24-upgrade:octopus-x-wip-sage-testing-2021-03-23-2309-distro-basic-smithi/5993444 --owner scheduled_sage@teuthology -- /home/teuthworker/archive/sage-2021-03-24_06:13:24-upgrade:octopus-x-wip-sage-testing-2021-03-23-2309-distro-basic-smithi/5993444/orig.config.yaml 2021-03-24T11:54:24.337 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-03-24T11:54:24.389 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-03-24_06:13:24-upgrade:octopus-x-wip-sage-testing-2021-03-23-2309-distro-basic-smithi/5993444 branch: wip-sage-testing-2021-03-23-2309 description: upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} email: null first_in_suite: false job_id: '5993444' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sage-2021-03-24_06:13:24-upgrade:octopus-x-wip-sage-testing-2021-03-23-2309-distro-basic-smithi nuke-on-error: true overrides: admin_socket: branch: wip-sage-testing-2021-03-23-2309 ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= rgw curl low speed time: 300 rgw data log num shards: 4 rgw md log max shards: 4 rgw sync log trim interval: 0 rgw sync obj etag verify: true setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 666a545dfbb7fc4fe7736e3c0e891b149a8ef286 wait-for-scrub: false ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: branch: octopus sha1: 666a545dfbb7fc4fe7736e3c0e891b149a8ef286 rgw: compression type: random frontend: beast rgw-multisite: realm: is default: true name: test-realm zonegroups: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zonegroup zones: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zone1 - endpoints: - c2.client.0 is_default: true name: test-zone2 - endpoints: - c2.client.1 is_pubsub: true name: test-zone3 rgw-multisite-tests: args: - tests.py - tests_ps.py branch: octopus repo: https://github.com/ceph/ceph.git workunit: branch: wip-sage-testing-2021-03-23-2309 sha1: 666a545dfbb7fc4fe7736e3c0e891b149a8ef286 owner: scheduled_sage@teuthology priority: 80 repo: git://git.ceph.com/ceph-ci.git roles: - - c1.mon.a - c1.mgr.x - c1.osd.0 - c1.osd.1 - c1.osd.2 - c1.client.0 - - c2.mon.a - c2.mgr.x - c2.osd.0 - c2.osd.1 - c2.osd.2 - c2.client.0 - c2.client.1 sha1: 666a545dfbb7fc4fe7736e3c0e891b149a8ef286 sleep_before_teardown: 0 suite: upgrade:octopus-x suite_branch: wip-sage-testing-2021-03-23-2309 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_666a545dfbb7fc4fe7736e3c0e891b149a8ef286/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 666a545dfbb7fc4fe7736e3c0e891b149a8ef286 targets: smithi043.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPhwa3ibD1YBedhMFWy21AHn5O5CkJVIxaAk1movRw/4oSozYwafJi7eXneOBVXVbNhh7vzPlBz0MOSGeHrnB2EJ8Kcr4pX1eow9pYcfIHANjeNCsu691x5o/cFPiU082fvdvUeW3RMzsynsWATcTDPbjTFmx00+67Hl/pdH7QIsdv+SYbYDehzSu/5911Cb7GkyXrXbiVgnch/5puAGqbBWuOHxMctOA90xWHYr7JcVIJuzaD6pbCoBbVCCdVablXMXZQZc9/KUz+ztnh8r8Q9ATlTN97FyxFVI/zRKxHtNECfXooY+wLX7bo9I13pT2PFd4tyfkd63qdwXL+IgPL smithi161.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCaY1KZyL/Eub6ciQOfZ957YbBBCLIP6mYl/DzoNr02jwI6CUBSQdhU639DAVa0JXfjU4NmIQ53icIphzcgIZWp8HkCHbcGAeQpwsKjxSFWU2U3KkrVKypBqJxyF68bdH8Ul6PE6x91xOInzrdV6N3VYfrXLvox4njkEGgNhqGd/oPCtSJJqBc2NWqKolUTcVB/ltzFQPVB0jrjJhVzMMl34PuOPBwCw4pfs0+7Pf4K7Jq+uoZ1RM4rDYojkKB6q50EleDFOA+RZDSHComHd3t/ReRikRCZnb9TXfz4QFLb9q/HqahJcVVdEbH7Dvtq6m1LlC1ZqzFfrtl2ho+yvTbz tasks: - install: null - ceph: cluster: c1 - ceph: cluster: c2 - parallel: - upgrade-task - rgw: c1.client.0: port: 8000 c2.client.0: port: 8000 c2.client.1: port: 8001 - rgw-multisite: null - rgw-multisite-tests: config: reconfigure_delay: 60 teuthology_branch: master teuthology_sha1: 6b3150e9e0aa7ca432e26f31d87920ebd77f3708 timestamp: 2021-03-24_06:13:24 tube: smithi upgrade-task: - install.upgrade: c1.client.0: null c1.mgr.x: null c1.mon.a: null c1.osd.0: null c1.osd.1: null c1.osd.2: null user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.9855 2021-03-24T11:54:24.389 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_666a545dfbb7fc4fe7736e3c0e891b149a8ef286/qa; will attempt to use it 2021-03-24T11:54:24.390 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_666a545dfbb7fc4fe7736e3c0e891b149a8ef286/qa/tasks 2021-03-24T11:54:24.390 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-03-24T11:54:24.392 INFO:teuthology.task.internal:Checking packages... 2021-03-24T11:54:24.393 INFO:teuthology.task.internal:Checking packages skipped, missing os_type 'None' or ceph hash '666a545dfbb7fc4fe7736e3c0e891b149a8ef286' 2021-03-24T11:54:24.393 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-03-24T11:54:24.402 INFO:teuthology.task.internal:no buildpackages task found 2021-03-24T11:54:24.402 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-03-24T11:54:24.432 INFO:teuthology.task.internal:Saving configuration 2021-03-24T11:54:24.446 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-03-24T11:54:24.465 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-24T11:54:24.483 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-24 11:48:35.229013', 'description': '/home/teuthworker/archive/sage-2021-03-24_06:13:24-upgrade:octopus-x-wip-sage-testing-2021-03-23-2309-distro-basic-smithi/5993444', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII2MUsCnIKbdCKg1MGiLTm51nDY26Wz/wWzKVOKSDi5K', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi043.front.sepia.ceph.com'} 2021-03-24T11:54:24.501 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-24 11:48:35.228986', 'description': '/home/teuthworker/archive/sage-2021-03-24_06:13:24-upgrade:octopus-x-wip-sage-testing-2021-03-23-2309-distro-basic-smithi/5993444', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIumk1YPsHbDEsq8+EkE1Uef8L1eo1os7YRuc5aSPOWi', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi161.front.sepia.ceph.com'} 2021-03-24T11:54:24.501 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-03-24T11:54:24.510 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'] 2021-03-24T11:54:24.511 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2021-03-24T11:54:24.511 INFO:teuthology.run_tasks:Running task console_log... 2021-03-24T11:54:24.591 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9b8d9119d8>, signals=[15]) 2021-03-24T11:54:24.593 INFO:teuthology.run_tasks:Running task internal.connect... 2021-03-24T11:54:24.603 INFO:teuthology.task.internal:Opening connections... 2021-03-24T11:54:24.604 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2021-03-24T11:54:24.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-24T11:54:24.682 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2021-03-24T11:54:24.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-24T11:54:24.757 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-03-24T11:54:24.767 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2021-03-24T11:54:24.839 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2021-03-24T11:54:24.840 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2021-03-24T11:54:24.886 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Ubuntu" 2021-03-24T11:54:24.887 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-03-24T11:54:24.887 INFO:teuthology.orchestra.run.smithi043.stdout:ID=ubuntu 2021-03-24T11:54:24.887 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE=debian 2021-03-24T11:54:24.888 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-03-24T11:54:24.888 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="18.04" 2021-03-24T11:54:24.888 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-24T11:54:24.888 INFO:teuthology.orchestra.run.smithi043.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-24T11:54:24.889 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-24T11:54:24.889 INFO:teuthology.orchestra.run.smithi043.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-24T11:54:24.889 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_CODENAME=bionic 2021-03-24T11:54:24.889 INFO:teuthology.orchestra.run.smithi043.stdout:UBUNTU_CODENAME=bionic 2021-03-24T11:54:24.890 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2021-03-24T11:54:24.911 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2021-03-24T11:54:24.916 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2021-03-24T11:54:24.917 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2021-03-24T11:54:24.963 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2021-03-24T11:54:24.963 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-03-24T11:54:24.964 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2021-03-24T11:54:24.964 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2021-03-24T11:54:24.965 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-03-24T11:54:24.965 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="18.04" 2021-03-24T11:54:24.966 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-24T11:54:24.966 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-24T11:54:24.966 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-24T11:54:24.967 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-24T11:54:24.967 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=bionic 2021-03-24T11:54:24.967 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=bionic 2021-03-24T11:54:24.968 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2021-03-24T11:54:24.986 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-03-24T11:54:25.000 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-03-24T11:54:25.027 INFO:teuthology.task.internal:Checking for old test directory... 2021-03-24T11:54:25.028 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2021-03-24T11:54:25.030 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2021-03-24T11:54:25.036 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-03-24T11:54:25.055 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-03-24T11:54:25.055 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2021-03-24T11:54:25.079 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2021-03-24T11:54:25.095 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-03-24T11:54:25.146 INFO:teuthology.run_tasks:Running task kernel... 2021-03-24T11:54:25.165 DEBUG:teuthology.task.kernel:normalized config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c1.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.0': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.1': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.2': {'kdb': True, 'sha1': 'distro'}, 'c1.client.0': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.0': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.1': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.2': {'kdb': True, 'sha1': 'distro'}, 'c2.client.0': {'kdb': True, 'sha1': 'distro'}, 'c2.client.1': {'kdb': True, 'sha1': 'distro'}} 2021-03-24T11:54:25.166 INFO:teuthology.task.kernel:config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-03-24T11:54:25.167 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2021-03-24T11:54:25.173 INFO:teuthology.orchestra.run.smithi043.stdout:4.15.0-136-generic 2021-03-24T11:54:25.174 INFO:teuthology.task.kernel:Running kernel on smithi043: 4.15.0-136-generic 2021-03-24T11:54:25.175 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get clean 2021-03-24T11:54:25.277 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get update 2021-03-24T11:54:25.537 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-03-24T11:54:25.537 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-03-24T11:54:25.602 INFO:teuthology.orchestra.run.smithi043.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-03-24T11:54:25.893 INFO:teuthology.orchestra.run.smithi043.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-03-24T11:54:25.970 INFO:teuthology.orchestra.run.smithi043.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,627 kB] 2021-03-24T11:54:26.112 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,967 kB] 2021-03-24T11:54:26.437 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [946 kB] 2021-03-24T11:54:26.455 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [309 kB] 2021-03-24T11:54:26.460 INFO:teuthology.orchestra.run.smithi043.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [261 kB] 2021-03-24T11:54:26.465 INFO:teuthology.orchestra.run.smithi043.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [17.7 kB] 2021-03-24T11:54:26.465 INFO:teuthology.orchestra.run.smithi043.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [34.1 kB] 2021-03-24T11:54:26.466 INFO:teuthology.orchestra.run.smithi043.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,116 kB] 2021-03-24T11:54:26.532 INFO:teuthology.orchestra.run.smithi043.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,249 kB] 2021-03-24T11:54:26.548 INFO:teuthology.orchestra.run.smithi043.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [979 kB] 2021-03-24T11:54:26.570 INFO:teuthology.orchestra.run.smithi043.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [400 kB] 2021-03-24T11:54:26.571 INFO:teuthology.orchestra.run.smithi043.stdout:Get:16 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [250 kB] 2021-03-24T11:54:26.577 INFO:teuthology.orchestra.run.smithi043.stdout:Get:17 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [6,480 B] 2021-03-24T11:54:26.577 INFO:teuthology.orchestra.run.smithi043.stdout:Get:18 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [19.1 kB] 2021-03-24T11:54:26.578 INFO:teuthology.orchestra.run.smithi043.stdout:Get:19 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [4,412 B] 2021-03-24T11:54:26.582 INFO:teuthology.orchestra.run.smithi043.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [24.3 kB] 2021-03-24T11:54:26.583 INFO:teuthology.orchestra.run.smithi043.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [282 kB] 2021-03-24T11:54:26.591 INFO:teuthology.orchestra.run.smithi043.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [37.7 kB] 2021-03-24T11:54:26.592 INFO:teuthology.orchestra.run.smithi043.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,562 kB] 2021-03-24T11:54:26.656 INFO:teuthology.orchestra.run.smithi043.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,723 kB] 2021-03-24T11:54:26.696 INFO:teuthology.orchestra.run.smithi043.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [365 kB] 2021-03-24T11:54:26.702 INFO:teuthology.orchestra.run.smithi043.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [11.6 kB] 2021-03-24T11:54:26.704 INFO:teuthology.orchestra.run.smithi043.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [24.9 kB] 2021-03-24T11:54:26.718 INFO:teuthology.orchestra.run.smithi043.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [6,464 B] 2021-03-24T11:54:28.296 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 13.5 MB in 3s (4,805 kB/s) 2021-03-24T11:54:29.748 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2021-03-24T11:54:29.795 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-03-24T11:54:29.874 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2021-03-24T11:54:30.126 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2021-03-24T11:54:30.127 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2021-03-24T11:54:30.218 INFO:teuthology.orchestra.run.smithi043.stderr:E: Unable to locate package linux-image-current-generic 2021-03-24T11:54:30.220 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-03-24T11:54:30.221 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-03-24T11:54:30.303 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2021-03-24T11:54:30.576 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2021-03-24T11:54:30.577 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2021-03-24T11:54:30.770 INFO:teuthology.orchestra.run.smithi043.stdout:The following additional packages will be installed: 2021-03-24T11:54:30.770 INFO:teuthology.orchestra.run.smithi043.stdout: linux-generic linux-headers-4.15.0-139 linux-headers-4.15.0-139-generic 2021-03-24T11:54:30.770 INFO:teuthology.orchestra.run.smithi043.stdout: linux-headers-generic linux-image-4.15.0-139-generic 2021-03-24T11:54:30.771 INFO:teuthology.orchestra.run.smithi043.stdout: linux-modules-4.15.0-139-generic linux-modules-extra-4.15.0-139-generic 2021-03-24T11:54:30.772 INFO:teuthology.orchestra.run.smithi043.stdout:Suggested packages: 2021-03-24T11:54:30.772 INFO:teuthology.orchestra.run.smithi043.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2021-03-24T11:54:30.772 INFO:teuthology.orchestra.run.smithi043.stdout:Recommended packages: 2021-03-24T11:54:30.773 INFO:teuthology.orchestra.run.smithi043.stdout: thermald 2021-03-24T11:54:30.807 INFO:teuthology.orchestra.run.smithi043.stdout:The following NEW packages will be installed: 2021-03-24T11:54:30.807 INFO:teuthology.orchestra.run.smithi043.stdout: linux-headers-4.15.0-139 linux-headers-4.15.0-139-generic 2021-03-24T11:54:30.807 INFO:teuthology.orchestra.run.smithi043.stdout: linux-image-4.15.0-139-generic linux-modules-4.15.0-139-generic 2021-03-24T11:54:30.808 INFO:teuthology.orchestra.run.smithi043.stdout: linux-modules-extra-4.15.0-139-generic 2021-03-24T11:54:30.809 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages will be upgraded: 2021-03-24T11:54:30.809 INFO:teuthology.orchestra.run.smithi043.stdout: linux-generic linux-headers-generic linux-image-generic 2021-03-24T11:54:30.989 INFO:teuthology.orchestra.run.smithi043.stdout:3 upgraded, 5 newly installed, 0 to remove and 28 not upgraded. 2021-03-24T11:54:30.989 INFO:teuthology.orchestra.run.smithi043.stdout:Need to get 66.0 MB of archives. 2021-03-24T11:54:30.990 INFO:teuthology.orchestra.run.smithi043.stdout:After this operation, 334 MB of additional disk space will be used. 2021-03-24T11:54:30.990 INFO:teuthology.orchestra.run.smithi043.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-139-generic amd64 4.15.0-139.143 [13.1 MB] 2021-03-24T11:54:31.995 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-139-generic amd64 4.15.0-139.143 [8,021 kB] 2021-03-24T11:54:32.236 INFO:teuthology.orchestra.run.smithi043.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-139-generic amd64 4.15.0-139.143 [32.8 MB] 2021-03-24T11:54:33.221 INFO:teuthology.orchestra.run.smithi043.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.139.126 [1,868 B] 2021-03-24T11:54:33.221 INFO:teuthology.orchestra.run.smithi043.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.139.126 [2,572 B] 2021-03-24T11:54:33.222 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-139 all 4.15.0-139.143 [10.9 MB] 2021-03-24T11:54:33.538 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-139-generic amd64 4.15.0-139.143 [1,101 kB] 2021-03-24T11:54:33.554 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.139.126 [2,468 B] 2021-03-24T11:54:34.057 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 66.0 MB in 3s (24.2 MB/s) 2021-03-24T11:54:34.226 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-modules-4.15.0-139-generic. 2021-03-24T11:54:34.264 INFO:teuthology.orchestra.run.smithi043.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102065 files and directories currently installed.) 2021-03-24T11:54:34.267 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../0-linux-modules-4.15.0-139-generic_4.15.0-139.143_amd64.deb ... 2021-03-24T11:54:34.323 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-modules-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:54:36.131 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-image-4.15.0-139-generic. 2021-03-24T11:54:36.143 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../1-linux-image-4.15.0-139-generic_4.15.0-139.143_amd64.deb ... 2021-03-24T11:54:36.243 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-image-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:54:36.767 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-139-generic. 2021-03-24T11:54:36.779 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-139-generic_4.15.0-139.143_amd64.deb ... 2021-03-24T11:54:36.842 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-modules-extra-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:54:40.582 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../3-linux-generic_4.15.0.139.126_amd64.deb ... 2021-03-24T11:54:40.798 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-generic (4.15.0.139.126) over (4.15.0.136.123) ... 2021-03-24T11:54:41.109 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.139.126_amd64.deb ... 2021-03-24T11:54:41.230 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-image-generic (4.15.0.139.126) over (4.15.0.136.123) ... 2021-03-24T11:54:41.566 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-headers-4.15.0-139. 2021-03-24T11:54:41.576 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../5-linux-headers-4.15.0-139_4.15.0-139.143_all.deb ... 2021-03-24T11:54:41.616 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-headers-4.15.0-139 (4.15.0-139.143) ... 2021-03-24T11:54:46.305 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-headers-4.15.0-139-generic. 2021-03-24T11:54:46.323 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../6-linux-headers-4.15.0-139-generic_4.15.0-139.143_amd64.deb ... 2021-03-24T11:54:46.363 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-headers-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:54:48.812 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.139.126_amd64.deb ... 2021-03-24T11:54:48.920 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-headers-generic (4.15.0.139.126) over (4.15.0.136.123) ... 2021-03-24T11:54:49.258 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-modules-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:54:49.833 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-headers-4.15.0-139 (4.15.0-139.143) ... 2021-03-24T11:54:49.976 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-headers-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:54:50.102 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-image-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:54:50.574 INFO:teuthology.orchestra.run.smithi043.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-139-generic 2021-03-24T11:54:50.574 INFO:teuthology.orchestra.run.smithi043.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-139-generic 2021-03-24T11:54:50.704 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-modules-extra-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:54:51.197 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-headers-generic (4.15.0.139.126) ... 2021-03-24T11:54:51.323 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-image-generic (4.15.0.139.126) ... 2021-03-24T11:54:51.458 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-generic (4.15.0.139.126) ... 2021-03-24T11:54:51.584 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for linux-image-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:54:51.791 INFO:teuthology.orchestra.run.smithi043.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-03-24T11:54:51.792 INFO:teuthology.orchestra.run.smithi043.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-139-generic 2021-03-24T11:55:07.125 INFO:teuthology.orchestra.run.smithi043.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-03-24T11:55:07.125 INFO:teuthology.orchestra.run.smithi043.stdout:Sourcing file `/etc/default/grub' 2021-03-24T11:55:07.160 INFO:teuthology.orchestra.run.smithi043.stdout:Generating grub configuration file ... 2021-03-24T11:55:07.544 INFO:teuthology.orchestra.run.smithi043.stdout:Found linux image: /boot/vmlinuz-4.15.0-139-generic 2021-03-24T11:55:07.583 INFO:teuthology.orchestra.run.smithi043.stdout:Found initrd image: /boot/initrd.img-4.15.0-139-generic 2021-03-24T11:55:08.007 INFO:teuthology.orchestra.run.smithi043.stdout:Found linux image: /boot/vmlinuz-4.15.0-136-generic 2021-03-24T11:55:08.042 INFO:teuthology.orchestra.run.smithi043.stdout:Found initrd image: /boot/initrd.img-4.15.0-136-generic 2021-03-24T11:55:09.941 INFO:teuthology.orchestra.run.smithi043.stdout:done 2021-03-24T11:55:10.362 DEBUG:teuthology.orchestra.run.smithi043:> dpkg -s linux-image-generic 2021-03-24T11:55:10.385 INFO:teuthology.orchestra.run.smithi043.stdout:Package: linux-image-generic 2021-03-24T11:55:10.385 INFO:teuthology.orchestra.run.smithi043.stdout:Status: install ok installed 2021-03-24T11:55:10.386 INFO:teuthology.orchestra.run.smithi043.stdout:Priority: optional 2021-03-24T11:55:10.386 INFO:teuthology.orchestra.run.smithi043.stdout:Section: kernel 2021-03-24T11:55:10.386 INFO:teuthology.orchestra.run.smithi043.stdout:Installed-Size: 17 2021-03-24T11:55:10.387 INFO:teuthology.orchestra.run.smithi043.stdout:Maintainer: Ubuntu Kernel Team 2021-03-24T11:55:10.387 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: amd64 2021-03-24T11:55:10.387 INFO:teuthology.orchestra.run.smithi043.stdout:Source: linux-meta 2021-03-24T11:55:10.387 INFO:teuthology.orchestra.run.smithi043.stdout:Version: 4.15.0.139.126 2021-03-24T11:55:10.388 INFO:teuthology.orchestra.run.smithi043.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-03-24T11:55:10.388 INFO:teuthology.orchestra.run.smithi043.stdout:Depends: linux-image-4.15.0-139-generic, linux-modules-extra-4.15.0-139-generic, linux-firmware, intel-microcode, amd64-microcode 2021-03-24T11:55:10.388 INFO:teuthology.orchestra.run.smithi043.stdout:Recommends: thermald 2021-03-24T11:55:10.388 INFO:teuthology.orchestra.run.smithi043.stdout:Description: Generic Linux kernel image 2021-03-24T11:55:10.389 INFO:teuthology.orchestra.run.smithi043.stdout: This package will always depend on the latest generic kernel image 2021-03-24T11:55:10.389 INFO:teuthology.orchestra.run.smithi043.stdout: available. 2021-03-24T11:55:10.389 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-136-generic Expected: 4.15.0-139-generic 2021-03-24T11:55:10.390 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2021-03-24T11:55:10.397 INFO:teuthology.orchestra.run.smithi161.stdout:4.15.0-136-generic 2021-03-24T11:55:10.397 INFO:teuthology.task.kernel:Running kernel on smithi161: 4.15.0-136-generic 2021-03-24T11:55:10.398 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get clean 2021-03-24T11:55:10.523 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2021-03-24T11:55:10.652 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-03-24T11:55:10.777 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-03-24T11:55:10.858 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-03-24T11:55:10.905 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,627 kB] 2021-03-24T11:55:11.017 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [946 kB] 2021-03-24T11:55:11.032 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [309 kB] 2021-03-24T11:55:11.036 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [17.7 kB] 2021-03-24T11:55:11.036 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [261 kB] 2021-03-24T11:55:11.038 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [34.1 kB] 2021-03-24T11:55:11.039 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [979 kB] 2021-03-24T11:55:11.048 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,116 kB] 2021-03-24T11:55:11.059 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [250 kB] 2021-03-24T11:55:11.062 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [19.1 kB] 2021-03-24T11:55:11.062 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [6,480 B] 2021-03-24T11:55:11.062 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [4,412 B] 2021-03-24T11:55:11.161 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-03-24T11:55:11.301 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,967 kB] 2021-03-24T11:55:11.655 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,249 kB] 2021-03-24T11:55:11.712 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [400 kB] 2021-03-24T11:55:11.725 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [24.3 kB] 2021-03-24T11:55:11.725 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [282 kB] 2021-03-24T11:55:11.734 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [37.7 kB] 2021-03-24T11:55:11.735 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,723 kB] 2021-03-24T11:55:11.775 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,562 kB] 2021-03-24T11:55:11.822 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [365 kB] 2021-03-24T11:55:11.828 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [11.6 kB] 2021-03-24T11:55:11.830 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [24.9 kB] 2021-03-24T11:55:11.830 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [6,464 B] 2021-03-24T11:55:12.822 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 13.5 MB in 2s (6,463 kB/s) 2021-03-24T11:55:14.254 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2021-03-24T11:55:14.299 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-03-24T11:55:14.376 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2021-03-24T11:55:14.634 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2021-03-24T11:55:14.635 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2021-03-24T11:55:14.716 INFO:teuthology.orchestra.run.smithi161.stderr:E: Unable to locate package linux-image-current-generic 2021-03-24T11:55:14.717 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-03-24T11:55:14.718 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-03-24T11:55:14.792 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2021-03-24T11:55:15.024 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2021-03-24T11:55:15.024 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2021-03-24T11:55:15.202 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2021-03-24T11:55:15.203 INFO:teuthology.orchestra.run.smithi161.stdout: linux-generic linux-headers-4.15.0-139 linux-headers-4.15.0-139-generic 2021-03-24T11:55:15.203 INFO:teuthology.orchestra.run.smithi161.stdout: linux-headers-generic linux-image-4.15.0-139-generic 2021-03-24T11:55:15.203 INFO:teuthology.orchestra.run.smithi161.stdout: linux-modules-4.15.0-139-generic linux-modules-extra-4.15.0-139-generic 2021-03-24T11:55:15.204 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2021-03-24T11:55:15.205 INFO:teuthology.orchestra.run.smithi161.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2021-03-24T11:55:15.205 INFO:teuthology.orchestra.run.smithi161.stdout:Recommended packages: 2021-03-24T11:55:15.205 INFO:teuthology.orchestra.run.smithi161.stdout: thermald 2021-03-24T11:55:15.240 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2021-03-24T11:55:15.240 INFO:teuthology.orchestra.run.smithi161.stdout: linux-headers-4.15.0-139 linux-headers-4.15.0-139-generic 2021-03-24T11:55:15.240 INFO:teuthology.orchestra.run.smithi161.stdout: linux-image-4.15.0-139-generic linux-modules-4.15.0-139-generic 2021-03-24T11:55:15.241 INFO:teuthology.orchestra.run.smithi161.stdout: linux-modules-extra-4.15.0-139-generic 2021-03-24T11:55:15.242 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages will be upgraded: 2021-03-24T11:55:15.242 INFO:teuthology.orchestra.run.smithi161.stdout: linux-generic linux-headers-generic linux-image-generic 2021-03-24T11:55:15.422 INFO:teuthology.orchestra.run.smithi161.stdout:3 upgraded, 5 newly installed, 0 to remove and 28 not upgraded. 2021-03-24T11:55:15.422 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 66.0 MB of archives. 2021-03-24T11:55:15.422 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 334 MB of additional disk space will be used. 2021-03-24T11:55:15.423 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-139-generic amd64 4.15.0-139.143 [13.1 MB] 2021-03-24T11:55:16.455 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-139-generic amd64 4.15.0-139.143 [8,021 kB] 2021-03-24T11:55:16.703 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-139-generic amd64 4.15.0-139.143 [32.8 MB] 2021-03-24T11:55:17.637 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.139.126 [1,868 B] 2021-03-24T11:55:17.638 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.139.126 [2,572 B] 2021-03-24T11:55:17.638 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-139 all 4.15.0-139.143 [10.9 MB] 2021-03-24T11:55:17.942 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-139-generic amd64 4.15.0-139.143 [1,101 kB] 2021-03-24T11:55:17.979 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.139.126 [2,468 B] 2021-03-24T11:55:18.440 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 66.0 MB in 3s (24.3 MB/s) 2021-03-24T11:55:18.604 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-modules-4.15.0-139-generic. 2021-03-24T11:55:18.642 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102065 files and directories currently installed.) 2021-03-24T11:55:18.645 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../0-linux-modules-4.15.0-139-generic_4.15.0-139.143_amd64.deb ... 2021-03-24T11:55:18.692 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-modules-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:55:20.341 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-image-4.15.0-139-generic. 2021-03-24T11:55:20.495 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../1-linux-image-4.15.0-139-generic_4.15.0-139.143_amd64.deb ... 2021-03-24T11:55:20.495 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-image-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:55:20.986 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-139-generic. 2021-03-24T11:55:20.998 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-139-generic_4.15.0-139.143_amd64.deb ... 2021-03-24T11:55:21.036 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-modules-extra-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:55:24.765 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../3-linux-generic_4.15.0.139.126_amd64.deb ... 2021-03-24T11:55:24.893 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-generic (4.15.0.139.126) over (4.15.0.136.123) ... 2021-03-24T11:55:25.192 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.139.126_amd64.deb ... 2021-03-24T11:55:25.314 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-image-generic (4.15.0.139.126) over (4.15.0.136.123) ... 2021-03-24T11:55:25.641 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-headers-4.15.0-139. 2021-03-24T11:55:25.653 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../5-linux-headers-4.15.0-139_4.15.0-139.143_all.deb ... 2021-03-24T11:55:25.691 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-4.15.0-139 (4.15.0-139.143) ... 2021-03-24T11:55:30.213 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-headers-4.15.0-139-generic. 2021-03-24T11:55:30.235 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../6-linux-headers-4.15.0-139-generic_4.15.0-139.143_amd64.deb ... 2021-03-24T11:55:30.279 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:55:32.644 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.139.126_amd64.deb ... 2021-03-24T11:55:32.760 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-generic (4.15.0.139.126) over (4.15.0.136.123) ... 2021-03-24T11:55:33.100 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-modules-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:55:33.690 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-4.15.0-139 (4.15.0-139.143) ... 2021-03-24T11:55:33.816 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:55:33.942 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-image-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:55:34.393 INFO:teuthology.orchestra.run.smithi161.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-139-generic 2021-03-24T11:55:34.394 INFO:teuthology.orchestra.run.smithi161.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-139-generic 2021-03-24T11:55:34.527 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-modules-extra-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:55:34.995 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-generic (4.15.0.139.126) ... 2021-03-24T11:55:35.146 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-image-generic (4.15.0.139.126) ... 2021-03-24T11:55:35.272 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-generic (4.15.0.139.126) ... 2021-03-24T11:55:35.398 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for linux-image-4.15.0-139-generic (4.15.0-139.143) ... 2021-03-24T11:55:35.600 INFO:teuthology.orchestra.run.smithi161.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-03-24T11:55:35.600 INFO:teuthology.orchestra.run.smithi161.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-139-generic 2021-03-24T11:55:50.779 INFO:teuthology.orchestra.run.smithi161.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-03-24T11:55:50.780 INFO:teuthology.orchestra.run.smithi161.stdout:Sourcing file `/etc/default/grub' 2021-03-24T11:55:50.814 INFO:teuthology.orchestra.run.smithi161.stdout:Generating grub configuration file ... 2021-03-24T11:55:51.188 INFO:teuthology.orchestra.run.smithi161.stdout:Found linux image: /boot/vmlinuz-4.15.0-139-generic 2021-03-24T11:55:51.246 INFO:teuthology.orchestra.run.smithi161.stdout:Found initrd image: /boot/initrd.img-4.15.0-139-generic 2021-03-24T11:55:51.581 INFO:teuthology.orchestra.run.smithi161.stdout:Found linux image: /boot/vmlinuz-4.15.0-136-generic 2021-03-24T11:55:51.617 INFO:teuthology.orchestra.run.smithi161.stdout:Found initrd image: /boot/initrd.img-4.15.0-136-generic 2021-03-24T11:55:53.268 INFO:teuthology.orchestra.run.smithi161.stdout:done 2021-03-24T11:55:53.671 DEBUG:teuthology.orchestra.run.smithi161:> dpkg -s linux-image-generic 2021-03-24T11:55:53.694 INFO:teuthology.orchestra.run.smithi161.stdout:Package: linux-image-generic 2021-03-24T11:55:53.694 INFO:teuthology.orchestra.run.smithi161.stdout:Status: install ok installed 2021-03-24T11:55:53.695 INFO:teuthology.orchestra.run.smithi161.stdout:Priority: optional 2021-03-24T11:55:53.695 INFO:teuthology.orchestra.run.smithi161.stdout:Section: kernel 2021-03-24T11:55:53.696 INFO:teuthology.orchestra.run.smithi161.stdout:Installed-Size: 17 2021-03-24T11:55:53.696 INFO:teuthology.orchestra.run.smithi161.stdout:Maintainer: Ubuntu Kernel Team 2021-03-24T11:55:53.697 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: amd64 2021-03-24T11:55:53.697 INFO:teuthology.orchestra.run.smithi161.stdout:Source: linux-meta 2021-03-24T11:55:53.698 INFO:teuthology.orchestra.run.smithi161.stdout:Version: 4.15.0.139.126 2021-03-24T11:55:53.698 INFO:teuthology.orchestra.run.smithi161.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-03-24T11:55:53.699 INFO:teuthology.orchestra.run.smithi161.stdout:Depends: linux-image-4.15.0-139-generic, linux-modules-extra-4.15.0-139-generic, linux-firmware, intel-microcode, amd64-microcode 2021-03-24T11:55:53.699 INFO:teuthology.orchestra.run.smithi161.stdout:Recommends: thermald 2021-03-24T11:55:53.700 INFO:teuthology.orchestra.run.smithi161.stdout:Description: Generic Linux kernel image 2021-03-24T11:55:53.700 INFO:teuthology.orchestra.run.smithi161.stdout: This package will always depend on the latest generic kernel image 2021-03-24T11:55:53.700 INFO:teuthology.orchestra.run.smithi161.stdout: available. 2021-03-24T11:55:53.701 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-136-generic Expected: 4.15.0-139-generic 2021-03-24T11:55:53.702 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-03-24T11:55:53.702 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-03-24T11:55:53.703 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-03-24T11:55:53.703 INFO:teuthology.task.kernel:Installing distro kernel on c1.mon.a... 2021-03-24T11:55:53.704 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi043.front.sepia.ceph.com, path=None, version=distro) 2021-03-24T11:55:53.704 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get clean 2021-03-24T11:55:53.779 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get update 2021-03-24T11:55:54.039 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-03-24T11:55:54.040 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:2 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-03-24T11:55:54.109 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-03-24T11:55:54.188 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-03-24T11:55:55.990 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2021-03-24T11:55:56.038 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-03-24T11:55:56.133 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2021-03-24T11:55:56.378 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2021-03-24T11:55:56.379 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2021-03-24T11:55:56.467 INFO:teuthology.orchestra.run.smithi043.stderr:E: Unable to locate package linux-image-current-generic 2021-03-24T11:55:56.468 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-03-24T11:55:56.469 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-03-24T11:55:56.550 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2021-03-24T11:55:56.838 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2021-03-24T11:55:56.839 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2021-03-24T11:55:57.052 INFO:teuthology.orchestra.run.smithi043.stdout:linux-image-generic is already the newest version (4.15.0.139.126). 2021-03-24T11:55:57.053 INFO:teuthology.orchestra.run.smithi043.stdout:0 upgraded, 0 newly installed, 0 to remove and 28 not upgraded. 2021-03-24T11:55:57.055 DEBUG:teuthology.orchestra.run.smithi043:> dpkg -s linux-image-generic 2021-03-24T11:55:57.075 INFO:teuthology.orchestra.run.smithi043.stdout:Package: linux-image-generic 2021-03-24T11:55:57.076 INFO:teuthology.orchestra.run.smithi043.stdout:Status: install ok installed 2021-03-24T11:55:57.076 INFO:teuthology.orchestra.run.smithi043.stdout:Priority: optional 2021-03-24T11:55:57.076 INFO:teuthology.orchestra.run.smithi043.stdout:Section: kernel 2021-03-24T11:55:57.076 INFO:teuthology.orchestra.run.smithi043.stdout:Installed-Size: 17 2021-03-24T11:55:57.076 INFO:teuthology.orchestra.run.smithi043.stdout:Maintainer: Ubuntu Kernel Team 2021-03-24T11:55:57.077 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: amd64 2021-03-24T11:55:57.077 INFO:teuthology.orchestra.run.smithi043.stdout:Source: linux-meta 2021-03-24T11:55:57.077 INFO:teuthology.orchestra.run.smithi043.stdout:Version: 4.15.0.139.126 2021-03-24T11:55:57.077 INFO:teuthology.orchestra.run.smithi043.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-03-24T11:55:57.078 INFO:teuthology.orchestra.run.smithi043.stdout:Depends: linux-image-4.15.0-139-generic, linux-modules-extra-4.15.0-139-generic, linux-firmware, intel-microcode, amd64-microcode 2021-03-24T11:55:57.078 INFO:teuthology.orchestra.run.smithi043.stdout:Recommends: thermald 2021-03-24T11:55:57.078 INFO:teuthology.orchestra.run.smithi043.stdout:Description: Generic Linux kernel image 2021-03-24T11:55:57.078 INFO:teuthology.orchestra.run.smithi043.stdout: This package will always depend on the latest generic kernel image 2021-03-24T11:55:57.079 INFO:teuthology.orchestra.run.smithi043.stdout: available. 2021-03-24T11:55:57.079 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2021-03-24T11:55:57.123 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.piOlLHsV7q 2021-03-24T11:55:57.124 DEBUG:teuthology.orchestra.run.smithi043:> sudo cp /boot/grub/grub.cfg /tmp/tmp.piOlLHsV7q 2021-03-24T11:55:57.192 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.piOlLHsV7q 2021-03-24T11:55:57.309 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.piOlLHsV7q is 8KB 2021-03-24T11:55:57.360 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.piOlLHsV7q 2021-03-24T11:55:57.366 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-03-24T11:55:57.425 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T11:55:57.426 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-03-24T11:55:57.426 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-03-24T11:55:57.507 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-139-generic 2021-03-24T11:55:57.507 DEBUG:teuthology.orchestra.run.smithi043:> sudo update-grub 2021-03-24T11:55:58.808 INFO:teuthology.orchestra.run.smithi043.stderr:Sourcing file `/etc/default/grub' 2021-03-24T11:55:58.828 INFO:teuthology.orchestra.run.smithi043.stderr:Generating grub configuration file ... 2021-03-24T11:55:59.139 INFO:teuthology.orchestra.run.smithi043.stderr:Found linux image: /boot/vmlinuz-4.15.0-139-generic 2021-03-24T11:55:59.150 INFO:teuthology.orchestra.run.smithi043.stderr:Found initrd image: /boot/initrd.img-4.15.0-139-generic 2021-03-24T11:55:59.472 INFO:teuthology.orchestra.run.smithi043.stderr:Found linux image: /boot/vmlinuz-4.15.0-136-generic 2021-03-24T11:55:59.486 INFO:teuthology.orchestra.run.smithi043.stderr:Found initrd image: /boot/initrd.img-4.15.0-136-generic 2021-03-24T11:56:00.712 INFO:teuthology.orchestra.run.smithi043.stderr:done 2021-03-24T11:56:00.713 DEBUG:teuthology.orchestra.run.smithi043:> sudo shutdown -r now 2021-03-24T11:56:00.716 INFO:teuthology.task.kernel:Installing distro kernel on c2.mon.a... 2021-03-24T11:56:00.716 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi161.front.sepia.ceph.com, path=None, version=distro) 2021-03-24T11:56:00.717 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get clean 2021-03-24T11:56:00.788 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2021-03-24T11:56:00.920 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-03-24T11:56:01.037 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-03-24T11:56:01.116 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-03-24T11:56:01.196 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-03-24T11:56:02.782 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2021-03-24T11:56:02.829 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-03-24T11:56:02.907 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2021-03-24T11:56:03.143 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2021-03-24T11:56:03.144 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2021-03-24T11:56:03.225 INFO:teuthology.orchestra.run.smithi161.stderr:E: Unable to locate package linux-image-current-generic 2021-03-24T11:56:03.227 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-03-24T11:56:03.228 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-03-24T11:56:03.303 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2021-03-24T11:56:03.537 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2021-03-24T11:56:03.538 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2021-03-24T11:56:03.740 INFO:teuthology.orchestra.run.smithi161.stdout:linux-image-generic is already the newest version (4.15.0.139.126). 2021-03-24T11:56:03.740 INFO:teuthology.orchestra.run.smithi161.stdout:0 upgraded, 0 newly installed, 0 to remove and 28 not upgraded. 2021-03-24T11:56:03.742 DEBUG:teuthology.orchestra.run.smithi161:> dpkg -s linux-image-generic 2021-03-24T11:56:03.764 INFO:teuthology.orchestra.run.smithi161.stdout:Package: linux-image-generic 2021-03-24T11:56:03.765 INFO:teuthology.orchestra.run.smithi161.stdout:Status: install ok installed 2021-03-24T11:56:03.765 INFO:teuthology.orchestra.run.smithi161.stdout:Priority: optional 2021-03-24T11:56:03.765 INFO:teuthology.orchestra.run.smithi161.stdout:Section: kernel 2021-03-24T11:56:03.766 INFO:teuthology.orchestra.run.smithi161.stdout:Installed-Size: 17 2021-03-24T11:56:03.766 INFO:teuthology.orchestra.run.smithi161.stdout:Maintainer: Ubuntu Kernel Team 2021-03-24T11:56:03.766 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: amd64 2021-03-24T11:56:03.766 INFO:teuthology.orchestra.run.smithi161.stdout:Source: linux-meta 2021-03-24T11:56:03.767 INFO:teuthology.orchestra.run.smithi161.stdout:Version: 4.15.0.139.126 2021-03-24T11:56:03.767 INFO:teuthology.orchestra.run.smithi161.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-03-24T11:56:03.767 INFO:teuthology.orchestra.run.smithi161.stdout:Depends: linux-image-4.15.0-139-generic, linux-modules-extra-4.15.0-139-generic, linux-firmware, intel-microcode, amd64-microcode 2021-03-24T11:56:03.767 INFO:teuthology.orchestra.run.smithi161.stdout:Recommends: thermald 2021-03-24T11:56:03.768 INFO:teuthology.orchestra.run.smithi161.stdout:Description: Generic Linux kernel image 2021-03-24T11:56:03.768 INFO:teuthology.orchestra.run.smithi161.stdout: This package will always depend on the latest generic kernel image 2021-03-24T11:56:03.768 INFO:teuthology.orchestra.run.smithi161.stdout: available. 2021-03-24T11:56:03.769 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2021-03-24T11:56:03.812 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.2fs7I95MS5 2021-03-24T11:56:03.813 DEBUG:teuthology.orchestra.run.smithi161:> sudo cp /boot/grub/grub.cfg /tmp/tmp.2fs7I95MS5 2021-03-24T11:56:03.877 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.2fs7I95MS5 2021-03-24T11:56:03.993 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.2fs7I95MS5 is 8KB 2021-03-24T11:56:04.006 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.2fs7I95MS5 2021-03-24T11:56:04.013 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-03-24T11:56:04.069 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T11:56:04.070 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-03-24T11:56:04.070 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-03-24T11:56:04.152 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-139-generic 2021-03-24T11:56:04.153 DEBUG:teuthology.orchestra.run.smithi161:> sudo update-grub 2021-03-24T11:56:05.557 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub' 2021-03-24T11:56:05.574 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2021-03-24T11:56:05.816 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-4.15.0-139-generic 2021-03-24T11:56:05.829 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-4.15.0-139-generic 2021-03-24T11:56:06.123 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-4.15.0-136-generic 2021-03-24T11:56:06.136 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-4.15.0-136-generic 2021-03-24T11:56:07.424 INFO:teuthology.orchestra.run.smithi161.stderr:done 2021-03-24T11:56:07.426 DEBUG:teuthology.orchestra.run.smithi161:> sudo shutdown -r now 2021-03-24T11:56:37.458 INFO:teuthology.misc:Re-opening connections... 2021-03-24T11:56:37.459 INFO:teuthology.misc:trying to connect to ubuntu@smithi043.front.sepia.ceph.com 2021-03-24T11:56:37.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-24T11:56:37.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-24T11:57:37.523 DEBUG:teuthology.orchestra.remote:timed out 2021-03-24T11:57:37.525 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-03-24T11:57:37.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-24T11:57:37.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-24T11:57:40.578 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2021-03-24T11:57:40.579 DEBUG:teuthology.misc:waited 63.119624614715576 2021-03-24T11:57:41.580 INFO:teuthology.misc:trying to connect to ubuntu@smithi043.front.sepia.ceph.com 2021-03-24T11:57:41.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-24T11:57:41.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-24T11:57:41.669 DEBUG:teuthology.orchestra.run.smithi043:> true 2021-03-24T11:57:42.028 DEBUG:teuthology.misc:waited 64.56822729110718 2021-03-24T11:57:43.029 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-03-24T11:57:43.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-24T11:57:43.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-24T11:57:43.650 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2021-03-24T11:57:43.651 DEBUG:teuthology.misc:waited 66.191486120224 2021-03-24T11:57:44.651 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-03-24T11:57:44.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-24T11:57:44.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-24T11:57:47.714 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2021-03-24T11:57:47.715 DEBUG:teuthology.misc:waited 70.25579023361206 2021-03-24T11:57:48.717 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-03-24T11:57:48.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-24T11:57:48.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-24T11:57:50.786 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2021-03-24T11:57:50.789 DEBUG:teuthology.misc:waited 73.3301191329956 2021-03-24T11:57:51.790 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-03-24T11:57:51.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-24T11:57:51.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-24T11:57:53.858 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2021-03-24T11:57:53.859 DEBUG:teuthology.misc:waited 76.39963722229004 2021-03-24T11:57:54.860 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-03-24T11:57:54.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-24T11:57:54.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-24T11:57:56.930 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2021-03-24T11:57:56.931 DEBUG:teuthology.misc:waited 79.47157311439514 2021-03-24T11:57:57.932 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2021-03-24T11:57:57.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-24T11:57:57.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-24T11:57:58.141 DEBUG:teuthology.orchestra.run.smithi161:> true 2021-03-24T11:57:59.337 DEBUG:teuthology.misc:waited 81.87760305404663 2021-03-24T11:58:00.338 INFO:teuthology.task.kernel:Checking client c1.mon.a for new kernel version... 2021-03-24T11:58:00.338 INFO:teuthology.task.kernel:Checking kernel version of c1.mon.a, want "4.15.0-139-generic"... 2021-03-24T11:58:00.339 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2021-03-24T11:58:00.345 INFO:teuthology.orchestra.run.smithi043.stdout:4.15.0-139-generic 2021-03-24T11:58:00.346 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-139-generic vs 4.15.0-139-generic 2021-03-24T11:58:00.346 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-03-24T11:58:00.346 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-03-24T11:58:00.347 INFO:teuthology.task.kernel:Checking client c2.mon.a for new kernel version... 2021-03-24T11:58:00.347 INFO:teuthology.task.kernel:Checking kernel version of c2.mon.a, want "4.15.0-139-generic"... 2021-03-24T11:58:00.347 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2021-03-24T11:58:00.354 INFO:teuthology.orchestra.run.smithi161.stdout:4.15.0-139-generic 2021-03-24T11:58:00.354 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-139-generic vs 4.15.0-139-generic 2021-03-24T11:58:00.355 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-03-24T11:58:00.355 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-03-24T11:58:01.356 INFO:teuthology.task.kernel:Enabling kdb on c1.mon.a... 2021-03-24T11:58:01.357 DEBUG:teuthology.orchestra.run.smithi043:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-03-24T11:58:01.385 INFO:teuthology.orchestra.run.smithi043.stdout:ttyS1 2021-03-24T11:58:01.413 INFO:teuthology.task.kernel:Enabling kdb on c2.mon.a... 2021-03-24T11:58:01.414 DEBUG:teuthology.orchestra.run.smithi161:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-03-24T11:58:01.468 INFO:teuthology.orchestra.run.smithi161.stdout:ttyS1 2021-03-24T11:58:01.489 INFO:teuthology.run_tasks:Running task internal.base... 2021-03-24T11:58:01.499 INFO:teuthology.task.internal:Creating test directory... 2021-03-24T11:58:01.500 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-24T11:58:01.502 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-24T11:58:01.509 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-03-24T11:58:01.881 INFO:teuthology.run_tasks:Running task internal.archive... 2021-03-24T11:58:01.969 INFO:teuthology.task.internal:Creating archive directory... 2021-03-24T11:58:01.969 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-24T11:58:01.972 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-24T11:58:02.050 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-03-24T11:58:02.065 INFO:teuthology.task.internal:Enabling coredump saving... 2021-03-24T11:58:02.065 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-03-24T11:58:02.068 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-03-24T11:58:02.090 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-24T11:58:02.095 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-24T11:58:02.097 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-24T11:58:02.104 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-24T11:58:02.106 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-03-24T11:58:02.172 INFO:teuthology.task.internal:Configuring sudo... 2021-03-24T11:58:02.173 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-03-24T11:58:02.175 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-03-24T11:58:02.191 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-03-24T11:58:02.221 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-03-24T11:58:02.222 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-03-24T11:58:02.233 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-03-24T11:58:02.240 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-24T11:58:02.285 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-24T11:58:02.333 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T11:58:02.334 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-03-24T11:58:02.399 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-24T11:58:02.406 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-24T11:58:02.453 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T11:58:02.454 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-03-24T11:58:02.520 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2021-03-24T11:58:02.526 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2021-03-24T11:58:02.606 INFO:teuthology.run_tasks:Running task internal.timer... 2021-03-24T11:58:02.617 INFO:teuthology.task.internal:Starting timer... 2021-03-24T11:58:02.618 INFO:teuthology.run_tasks:Running task pcp... 2021-03-24T11:58:02.690 INFO:teuthology.run_tasks:Running task selinux... 2021-03-24T11:58:02.784 DEBUG:teuthology.task.selinux:Excluding smithi043: OS 'ubuntu' does not support SELinux 2021-03-24T11:58:02.785 DEBUG:teuthology.task.selinux:Excluding smithi161: OS 'ubuntu' does not support SELinux 2021-03-24T11:58:02.785 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-03-24T11:58:02.786 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-03-24T11:58:02.788 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-03-24T11:58:02.788 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-03-24T11:58:02.858 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-03-24T11:58:02.863 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-03-24T11:58:03.046 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-03-24T11:58:03.050 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi043.front.sepia.ceph.com,smithi161.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-03-24T11:58:04.047 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-03-24T11:58:05.894 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-03-24T11:58:08.336 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-03-24T11:58:08.397 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:08 +0000 (0:00:00.095) 0:00:00.095 ******* 2021-03-24T11:58:08.412 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:08 +0000 (0:00:00.015) 0:00:00.111 ******* 2021-03-24T11:58:10.212 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-03-24T11:58:10.214 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 18.04 on host smithi043.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi043.front.sepia.ceph.com] 2021-03-24T11:58:10.265 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:10 +0000 (0:00:01.853) 0:00:01.964 ******* 2021-03-24T11:58:10.349 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 18.04 on host smithi161.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi161.front.sepia.ceph.com] 2021-03-24T11:58:10.401 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:10 +0000 (0:00:00.135) 0:00:02.099 ******* 2021-03-24T11:58:10.530 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-03-24T11:58:10.532 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-24T11:58:10.554 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:10 +0000 (0:00:00.153) 0:00:02.253 ******* 2021-03-24T11:58:10.561 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-24T11:58:10.586 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:10 +0000 (0:00:00.031) 0:00:02.284 ******* 2021-03-24T11:58:11.152 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-03-24T11:58:11.154 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-03-24T11:58:11.179 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:11 +0000 (0:00:00.593) 0:00:02.878 ******* 2021-03-24T11:58:11.198 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-03-24T11:58:11.223 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:11 +0000 (0:00:00.043) 0:00:02.922 ******* 2021-03-24T11:58:11.558 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-03-24T11:58:11.560 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.062559", "end": "2021-03-24 11:58:11.096298", "rc": 0, "start": "2021-03-24 11:58:11.033739", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-03-24T11:58:11.586 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:11 +0000 (0:00:00.362) 0:00:03.284 ******* 2021-03-24T11:58:11.593 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.072825", "end": "2021-03-24 11:58:11.547094", "rc": 0, "start": "2021-03-24 11:58:11.474269", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-03-24T11:58:11.618 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:11 +0000 (0:00:00.032) 0:00:03.317 ******* 2021-03-24T11:58:11.872 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-03-24T11:58:11.874 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi043.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-24T11:58:11.899 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:11 +0000 (0:00:00.281) 0:00:03.598 ******* 2021-03-24T11:58:11.922 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:11 +0000 (0:00:00.022) 0:00:03.620 ******* 2021-03-24T11:58:13.008 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-03-24T11:58:13.010 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616587091.961736-6020-94089547047529/source", "state": "file", "uid": 0} 2021-03-24T11:58:13.037 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:13 +0000 (0:00:01.114) 0:00:04.735 ******* 2021-03-24T11:58:13.045 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616587091.9436479-6017-31496505874285/source", "state": "file", "uid": 0} 2021-03-24T11:58:13.083 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:13 +0000 (0:00:00.046) 0:00:04.781 ******* 2021-03-24T11:58:13.589 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-03-24T11:58:13.591 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-03-24T11:58:13.593 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-03-24T11:58:13.626 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-03-24T11:58:13.628 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-03-24T11:58:13.718 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-03-24T11:58:13.722 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-03-24T11:58:13.919 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:13 +0000 (0:00:00.836) 0:00:05.618 ******* 2021-03-24T11:58:13.943 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:13 +0000 (0:00:00.023) 0:00:05.642 ******* 2021-03-24T11:58:14.684 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi161.front.sepia.ceph.com] 2021-03-24T11:58:14.706 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] 2021-03-24T11:58:14.779 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-03-24T11:58:14.781 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:14 +0000 (0:00:00.836) 0:00:06.478 ******* 2021-03-24T11:58:14.823 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:14 +0000 (0:00:00.042) 0:00:06.521 ******* 2021-03-24T11:58:15.628 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-03-24T11:58:15.630 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.444524", "end": "2021-03-24 11:58:15.595523", "rc": 0, "start": "2021-03-24 11:58:15.150999", "stderr": "", "stderr_lines": [], "stdout": "c31004c4720a55ac12a95d66c32e64f592877604", "stdout_lines": ["c31004c4720a55ac12a95d66c32e64f592877604"]} changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.445182", "end": "2021-03-24 11:58:15.596141", "rc": 0, "start": "2021-03-24 11:58:15.150959", "stderr": "", "stderr_lines": [], "stdout": "c31004c4720a55ac12a95d66c32e64f592877604", "stdout_lines": ["c31004c4720a55ac12a95d66c32e64f592877604"]} 2021-03-24T11:58:15.654 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:15 +0000 (0:00:00.830) 0:00:07.352 ******* 2021-03-24T11:58:15.674 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:15 +0000 (0:00:00.021) 0:00:07.373 ******* 2021-03-24T11:58:15.820 INFO:teuthology.task.ansible.out: 2021-03-24T11:58:15.821 INFO:teuthology.task.ansible.out:TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-03-24T11:58:15.822 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008963", "end": "2021-03-24 11:58:15.795911", "failed_when_result": false, "rc": 0, "start": "2021-03-24 11:58:15.786948", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-03-24T11:58:15.846 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:15 +0000 (0:00:00.171) 0:00:07.545 ******* 2021-03-24T11:58:15.854 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.017932", "end": "2021-03-24 11:58:15.376285", "failed_when_result": false, "rc": 0, "start": "2021-03-24 11:58:15.358353", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-03-24T11:58:15.880 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:15 +0000 (0:00:00.033) 0:00:07.578 ******* 2021-03-24T11:58:15.940 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-03-24T11:58:15.941 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:58:15.965 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:15 +0000 (0:00:00.085) 0:00:07.664 ******* 2021-03-24T11:58:15.984 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:58:16.011 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:16 +0000 (0:00:00.046) 0:00:07.710 ******* 2021-03-24T11:58:16.050 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-03-24T11:58:16.052 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:58:16.076 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:16 +0000 (0:00:00.064) 0:00:07.774 ******* 2021-03-24T11:58:16.104 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:58:16.106 INFO:teuthology.task.ansible.out: 2021-03-24T11:58:16.133 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:16 +0000 (0:00:00.057) 0:00:07.831 ******* 2021-03-24T11:58:16.160 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-03-24T11:58:16.162 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:58:16.185 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:16 +0000 (0:00:00.052) 0:00:07.884 ******* 2021-03-24T11:58:16.213 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:58:16.260 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:16 +0000 (0:00:00.074) 0:00:07.958 ******* 2021-03-24T11:58:16.282 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-03-24T11:58:16.285 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:58:16.314 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:16 +0000 (0:00:00.054) 0:00:08.012 ******* 2021-03-24T11:58:16.357 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:58:16.383 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:16 +0000 (0:00:00.069) 0:00:08.081 ******* 2021-03-24T11:58:16.400 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-03-24T11:58:16.402 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:58:16.428 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:16 +0000 (0:00:00.045) 0:00:08.127 ******* 2021-03-24T11:58:16.472 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:58:16.509 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:16 +0000 (0:00:00.080) 0:00:08.207 ******* 2021-03-24T11:58:16.631 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-03-24T11:58:16.633 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-24T11:58:16.661 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:16 +0000 (0:00:00.152) 0:00:08.360 ******* 2021-03-24T11:58:16.712 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-24T11:58:16.737 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:16 +0000 (0:00:00.076) 0:00:08.436 ******* 2021-03-24T11:58:16.933 INFO:teuthology.task.ansible.out: 2021-03-24T11:58:16.935 INFO:teuthology.task.ansible.out:TASK [Create all admin users with sudo access.] ******************************** ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-03-24T11:58:16.977 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-03-24T11:58:17.084 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-03-24T11:58:17.127 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-03-24T11:58:17.245 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-03-24T11:58:17.288 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-03-24T11:58:17.405 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-03-24T11:58:17.437 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-03-24T11:58:17.545 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-03-24T11:58:17.591 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-03-24T11:58:17.699 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-03-24T11:58:17.743 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-03-24T11:58:17.838 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-03-24T11:58:17.882 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-03-24T11:58:17.988 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-03-24T11:58:18.031 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-03-24T11:58:18.139 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-03-24T11:58:18.182 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-03-24T11:58:18.300 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-03-24T11:58:18.344 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-03-24T11:58:18.451 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-03-24T11:58:18.494 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-03-24T11:58:18.600 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-03-24T11:58:18.633 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-03-24T11:58:18.748 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-03-24T11:58:18.781 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-03-24T11:58:18.899 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-03-24T11:58:18.932 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-03-24T11:58:19.093 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-03-24T11:58:19.115 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-03-24T11:58:19.265 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-03-24T11:58:19.287 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-03-24T11:58:19.416 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-03-24T11:58:19.460 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-03-24T11:58:19.577 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-03-24T11:58:19.612 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-03-24T11:58:19.729 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-03-24T11:58:19.763 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-03-24T11:58:19.881 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-03-24T11:58:19.915 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-03-24T11:58:20.022 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-03-24T11:58:20.077 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-03-24T11:58:20.194 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-03-24T11:58:20.249 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-03-24T11:58:20.334 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-03-24T11:58:20.388 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-03-24T11:58:20.474 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-03-24T11:58:20.538 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-03-24T11:58:20.624 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-03-24T11:58:20.710 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-03-24T11:58:20.775 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-03-24T11:58:20.864 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-03-24T11:58:20.919 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-03-24T11:58:21.016 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-03-24T11:58:21.071 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-03-24T11:58:21.167 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-03-24T11:58:21.221 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-03-24T11:58:21.316 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-03-24T11:58:21.370 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-03-24T11:58:21.479 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-03-24T11:58:21.523 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-03-24T11:58:21.629 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-03-24T11:58:21.672 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-03-24T11:58:21.778 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-03-24T11:58:21.821 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-03-24T11:58:21.948 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-03-24T11:58:21.973 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-03-24T11:58:22.097 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-03-24T11:58:22.120 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-03-24T11:58:22.247 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-03-24T11:58:22.270 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-03-24T11:58:22.406 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-03-24T11:58:22.429 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-03-24T11:58:22.430 INFO:teuthology.task.ansible.out: 2021-03-24T11:58:22.545 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-03-24T11:58:22.578 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-03-24T11:58:22.694 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-03-24T11:58:22.727 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-24T11:58:22.845 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-24T11:58:22.878 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-24T11:58:22.984 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-24T11:58:23.031 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-03-24T11:58:23.033 INFO:teuthology.task.ansible.out: 2021-03-24T11:58:23.138 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-03-24T11:58:23.192 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-03-24T11:58:23.298 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-03-24T11:58:23.330 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-03-24T11:58:23.443 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-03-24T11:58:23.477 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-03-24T11:58:23.584 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-03-24T11:58:23.627 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-03-24T11:58:23.735 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-03-24T11:58:23.778 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-03-24T11:58:23.878 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-03-24T11:58:23.935 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-24T11:58:24.046 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-24T11:58:24.086 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-24T11:58:24.211 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-24T11:58:24.233 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-03-24T11:58:24.370 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-03-24T11:58:24.382 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-03-24T11:58:24.508 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-03-24T11:58:24.531 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-03-24T11:58:24.667 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-03-24T11:58:24.668 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-03-24T11:58:24.814 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-03-24T11:58:24.816 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-03-24T11:58:24.952 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-03-24T11:58:24.953 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-03-24T11:58:25.101 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-03-24T11:58:25.102 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-03-24T11:58:25.249 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-03-24T11:58:25.386 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-03-24T11:58:25.398 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-03-24T11:58:25.527 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-03-24T11:58:25.550 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-03-24T11:58:25.682 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-03-24T11:58:25.697 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-03-24T11:58:25.838 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-03-24T11:58:25.976 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-03-24T11:58:25.988 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-03-24T11:58:26.125 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-03-24T11:58:26.137 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-03-24T11:58:26.274 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-03-24T11:58:26.275 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-03-24T11:58:26.423 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-03-24T11:58:26.424 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-03-24T11:58:26.570 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-24T11:58:26.571 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-03-24T11:58:26.720 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-03-24T11:58:26.721 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-24T11:58:26.859 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-03-24T11:58:26.871 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-03-24T11:58:27.009 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-03-24T11:58:27.031 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-03-24T11:58:27.160 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-03-24T11:58:27.194 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-03-24T11:58:27.310 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-03-24T11:58:27.343 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-03-24T11:58:27.464 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-03-24T11:58:27.486 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-03-24T11:58:27.602 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-03-24T11:58:27.645 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-03-24T11:58:27.751 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-03-24T11:58:27.909 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-03-24T11:58:27.946 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-03-24T11:58:28.051 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-03-24T11:58:28.094 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-03-24T11:58:28.190 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-03-24T11:58:28.254 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-03-24T11:58:28.347 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-03-24T11:58:28.401 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-03-24T11:58:28.492 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-03-24T11:58:28.557 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-03-24T11:58:28.633 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-03-24T11:58:28.707 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-03-24T11:58:28.784 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-03-24T11:58:28.848 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-03-24T11:58:28.923 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-03-24T11:58:28.998 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-03-24T11:58:29.063 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-03-24T11:58:29.149 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-03-24T11:58:29.214 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-03-24T11:58:29.333 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-03-24T11:58:29.365 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-03-24T11:58:29.441 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-03-24T11:58:29.516 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-03-24T11:58:29.591 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-03-24T11:58:29.666 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-03-24T11:58:29.741 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-03-24T11:58:29.804 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-03-24T11:58:29.891 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-03-24T11:58:29.955 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-03-24T11:58:30.041 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-03-24T11:58:30.105 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-03-24T11:58:30.201 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-03-24T11:58:30.254 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-03-24T11:58:30.385 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-03-24T11:58:30.473 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-03-24T11:58:30.579 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-03-24T11:58:30.643 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-03-24T11:58:30.735 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-03-24T11:58:30.799 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-03-24T11:58:30.887 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-03-24T11:58:30.963 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-03-24T11:58:31.030 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-03-24T11:58:31.115 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-03-24T11:58:31.190 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-03-24T11:58:31.280 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-03-24T11:58:31.364 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-03-24T11:58:31.429 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-03-24T11:58:31.528 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-03-24T11:58:31.583 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-03-24T11:58:31.679 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-03-24T11:58:31.757 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-03-24T11:58:31.843 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-03-24T11:58:31.898 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-03-24T11:58:31.993 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-03-24T11:58:32.060 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-03-24T11:58:32.134 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-03-24T11:58:32.219 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-03-24T11:58:32.283 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-03-24T11:58:32.370 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-24T11:58:32.434 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-03-24T11:58:32.521 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-03-24T11:58:32.590 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-24T11:58:32.654 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-03-24T11:58:32.740 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-03-24T11:58:32.804 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-03-24T11:58:32.889 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-03-24T11:58:32.955 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-03-24T11:58:33.040 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-03-24T11:58:33.095 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-03-24T11:58:33.190 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-03-24T11:58:33.244 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-03-24T11:58:33.331 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-03-24T11:58:33.384 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-03-24T11:58:33.481 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-03-24T11:58:33.524 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-03-24T11:58:33.630 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-03-24T11:58:33.672 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-03-24T11:58:33.780 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-03-24T11:58:33.813 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-03-24T11:58:33.928 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-03-24T11:58:33.961 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-03-24T11:58:34.067 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-03-24T11:58:34.110 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-03-24T11:58:34.216 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-03-24T11:58:34.248 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-03-24T11:58:34.366 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-03-24T11:58:34.399 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-03-24T11:58:34.521 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-03-24T11:58:34.544 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-03-24T11:58:34.672 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-03-24T11:58:34.694 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-03-24T11:58:34.810 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-03-24T11:58:34.832 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-03-24T11:58:34.959 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-03-24T11:58:34.981 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-03-24T11:58:35.109 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-03-24T11:58:35.111 INFO:teuthology.task.ansible.out: 2021-03-24T11:58:35.122 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-03-24T11:58:35.269 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-03-24T11:58:35.282 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-03-24T11:58:35.422 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-03-24T11:58:35.434 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-03-24T11:58:35.576 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-03-24T11:58:35.578 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-03-24T11:58:35.730 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-03-24T11:58:35.734 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-03-24T11:58:35.881 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-03-24T11:58:35.883 INFO:teuthology.task.ansible.out: ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-03-24T11:58:35.885 INFO:teuthology.task.ansible.out: 2021-03-24T11:58:36.032 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-03-24T11:58:36.034 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-03-24T11:58:36.194 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-03-24T11:58:36.195 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-03-24T11:58:36.356 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-03-24T11:58:36.369 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-03-24T11:58:36.507 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-03-24T11:58:36.519 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-03-24T11:58:36.678 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-03-24T11:58:36.690 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-03-24T11:58:36.841 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-03-24T11:58:36.855 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-03-24T11:58:36.991 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-03-24T11:58:37.016 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-03-24T11:58:37.144 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-03-24T11:58:37.176 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-03-24T11:58:37.297 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-03-24T11:58:37.320 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-03-24T11:58:37.438 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-03-24T11:58:37.473 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-03-24T11:58:37.591 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-03-24T11:58:37.624 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-03-24T11:58:37.744 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-03-24T11:58:37.777 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-03-24T11:58:37.915 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-03-24T11:58:37.928 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-03-24T11:58:38.166 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-03-24T11:58:38.191 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:38 +0000 (0:00:21.453) 0:00:29.889 ******* 2021-03-24T11:58:38.235 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-03-24T11:58:38.333 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-03-24T11:58:38.357 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:38 +0000 (0:00:00.165) 0:00:30.055 ******* 2021-03-24T11:58:38.379 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:38 +0000 (0:00:00.022) 0:00:30.077 ******* 2021-03-24T11:58:38.480 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:38 +0000 (0:00:00.100) 0:00:30.178 ******* 2021-03-24T11:58:38.767 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c 2021-03-24T11:58:38.769 INFO:teuthology.task.ansible.out:68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "a 2021-03-24T11:58:38.770 INFO:teuthology.task.ansible.out:li@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb27 2021-03-24T11:58:38.772 INFO:teuthology.task.ansible.out:3afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767 2021-03-24T11:58:38.773 INFO:teuthology.task.ansible.out:dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d9037 2021-03-24T11:58:38.775 INFO:teuthology.task.ansible.out:6839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rza 2021-03-24T11:58:38.777 INFO:teuthology.task.ansible.out:rzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a 2021-03-24T11:58:38.777 INFO:teuthology.task.ansible.out:4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mk 2021-03-24T11:58:38.779 INFO:teuthology.task.ansible.out:ogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"} 2021-03-24T11:58:38.780 INFO:teuthology.task.ansible.out:, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name" 2021-03-24T11:58:38.782 INFO:teuthology.task.ansible.out:: "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8d 2021-03-24T11:58:38.784 INFO:teuthology.task.ansible.out:a3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7 2021-03-24T11:58:38.785 INFO:teuthology.task.ansible.out:465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalo 2021-03-24T11:58:38.787 INFO:teuthology.task.ansible.out:mon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174f 2021-03-24T11:58:38.787 INFO:teuthology.task.ansible.out:e16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-03-24T11:58:38.794 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-03-24T11:58:38.796 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-03-24T11:58:38.798 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-03-24T11:58:38.799 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\ 2021-03-24T11:58:38.800 INFO:teuthology.task.ansible.out:nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-03-24T11:58:38.801 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 2021-03-24T11:58:38.803 INFO:teuthology.task.ansible.out: 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc9795 2021-03-24T11:58:38.805 INFO:teuthology.task.ansible.out:3cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e 2021-03-24T11:58:38.807 INFO:teuthology.task.ansible.out:7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef14 2021-03-24T11:58:38.808 INFO:teuthology.task.ansible.out:80c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d301 2021-03-24T11:58:38.810 INFO:teuthology.task.ansible.out:7b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214 2021-03-24T11:58:38.812 INFO:teuthology.task.ansible.out:bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "o 2021-03-24T11:58:38.812 INFO:teuthology.task.ansible.out:vpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelope 2021-03-24T11:58:38.816 INFO:teuthology.task.ansible.out:z@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed 2021-03-24T11:58:38.818 INFO:teuthology.task.ansible.out:19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-03-24T11:58:38.843 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:38 +0000 (0:00:00.361) 0:00:30.539 ******* 2021-03-24T11:58:38.866 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:38 +0000 (0:00:00.025) 0:00:30.564 ******* 2021-03-24T11:58:40.705 INFO:teuthology.task.ansible.out:FAILED - RETRYING: Clone the keys repo (5 retries left). 2021-03-24T11:58:40.770 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-03-24T11:58:40.772 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"after": "c31004c4720a55ac12a95d66c32e64f592877604", "attempts": 1, "before": "c31004c4720a55ac12a95d66c32e64f592877604", "changed": false, "remote_url_changed": false} 2021-03-24T11:58:40.796 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:40 +0000 (0:00:01.929) 0:00:32.494 ******* 2021-03-24T11:58:41.036 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:58:41.038 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-03-24T11:58:41.185 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-03-24T11:58:41.323 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-03-24T11:58:41.477 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-03-24T11:58:41.479 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-03-24T11:58:41.630 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-03-24T11:58:41.806 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-03-24T11:58:41.809 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-03-24T11:58:41.950 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-03-24T11:58:42.090 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-03-24T11:58:42.239 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-03-24T11:58:42.251 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:58:42.402 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-03-24T11:58:42.404 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-03-24T11:58:42.542 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-03-24T11:58:42.545 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-03-24T11:58:42.554 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:58:42.576 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:58:42.713 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-03-24T11:58:42.843 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-03-24T11:58:42.845 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-03-24T11:58:42.982 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-03-24T11:58:43.110 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-03-24T11:58:43.112 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-03-24T11:58:43.248 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-03-24T11:58:43.387 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-03-24T11:58:43.528 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-03-24T11:58:43.672 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-03-24T11:58:43.675 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-03-24T11:58:43.814 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-03-24T11:58:43.816 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-03-24T11:58:43.962 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-03-24T11:58:44.102 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-03-24T11:58:44.238 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-03-24T11:58:44.240 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-03-24T11:58:44.379 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-03-24T11:58:44.518 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-03-24T11:58:44.656 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-03-24T11:58:44.794 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-03-24T11:58:44.933 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-03-24T11:58:45.071 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-03-24T11:58:45.073 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-03-24T11:58:45.209 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-03-24T11:58:45.338 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-03-24T11:58:45.475 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-03-24T11:58:45.615 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-03-24T11:58:45.747 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-03-24T11:58:45.886 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-03-24T11:58:46.024 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-24T11:58:46.151 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-03-24T11:58:46.290 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-03-24T11:58:46.418 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-03-24T11:58:46.420 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-03-24T11:58:46.554 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-03-24T11:58:46.556 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-03-24T11:58:46.692 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-03-24T11:58:46.820 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-03-24T11:58:46.949 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-03-24T11:58:47.086 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-03-24T11:58:47.088 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-24T11:58:47.214 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-03-24T11:58:47.215 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-03-24T11:58:47.217 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-03-24T11:58:47.362 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-03-24T11:58:47.500 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-03-24T11:58:47.638 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-03-24T11:58:47.778 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-03-24T11:58:47.918 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-03-24T11:58:48.058 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-03-24T11:58:48.061 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-03-24T11:58:48.240 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-03-24T11:58:48.378 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-03-24T11:58:48.518 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-03-24T11:58:48.520 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-03-24T11:58:48.645 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-03-24T11:58:48.784 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-03-24T11:58:48.910 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-03-24T11:58:48.912 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-03-24T11:58:49.048 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-03-24T11:58:49.188 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-03-24T11:58:49.324 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-03-24T11:58:49.462 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-24T11:58:49.610 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-03-24T11:58:49.749 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-03-24T11:58:49.898 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-03-24T11:58:50.036 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-03-24T11:58:50.174 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-03-24T11:58:50.580 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} ok: [smithi043.fron 2021-03-24T11:58:50.582 INFO:teuthology.task.ansible.out:t.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-03-24T11:58:50.730 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-03-24T11:58:50.871 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-03-24T11:58:51.035 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-03-24T11:58:51.173 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-03-24T11:58:51.308 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-03-24T11:58:51.454 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-03-24T11:58:51.594 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-03-24T11:58:51.734 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-03-24T11:58:51.881 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-03-24T11:58:51.883 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} TASK [users : Clone the keys repo] ********************************************* ok: [smithi161.front.sepia.ceph.com] => {"after": "c31004c4720a55ac12a95d66c32e64f592877604", "attempts": 2, "before": "c31004c4720a55ac12a95d66c32e64f592877604", "changed": false, "remote_url_changed": false} 2021-03-24T11:58:51.908 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:58:51 +0000 (0:00:11.112) 0:00:43.607 ******* 2021-03-24T11:58:52.014 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:58:52.016 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-03-24T11:58:52.153 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-03-24T11:58:52.176 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-03-24T11:58:52.283 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-03-24T11:58:52.316 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-03-24T11:58:52.434 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-03-24T11:58:52.468 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-03-24T11:58:52.606 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-03-24T11:58:52.608 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-03-24T11:58:52.628 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-03-24T11:58:52.630 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-03-24T11:58:52.766 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-03-24T11:58:52.770 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-03-24T11:58:52.798 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-03-24T11:58:52.904 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-03-24T11:58:52.936 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-03-24T11:58:52.938 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-03-24T11:58:53.043 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-03-24T11:58:53.065 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-03-24T11:58:53.172 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-03-24T11:58:53.194 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-03-24T11:58:53.312 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-03-24T11:58:53.344 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-03-24T11:58:53.345 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:58:53.452 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-03-24T11:58:53.485 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-03-24T11:58:53.488 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-03-24T11:58:53.591 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-03-24T11:58:53.624 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-03-24T11:58:53.626 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-03-24T11:58:53.636 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:58:53.647 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:58:53.731 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-03-24T11:58:53.786 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-03-24T11:58:53.884 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-03-24T11:58:53.887 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-03-24T11:58:53.948 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-03-24T11:58:53.950 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-03-24T11:58:54.001 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-03-24T11:58:54.086 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-03-24T11:58:54.150 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-03-24T11:58:54.225 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-03-24T11:58:54.227 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-03-24T11:58:54.300 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-03-24T11:58:54.366 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-03-24T11:58:54.431 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-03-24T11:58:54.505 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-03-24T11:58:54.580 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-03-24T11:58:54.646 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-03-24T11:58:54.713 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-03-24T11:58:54.779 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-03-24T11:58:54.782 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-03-24T11:58:54.855 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-03-24T11:58:54.858 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-24T11:58:54.920 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-03-24T11:58:54.922 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-03-24T11:58:55.007 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-03-24T11:58:55.073 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-03-24T11:58:55.159 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-03-24T11:58:55.225 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-03-24T11:58:55.312 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-03-24T11:58:55.369 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-03-24T11:58:55.371 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-03-24T11:58:55.454 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-03-24T11:58:55.529 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-03-24T11:58:55.603 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-03-24T11:58:55.667 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-03-24T11:58:55.731 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-03-24T11:58:55.795 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-03-24T11:58:55.869 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-03-24T11:58:55.933 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-03-24T11:58:55.935 INFO:teuthology.task.ansible.out: 2021-03-24T11:58:55.997 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-03-24T11:58:56.072 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-03-24T11:58:56.147 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-03-24T11:58:56.149 INFO:teuthology.task.ansible.out: 2021-03-24T11:58:56.201 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-03-24T11:58:56.203 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-03-24T11:58:56.281 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-03-24T11:58:56.348 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-03-24T11:58:56.414 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-03-24T11:58:56.501 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-03-24T11:58:56.555 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-03-24T11:58:56.630 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-03-24T11:58:56.694 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-03-24T11:58:56.786 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-03-24T11:58:56.839 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-03-24T11:58:56.941 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-03-24T11:58:56.994 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-03-24T11:58:57.079 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-03-24T11:58:57.145 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-03-24T11:58:57.231 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-24T11:58:57.285 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-03-24T11:58:57.371 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-03-24T11:58:57.424 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-03-24T11:58:57.520 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-03-24T11:58:57.606 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-03-24T11:58:57.608 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-03-24T11:58:57.649 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-03-24T11:58:57.651 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-03-24T11:58:57.749 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-03-24T11:58:57.804 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-03-24T11:58:57.806 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-03-24T11:58:57.891 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-03-24T11:58:57.956 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-03-24T11:58:58.054 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-03-24T11:58:58.108 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-03-24T11:58:58.193 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-03-24T11:58:58.263 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-03-24T11:58:58.328 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-03-24T11:58:58.435 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-03-24T11:58:58.437 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-24T11:58:58.478 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-03-24T11:58:58.588 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-03-24T11:58:58.590 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-03-24T11:58:58.592 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-03-24T11:58:58.623 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-03-24T11:58:58.757 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-03-24T11:58:58.759 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-03-24T11:58:58.899 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-03-24T11:58:58.911 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-03-24T11:58:59.043 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-03-24T11:58:59.066 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-03-24T11:58:59.209 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-03-24T11:58:59.210 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-03-24T11:58:59.360 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-03-24T11:58:59.372 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-03-24T11:58:59.500 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-03-24T11:58:59.501 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-03-24T11:58:59.503 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-03-24T11:58:59.627 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-03-24T11:58:59.639 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-03-24T11:58:59.777 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-03-24T11:58:59.788 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-03-24T11:58:59.918 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-03-24T11:58:59.940 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-03-24T11:58:59.941 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-03-24T11:59:00.067 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-03-24T11:59:00.068 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-03-24T11:59:00.197 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-03-24T11:59:00.209 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-03-24T11:59:00.325 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:00 +0000 (0:00:08.416) 0:00:52.024 ******* 2021-03-24T11:59:00.383 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-03-24T11:59:00.386 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-03-24T11:59:00.480 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-24T11:59:00.482 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:00.488 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:00.498 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:00.509 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:00.531 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:00.542 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:00.544 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-03-24T11:59:00.553 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:00.585 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:00.773 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+r 2021-03-24T11:59:00.775 INFO:teuthology.task.ansible.out:R1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-03-24T11:59:00.780 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:00.791 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:00.891 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:00.893 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-03-24T11:59:00.990 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-24T11:59:00.992 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-03-24T11:59:01.033 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:01.035 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-24T11:59:01.140 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-24T11:59:01.142 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-03-24T11:59:01.152 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.153 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.177 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:01.178 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-03-24T11:59:01.189 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-24T11:59:01.190 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.200 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.202 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.223 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.234 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.245 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.267 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.278 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.289 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.299 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.310 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.312 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.322 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:01.324 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.337 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.339 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.349 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.360 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.370 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.381 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.403 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.414 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.416 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.426 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.437 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.448 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.459 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.470 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.482 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.493 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:01.495 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-03-24T11:59:01.504 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.515 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.537 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.548 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.559 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.572 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.584 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.596 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.608 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.621 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.632 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.644 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional res 2021-03-24T11:59:01.649 INFO:teuthology.task.ansible.out:ult was False"} 2021-03-24T11:59:01.656 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.667 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.679 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.690 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.702 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.714 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.717 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.728 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.742 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.763 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.775 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.798 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.808 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:01.809 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.821 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.835 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.836 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:01.847 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.849 INFO:teuthology.task.ansible.out: skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.859 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.861 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:01.872 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.883 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.894 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.906 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.923 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.926 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.937 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.938 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.950 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-03-24T11:59:01.964 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-24T11:59:01.966 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.976 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.987 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.989 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:01.999 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.010 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.022 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.025 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.034 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.037 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.045 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.050 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.057 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.068 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.079 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.090 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.093 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.110 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.114 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.126 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:02.128 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.149 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.165 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.176 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.190 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.304 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (i 2021-03-24T11:59:02.307 INFO:teuthology.task.ansible.out:tem={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi043.front.se 2021-03-24T11:59:02.309 INFO:teuthology.task.ansible.out:pia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.315 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.326 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.337 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.348 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.350 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.360 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.381 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.392 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.414 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.425 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.427 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.438 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:02.456 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.458 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi043.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.511 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:02 +0000 (0:00:02.185) 0:00:54.209 ******* 2021-03-24T11:59:02.602 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:02.604 INFO:teuthology.task.ansible.out:TASK [Filter the revoked_users list] ******************************************* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:02.628 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:02 +0000 (0:00:00.117) 0:00:54.327 ******* 2021-03-24T11:59:02.657 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:02.660 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-03-24T11:59:02.808 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-03-24T11:59:02.939 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:02.941 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-03-24T11:59:02.965 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-03-24T11:59:03.120 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-03-24T11:59:03.127 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi043.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-03-24T11:59:03.327 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-03-24T11:59:03.391 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:03.393 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-03-24T11:59:03.487 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:03.489 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-03-24T11:59:03.551 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:03.553 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-03-24T11:59:03.626 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:03.628 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-03-24T11:59:03.690 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:03.692 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-03-24T11:59:03.765 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:03.766 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-03-24T11:59:03.850 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:03.852 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-03-24T11:59:03.854 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-03-24T11:59:03.915 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:03.917 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-03-24T11:59:04.000 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:04.002 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-03-24T11:59:04.054 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:04.056 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-03-24T11:59:04.139 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:04.141 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-03-24T11:59:04.203 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:04.205 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-03-24T11:59:04.289 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:04.291 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-03-24T11:59:04.342 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:04.344 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-03-24T11:59:04.449 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:04.451 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-03-24T11:59:04.482 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:04.483 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-03-24T11:59:04.587 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:04.589 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-03-24T11:59:04.591 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-03-24T11:59:04.621 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi043.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-03-24T11:59:04.737 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:04.739 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-03-24T11:59:04.741 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-03-24T11:59:04.759 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:04.761 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-03-24T11:59:04.865 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:04.867 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-03-24T11:59:04.909 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:04.911 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-03-24T11:59:05.016 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:05.018 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-03-24T11:59:05.051 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:05.053 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-03-24T11:59:05.158 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:05.160 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-03-24T11:59:05.212 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:05.213 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-03-24T11:59:05.297 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:05.299 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-03-24T11:59:05.363 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi043.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-03-24T11:59:05.426 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:05.428 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-03-24T11:59:05.503 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:05.504 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-03-24T11:59:05.567 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:05.569 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-03-24T11:59:05.664 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi043.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-03-24T11:59:05.752 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-03-24T11:59:05.817 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:05.819 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-03-24T11:59:05.913 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:05.915 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-03-24T11:59:05.917 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-03-24T11:59:05.972 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi043.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-03-24T11:59:06.092 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-03-24T11:59:06.113 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi043.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-03-24T11:59:06.251 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:06.253 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-03-24T11:59:06.286 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:06.297 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-03-24T11:59:06.413 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:06.415 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-03-24T11:59:06.435 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:06.440 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-03-24T11:59:06.585 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-03-24T11:59:06.587 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-03-24T11:59:06.736 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:06.738 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-03-24T11:59:06.749 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-03-24T11:59:06.891 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-03-24T11:59:06.893 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:06.919 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi043.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-03-24T11:59:07.060 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:07.062 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-03-24T11:59:07.064 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-24T11:59:07.083 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi043.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-03-24T11:59:07.205 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:07.206 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-03-24T11:59:07.216 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:07.221 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-03-24T11:59:07.334 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:07.336 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-03-24T11:59:07.377 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:07.379 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-03-24T11:59:07.504 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:07.506 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-03-24T11:59:07.516 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:07.521 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-03-24T11:59:07.679 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-03-24T11:59:07.686 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:07.688 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-03-24T11:59:07.824 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-03-24T11:59:07.850 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi043.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-03-24T11:59:07.987 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:07.989 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-03-24T11:59:08.009 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:08.010 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-03-24T11:59:08.149 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:08.151 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [smithi043.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-03-24T11:59:08.281 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:08.283 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-03-24T11:59:08.313 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:08.315 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-03-24T11:59:08.420 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:08.422 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-03-24T11:59:08.463 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi043.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-03-24T11:59:08.548 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:08.550 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-03-24T11:59:08.602 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:08.604 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-03-24T11:59:08.690 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:08.692 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-03-24T11:59:08.744 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:08.746 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-03-24T11:59:08.830 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:08.832 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-03-24T11:59:08.916 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:08.918 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-03-24T11:59:08.960 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:08.961 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-03-24T11:59:09.077 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:09.079 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-03-24T11:59:09.099 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:09.102 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-03-24T11:59:09.226 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:09.228 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-03-24T11:59:09.366 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-03-24T11:59:09.368 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi043.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-03-24T11:59:09.495 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-03-24T11:59:09.516 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:09.518 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-03-24T11:59:09.626 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:09.627 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-03-24T11:59:09.659 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:09.661 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-03-24T11:59:09.765 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:09.767 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-03-24T11:59:09.768 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-03-24T11:59:09.798 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:09.803 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-03-24T11:59:09.898 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:09.900 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-03-24T11:59:09.952 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:09.954 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-03-24T11:59:10.037 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:10.039 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-03-24T11:59:10.101 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:10.103 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-03-24T11:59:10.165 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:10.167 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-03-24T11:59:10.240 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi043.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-03-24T11:59:10.305 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:10 +0000 (0:00:07.676) 0:01:02.004 ******* 2021-03-24T11:59:10.313 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:10.314 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-03-24T11:59:10.442 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-03-24T11:59:10.570 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-03-24T11:59:10.721 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-03-24T11:59:10.786 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-03-24T11:59:10.788 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "checksum": "1d9711ff879c231c67cb70d00ca0088797a377d0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "80a55def4b505d08aff3687f81f74dc2", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616587150.3923604-15387-15738446496268/source", "state": "file", "uid": 0} 2021-03-24T11:59:10.817 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:10 +0000 (0:00:00.511) 0:01:02.515 ******* 2021-03-24T11:59:10.879 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-03-24T11:59:10.901 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi043.front.sepia.ceph.com] => { "msg": "Host smithi043.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-03-24T11:59:10.926 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:10 +0000 (0:00:00.108) 0:01:02.624 ******* 2021-03-24T11:59:11.022 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-03-24T11:59:11.023 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-03-24T11:59:11.024 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:11.024 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-03-24T11:59:11.060 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:11 +0000 (0:00:00.133) 0:01:02.758 ******* 2021-03-24T11:59:11.144 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-03-24T11:59:11.404 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 24 March 2021 11:59:11 +0000 (0:00:00.108) 0:01:02.867 ******* TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 24 March 2021 11:59:11 +0000 (0:00:00.097) 0:01:02.964 ******* TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", " 2021-03-24T11:59:11.406 INFO:teuthology.task.ansible.out:ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 24 March 2021 11:59:11 +0000 (0:00:00.098) 0:01:03.062 ******* 2021-03-24T11:59:11.425 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:11.430 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-03-24T11:59:11.437 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-03-24T11:59:11.438 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:11.461 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:11 +0000 (0:00:00.096) 0:01:03.159 ******* 2021-03-24T11:59:11.530 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-03-24T11:59:11.532 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:11.554 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:11 +0000 (0:00:00.093) 0:01:03.253 ******* 2021-03-24T11:59:11.572 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:11.573 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-03-24T11:59:11.647 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:11.671 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:11 +0000 (0:00:00.117) 0:01:03.370 ******* 2021-03-24T11:59:11.710 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:11.712 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-03-24T11:59:11.744 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:11.768 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:11 +0000 (0:00:00.096) 0:01:03.466 ******* 2021-03-24T11:59:11.849 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:11.851 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-03-24T11:59:11.860 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-03-24T11:59:11.862 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:11.889 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:11 +0000 (0:00:00.122) 0:01:03.588 ******* 2021-03-24T11:59:11.980 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:11.982 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi043.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-24T11:59:12.005 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:12 +0000 (0:00:00.115) 0:01:03.704 ******* 2021-03-24T11:59:12.069 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-03-24T11:59:12.071 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:12.098 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:12 +0000 (0:00:00.092) 0:01:03.796 ******* 2021-03-24T11:59:12.118 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:12.120 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-03-24T11:59:12.122 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-03-24T11:59:12.196 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:12.219 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:12 +0000 (0:00:00.121) 0:01:03.918 ******* 2021-03-24T11:59:12.259 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-24T11:59:12.261 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-03-24T11:59:12.349 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-03-24T11:59:12.349 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-24T11:59:12.351 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:12.374 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:12 +0000 (0:00:00.154) 0:01:04.072 ******* 2021-03-24T11:59:12.401 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:12 +0000 (0:00:00.027) 0:01:04.099 ******* 2021-03-24T11:59:12.443 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-03-24T11:59:12.445 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:12.470 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:12 +0000 (0:00:00.068) 0:01:04.168 ******* 2021-03-24T11:59:12.530 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-24T11:59:12.532 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:12.552 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:12.555 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} TASK [common : Register with subscription-manager.] **************************** skipping: [smithi043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-24T11:59:12.583 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:12 +0000 (0:00:00.112) 0:01:04.281 ******* 2021-03-24T11:59:12.595 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-24T11:59:12.596 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:12.598 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:12.600 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:12.611 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:12.612 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:12.677 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:12.702 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:12 +0000 (0:00:00.118) 0:01:04.400 ******* 2021-03-24T11:59:12.762 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-24T11:59:12.765 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-03-24T11:59:12.774 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:12.786 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:12.787 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:12.789 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:12.829 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:12 +0000 (0:00:00.127) 0:01:04.527 ******* 2021-03-24T11:59:12.924 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-03-24T11:59:12.927 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": t 2021-03-24T11:59:12.929 INFO:teuthology.task.ansible.out:rue} 2021-03-24T11:59:12.956 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:12 +0000 (0:00:00.127) 0:01:04.655 ******* 2021-03-24T11:59:12.958 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:13.041 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-03-24T11:59:13.043 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.067 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:13 +0000 (0:00:00.110) 0:01:04.766 ******* 2021-03-24T11:59:13.077 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-24T11:59:13.194 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfad 2021-03-24T11:59:13.196 INFO:teuthology.task.ansible.out:a28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@n 2021-03-24T11:59:13.198 INFO:teuthology.task.ansible.out:ew-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2 2021-03-24T11:59:13.199 INFO:teuthology.task.ansible.out:b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453 2021-03-24T11:59:13.201 INFO:teuthology.task.ansible.out:a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63 2021-03-24T11:59:13.203 INFO:teuthology.task.ansible.out:d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: 2021-03-24T11:59:13.205 INFO:teuthology.task.ansible.out:[smithi161.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.207 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:13 +0000 (0:00:00.139) 0:01:04.905 ******* 2021-03-24T11:59:13.218 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.225 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.227 INFO:teuthology.task.ansible.out: skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.229 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.240 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.242 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:13.243 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.255 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.266 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.278 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.291 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.293 INFO:teuthology.task.ansible.out: skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.304 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-24T11:59:13.306 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.332 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:13 +0000 (0:00:00.125) 0:01:05.031 ******* 2021-03-24T11:59:13.340 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.345 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.346 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.347 INFO:teuthology.task.ansible.out: skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.359 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.360 INFO:teuthology.task.ansible.out: skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.372 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.373 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.375 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:13.385 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.407 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.430 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:13 +0000 (0:00:00.098) 0:01:05.129 ******* 2021-03-24T11:59:13.438 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-24T11:59:13.440 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.441 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.443 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.443 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.444 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@red 2021-03-24T11:59:13.445 INFO:teuthology.task.ansible.out:hat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.457 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.459 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.469 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.480 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.482 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.491 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.503 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.514 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-03-24T11:59:13.516 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.541 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:13 +0000 (0:00:00.110) 0:01:05.240 ******* 2021-03-24T11:59:13.554 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.555 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.556 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.557 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.568 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.580 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.582 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.592 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.593 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.604 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.608 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.619 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.621 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.631 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.633 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.659 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:13 +0000 (0:00:00.117) 0:01:05.357 ******* 2021-03-24T11:59:13.667 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.667 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.669 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.682 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.684 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.694 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.705 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.717 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.718 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.730 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.732 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.758 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:13 +0000 (0:00:00.099) 0:01:05.456 ******* 2021-03-24T11:59:13.766 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.768 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.769 INFO:teuthology.task.ansible.out: skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.770 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:13.770 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.770 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.784 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.786 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.796 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.798 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.809 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.819 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.821 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.832 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.834 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.859 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:13 +0000 (0:00:00.101) 0:01:05.558 ******* 2021-03-24T11:59:13.868 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-24T11:59:13.869 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.870 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.871 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.871 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.872 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => 2021-03-24T11:59:13.874 INFO:teuthology.task.ansible.out:(item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.891 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.893 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.905 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.916 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.917 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.928 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.939 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.951 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.962 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.973 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-03-24T11:59:13.975 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:13.999 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:13 +0000 (0:00:00.139) 0:01:05.697 ******* 2021-03-24T11:59:14.010 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:14.011 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:14.013 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:14.014 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:14.015 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:14.080 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:14 +0000 (0:00:00.077) 0:01:05.775 ******* 2021-03-24T11:59:14.105 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-03-24T11:59:14.107 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:14.132 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:14 +0000 (0:00:00.056) 0:01:05.831 ******* 2021-03-24T11:59:14.162 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:14.198 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:14 +0000 (0:00:00.065) 0:01:05.897 ******* 2021-03-24T11:59:14.221 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:14.222 INFO:teuthology.task.ansible.out:TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:14.253 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:14 +0000 (0:00:00.054) 0:01:05.951 ******* 2021-03-24T11:59:14.339 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-03-24T11:59:14.341 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:14.377 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:14 +0000 (0:00:00.124) 0:01:06.076 ******* 2021-03-24T11:59:14.487 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:14.489 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-03-24T11:59:14.531 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-03-24T11:59:14.533 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:14.544 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:14.574 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:14 +0000 (0:00:00.196) 0:01:06.272 ******* 2021-03-24T11:59:14.626 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:14.628 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-03-24T11:59:14.692 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-03-24T11:59:14.694 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:14.706 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:14.733 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:14 +0000 (0:00:00.156) 0:01:06.429 ******* 2021-03-24T11:59:14.769 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:14.771 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-03-24T11:59:14.802 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-24T11:59:14.804 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:14.826 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:14 +0000 (0:00:00.095) 0:01:06.524 ******* 2021-03-24T11:59:14.908 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:14.910 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** ok: [smithi161.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-03-24T11:59:15.049 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-24T11:59:15.051 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.013681", "end": "2021-03-24 11:59:15.024689", "rc": 0, "start": "2021-03-24 11:59:15.011008", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-03-24T11:59:15.074 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:15 +0000 (0:00:00.248) 0:01:06.773 ******* 2021-03-24T11:59:15.076 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:15.084 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:15.086 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-03-24T11:59:15.156 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:15.158 INFO:teuthology.task.ansible.out:TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:15.180 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:15 +0000 (0:00:00.106) 0:01:06.879 ******* 2021-03-24T11:59:15.182 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:15.200 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:15.202 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** ok: [smithi161.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-03-24T11:59:15.265 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-03-24T11:59:15.267 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:15.293 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:15 +0000 (0:00:00.113) 0:01:06.992 ******* 2021-03-24T11:59:15.335 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:15.336 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-03-24T11:59:15.367 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-24T11:59:15.369 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:15.379 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:15.381 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:15.390 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:15.414 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:15 +0000 (0:00:00.120) 0:01:07.113 ******* 2021-03-24T11:59:15.475 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:15.477 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-03-24T11:59:15.487 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-24T11:59:15.488 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:15.512 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:15 +0000 (0:00:00.097) 0:01:07.211 ******* 2021-03-24T11:59:15.584 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-03-24T11:59:15.586 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:15.609 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:15 +0000 (0:00:00.096) 0:01:07.308 ******* 2021-03-24T11:59:15.632 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:15.635 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-03-24T11:59:15.709 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:15.735 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:15 +0000 (0:00:00.124) 0:01:07.433 ******* 2021-03-24T11:59:15.775 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:15.777 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-03-24T11:59:15.778 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:15.831 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:15.833 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:15.867 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:15 +0000 (0:00:00.132) 0:01:07.566 ******* 2021-03-24T11:59:15.938 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:15.941 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-03-24T11:59:15.971 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:15.996 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:15 +0000 (0:00:00.129) 0:01:07.695 ******* 2021-03-24T11:59:16.081 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:16.084 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-03-24T11:59:16.233 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-03-24T11:59:16.373 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-03-24T11:59:16.532 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-03-24T11:59:16.544 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.377163", "end": "2021-03-24 11:59:16.500365", "rc": 0, "start": "2021-03-24 11:59:16.123202", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T11:59:16.579 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:16 +0000 (0:00:00.582) 0:01:08.277 ******* 2021-03-24T11:59:16.705 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:16.726 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:16 +0000 (0:00:00.147) 0:01:08.425 ******* 2021-03-24T11:59:16.748 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:16.750 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-03-24T11:59:16.866 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-03-24T11:59:16.973 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-03-24T11:59:16.975 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.044640", "end": "2021-03-24 11:59:16.952676", "rc": 0, "start": "2021-03-24 11:59:16.908036", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T11:59:17.008 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:17 +0000 (0:00:00.280) 0:01:08.706 ******* 2021-03-24T11:59:17.029 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:17.030 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-03-24T11:59:17.168 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-03-24T11:59:17.310 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-03-24T11:59:17.448 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-03-24T11:59:17.596 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-03-24T11:59:17.733 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-03-24T11:59:17.876 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-03-24T11:59:18.013 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-03-24T11:59:18.149 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-03-24T11:59:18.297 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-03-24T11:59:18.437 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-03-24T11:59:18.573 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-03-24T11:59:18.720 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-03-24T11:59:18.858 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-03-24T11:59:18.988 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-03-24T11:59:19.138 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-03-24T11:59:19.276 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-03-24T11:59:19.416 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-03-24T11:59:19.553 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-03-24T11:59:19.695 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-03-24T11:59:19.837 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-03-24T11:59:19.981 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-03-24T11:59:20.130 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-03-24T11:59:20.279 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-03-24T11:59:20.420 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-03-24T11:59:20.559 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-03-24T11:59:20.699 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-03-24T11:59:20.850 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-03-24T11:59:20.992 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-03-24T11:59:21.047 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-03-24T11:59:21.049 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1616586868, "cache_updated": false, "changed": false} 2021-03-24T11:59:21.081 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:21 +0000 (0:00:04.073) 0:01:12.779 ******* 2021-03-24T11:59:21.132 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-24T11:59:21.134 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-03-24T11:59:21.290 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-03-24T11:59:21.431 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-03-24T11:59:21.500 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:21 +0000 (0:00:00.419) 0:01:13.199 ******* 2021-03-24T11:59:21.941 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-03-24T11:59:21.943 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "checksum": "1d9711ff879c231c67cb70d00ca0088797a377d0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "80a55def4b505d08aff3687f81f74dc2", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616587161.5998793-17632-17643658320184/source", "state": "file", "uid": 0} 2021-03-24T11:59:21.964 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:21 +0000 (0:00:00.463) 0:01:13.663 ******* 2021-03-24T11:59:22.045 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-03-24T11:59:22.047 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => { "msg": "Host smithi161.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-03-24T11:59:22.079 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:22 +0000 (0:00:00.112) 0:01:13.775 ******* 2021-03-24T11:59:22.088 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-03-24T11:59:22.089 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"cache_update_time": 1616586868, "cache_updated": false, "changed": false} 2021-03-24T11:59:22.117 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:22 +0000 (0:00:00.039) 0:01:13.815 ******* 2021-03-24T11:59:22.167 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-03-24T11:59:22.169 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-03-24T11:59:22.193 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:22 +0000 (0:00:00.076) 0:01:13.892 ******* 2021-03-24T11:59:22.199 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-03-24T11:59:22.202 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:22.229 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:22 +0000 (0:00:00.036) 0:01:13.928 ******* 2021-03-24T11:59:22.279 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-03-24T11:59:22.280 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:22.306 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:22 +0000 (0:00:00.077) 0:01:14.005 ******* 2021-03-24T11:59:22.377 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-03-24T11:59:22.379 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:22.402 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:22 +0000 (0:00:00.095) 0:01:14.100 ******* 2021-03-24T11:59:22.470 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-03-24T11:59:22.472 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:22.494 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:22 +0000 (0:00:00.092) 0:01:14.193 ******* 2021-03-24T11:59:22.563 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-03-24T11:59:22.565 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:22.587 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:22 +0000 (0:00:00.092) 0:01:14.286 ******* 2021-03-24T11:59:22.659 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-03-24T11:59:22.661 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:22.683 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:22 +0000 (0:00:00.095) 0:01:14.382 ******* 2021-03-24T11:59:22.753 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:22.777 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:22 +0000 (0:00:00.093) 0:01:14.476 ******* 2021-03-24T11:59:22.857 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-03-24T11:59:22.859 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:22.880 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:22 +0000 (0:00:00.103) 0:01:14.579 ******* 2021-03-24T11:59:22.911 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-03-24T11:59:22.912 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-03-24T11:59:22.941 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:22 +0000 (0:00:00.060) 0:01:14.640 ******* 2021-03-24T11:59:22.943 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:22.961 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-03-24T11:59:22.964 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:22.989 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:22 +0000 (0:00:00.046) 0:01:14.686 ******* 2021-03-24T11:59:23.214 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi161.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} Wednesday 24 March 2021 11:59:23 +0000 (0:00:00.105) 0:01:14.791 ******* TASK [common : Set have_entitlements] ****************************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 24 March 2021 11:59:23 +0000 (0:00:00.093) 0:01:14.884 ******* 2021-03-24T11:59:23.265 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-03-24T11:59:23.267 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:23.292 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:23 +0000 (0:00:00.106) 0:01:14.991 ******* 2021-03-24T11:59:23.361 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-03-24T11:59:23.363 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-24T11:59:23.385 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:23 +0000 (0:00:00.092) 0:01:15.084 ******* 2021-03-24T11:59:23.454 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-03-24T11:59:23.456 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:23.480 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:23 +0000 (0:00:00.094) 0:01:15.178 ******* 2021-03-24T11:59:23.543 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-03-24T11:59:23.545 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-24T11:59:23.567 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:23 +0000 (0:00:00.087) 0:01:15.266 ******* 2021-03-24T11:59:23.635 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-03-24T11:59:23.637 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:23.663 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:23 +0000 (0:00:00.096) 0:01:15.362 ******* 2021-03-24T11:59:23.732 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-03-24T11:59:23.734 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:23.756 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:23 +0000 (0:00:00.092) 0:01:15.454 ******* 2021-03-24T11:59:23.826 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-03-24T11:59:23.828 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:23.850 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:23 +0000 (0:00:00.093) 0:01:15.548 ******* 2021-03-24T11:59:23.891 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-03-24T11:59:23.893 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"cache_update_time": 1616586868, "cache_updated": false, "changed": false} 2021-03-24T11:59:23.923 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:23 +0000 (0:00:00.073) 0:01:15.622 ******* 2021-03-24T11:59:23.930 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-03-24T11:59:23.931 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:23.958 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:23 +0000 (0:00:00.034) 0:01:15.657 ******* 2021-03-24T11:59:24.028 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-03-24T11:59:24.029 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-24T11:59:24.059 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:24 +0000 (0:00:00.100) 0:01:15.757 ******* 2021-03-24T11:59:24.142 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:24.168 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:24 +0000 (0:00:00.109) 0:01:15.867 ******* 2021-03-24T11:59:24.239 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-03-24T11:59:24.241 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:24.264 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:24 +0000 (0:00:00.096) 0:01:15.963 ******* 2021-03-24T11:59:24.334 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-03-24T11:59:24.336 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:24.363 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:24 +0000 (0:00:00.098) 0:01:16.062 ******* 2021-03-24T11:59:24.435 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-03-24T11:59:24.437 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:24.461 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:24 +0000 (0:00:00.098) 0:01:16.160 ******* 2021-03-24T11:59:24.530 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-03-24T11:59:24.532 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:24.560 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:24 +0000 (0:00:00.099) 0:01:16.259 ******* 2021-03-24T11:59:24.603 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:24.605 INFO:teuthology.task.ansible.out:TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi043.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-03-24T11:59:24.638 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-03-24T11:59:24.640 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:24.663 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:24 +0000 (0:00:00.102) 0:01:16.362 ******* 2021-03-24T11:59:24.664 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:24.745 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-03-24T11:59:24.748 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-24T11:59:24.773 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:24 +0000 (0:00:00.108) 0:01:16.471 ******* 2021-03-24T11:59:24.853 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:24.878 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:24 +0000 (0:00:00.105) 0:01:16.577 ******* 2021-03-24T11:59:24.951 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-24T11:59:24.953 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:24.977 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:24 +0000 (0:00:00.098) 0:01:16.676 ******* 2021-03-24T11:59:25.059 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:25.087 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:25 +0000 (0:00:00.109) 0:01:16.785 ******* 2021-03-24T11:59:25.182 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-03-24T11:59:25.184 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:25.211 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:25 +0000 (0:00:00.123) 0:01:16.909 ******* 2021-03-24T11:59:25.293 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-24T11:59:25.295 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-03-24T11:59:25.323 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:25 +0000 (0:00:00.112) 0:01:17.022 ******* 2021-03-24T11:59:25.338 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:25.344 INFO:teuthology.task.ansible.out:TASK [common : Configure local epel mirrorlists] ******************************* 2021-03-24T11:59:25.346 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:25.376 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:25 +0000 (0:00:00.052) 0:01:17.075 ******* 2021-03-24T11:59:25.472 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-03-24T11:59:25.474 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} TASK [common : Clean yum cache] ************************************************ skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:25.498 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:25 +0000 (0:00:00.121) 0:01:17.197 ******* 2021-03-24T11:59:25.537 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:25 +0000 (0:00:00.038) 0:01:17.235 ******* 2021-03-24T11:59:25.751 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-24T11:59:25.753 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.018298", "end": "2021-03-24 11:59:25.330075", "rc": 0, "start": "2021-03-24 11:59:25.311777", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-03-24T11:59:25.780 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:25 +0000 (0:00:00.242) 0:01:17.478 ******* 2021-03-24T11:59:25.853 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-03-24T11:59:25.855 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:25.877 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:25 +0000 (0:00:00.097) 0:01:17.576 ******* 2021-03-24T11:59:25.929 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-24T11:59:25.931 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-03-24T11:59:25.953 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-03-24T11:59:25.954 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:25.977 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:25 +0000 (0:00:00.100) 0:01:17.676 ******* 2021-03-24T11:59:26.065 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-24T11:59:26.067 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:26.077 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:26.088 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:26.090 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:26.115 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:26 +0000 (0:00:00.137) 0:01:17.813 ******* 2021-03-24T11:59:26.206 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-24T11:59:26.215 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:26.234 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:26 +0000 (0:00:00.119) 0:01:17.933 ******* 2021-03-24T11:59:26.245 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-24T11:59:26.247 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-03-24T11:59:26.321 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:26.348 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:26 +0000 (0:00:00.113) 0:01:18.046 ******* 2021-03-24T11:59:26.429 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:26.454 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:26 +0000 (0:00:00.105) 0:01:18.152 ******* 2021-03-24T11:59:26.546 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-03-24T11:59:26.547 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:26.586 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:26 +0000 (0:00:00.132) 0:01:18.285 ******* 2021-03-24T11:59:26.597 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-24T11:59:26.601 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-03-24T11:59:26.634 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:26 +0000 (0:00:00.048) 0:01:18.333 ******* 2021-03-24T11:59:26.677 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-03-24T11:59:26.680 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:26.715 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:26 +0000 (0:00:00.080) 0:01:18.413 ******* 2021-03-24T11:59:26.738 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-03-24T11:59:26.739 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-03-24T11:59:26.777 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:26 +0000 (0:00:00.062) 0:01:18.476 ******* 2021-03-24T11:59:26.868 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-03-24T11:59:26.870 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:26.894 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:26 +0000 (0:00:00.116) 0:01:18.592 ******* 2021-03-24T11:59:26.923 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-03-24T11:59:26.925 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.065491", "end": "2021-03-24 11:59:26.500337", "rc": 0, "start": "2021-03-24 11:59:26.434846", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T11:59:26.949 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:26 +0000 (0:00:00.055) 0:01:18.648 ******* 2021-03-24T11:59:26.978 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-03-24T11:59:26.979 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-24T11:59:27.009 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:27 +0000 (0:00:00.059) 0:01:18.708 ******* 2021-03-24T11:59:27.050 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-03-24T11:59:27.052 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:27.085 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:27 +0000 (0:00:00.075) 0:01:18.784 ******* 2021-03-24T11:59:27.103 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-03-24T11:59:27.105 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:27.116 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:27.127 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:27.129 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:27.155 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:27 +0000 (0:00:00.069) 0:01:18.853 ******* 2021-03-24T11:59:27.156 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:27.249 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:27.251 INFO:teuthology.task.ansible.out:TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:27.274 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:27 +0000 (0:00:00.119) 0:01:18.973 ******* 2021-03-24T11:59:27.354 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-03-24T11:59:27.357 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.057070", "end": "2021-03-24 11:59:26.929240", "rc": 0, "start": "2021-03-24 11:59:26.872170", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T11:59:27.381 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:27 +0000 (0:00:00.107) 0:01:19.080 ******* 2021-03-24T11:59:28.254 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-03-24T11:59:28.257 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"cache_update_time": 1616586868, "cache_updated": false, "changed": false} 2021-03-24T11:59:28.280 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:28 +0000 (0:00:00.896) 0:01:19.977 ******* 2021-03-24T11:59:28.688 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-03-24T11:59:28.690 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-03-24T11:59:28.716 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:28 +0000 (0:00:00.437) 0:01:20.415 ******* 2021-03-24T11:59:29.200 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-03-24T11:59:29.202 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-03-24T11:59:29.229 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:29 +0000 (0:00:00.512) 0:01:20.928 ******* 2021-03-24T11:59:29.479 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-24T11:59:29.481 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-03-24T11:59:29.593 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-03-24T11:59:29.619 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:29 +0000 (0:00:00.389) 0:01:21.318 ******* 2021-03-24T11:59:29.690 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:29.713 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:29 +0000 (0:00:00.093) 0:01:21.412 ******* 2021-03-24T11:59:29.814 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-03-24T11:59:29.816 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-24T11:59:29.848 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:29 +0000 (0:00:00.135) 0:01:21.547 ******* 2021-03-24T11:59:30.001 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:30.026 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:30 +0000 (0:00:00.177) 0:01:21.724 ******* 2021-03-24T11:59:30.466 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-03-24T11:59:30.468 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-03-24T11:59:30.512 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:30 +0000 (0:00:00.486) 0:01:22.211 ******* 2021-03-24T11:59:30.979 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-03-24T11:59:30.981 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1616586912, "cache_updated": false, "changed": false} 2021-03-24T11:59:31.003 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:31 +0000 (0:00:00.491) 0:01:22.702 ******* 2021-03-24T11:59:31.280 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-03-24T11:59:31.281 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-24 11:57:27 UTC", "ActiveEnterTimestampMonotonic": "17483055", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount local-fs.target nss-lookup.target remote-fs.target systemd-tmpfiles-setup.service systemd-journald.socket network.target system.slice basic.target time-sync.target var-run.mount sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-24 11:57:27 UTC", "AssertTimestampMonotonic": "17482040", "Before": "plymouth-quit.service xdm.service multi-user.target getty@tty1.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-24 11:57:27 UTC", "ConditionTimestampMonotonic": "17482038", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-03-24T11:59:31.283 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1461", "ExecMainStartTimestamp": "Wed 2021-03-24 11:57:27 UTC", "ExecMainStartTimestampMonotonic": "17483021", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-03-24 11:57:27 UTC] ; stop_time=[n/a] ; pid=1461 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-24 11:57:27 UTC", "InactiveExitTimestampMonotonic": "17483055", "InvocationID": "fae5afce48c9428b88f459cb2e3f3174", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2021-03-24T11:59:31.285 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1461", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2021-03-24T11:59:31.286 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-24 11:57:27 UTC", "StateChangeTimestampMonotonic": "17483055", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2021-03-24 11:57:27 UTC", "WatchdogTimestampMonotonic": "17483053", "WatchdogUSec": "0"}} 2021-03-24T11:59:31.306 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:31 +0000 (0:00:00.302) 0:01:23.005 ******* 2021-03-24T11:59:31.380 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:31.404 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:31 +0000 (0:00:00.097) 0:01:23.102 ******* 2021-03-24T11:59:31.473 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-03-24T11:59:31.475 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:31.498 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:31 +0000 (0:00:00.094) 0:01:23.197 ******* 2021-03-24T11:59:31.568 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-03-24T11:59:31.570 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:31.595 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:31 +0000 (0:00:00.096) 0:01:23.293 ******* 2021-03-24T11:59:31.664 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-03-24T11:59:31.666 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:31.691 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:31 +0000 (0:00:00.096) 0:01:23.390 ******* 2021-03-24T11:59:31.761 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-03-24T11:59:31.763 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:31.787 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:31 +0000 (0:00:00.095) 0:01:23.486 ******* 2021-03-24T11:59:31.989 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1616586912, "cache_updated": false, "changed": false} 2021-03-24T11:59:32.013 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:32 +0000 (0:00:00.225) 0:01:23.711 ******* 2021-03-24T11:59:32.019 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-03-24T11:59:32.021 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:32.046 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:32 +0000 (0:00:00.032) 0:01:23.744 ******* 2021-03-24T11:59:32.211 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:32.243 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:32 +0000 (0:00:00.197) 0:01:23.941 ******* 2021-03-24T11:59:32.250 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-03-24T11:59:32.252 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:32.277 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:32 +0000 (0:00:00.034) 0:01:23.976 ******* 2021-03-24T11:59:32.477 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-03-24T11:59:32.478 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:32.503 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:32 +0000 (0:00:00.225) 0:01:24.202 ******* 2021-03-24T11:59:32.587 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-03-24T11:59:32.589 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:32.617 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:32 +0000 (0:00:00.113) 0:01:24.315 ******* 2021-03-24T11:59:32.687 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-03-24T11:59:32.689 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:32.717 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:32 +0000 (0:00:00.100) 0:01:24.416 ******* 2021-03-24T11:59:32.770 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-03-24T11:59:32.772 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-03-24T11:59:32.798 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:32 +0000 (0:00:00.081) 0:01:24.497 ******* 2021-03-24T11:59:32.817 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-03-24T11:59:32.819 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-03-24T11:59:32.846 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:32 +0000 (0:00:00.047) 0:01:24.545 ******* 2021-03-24T11:59:32.950 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-03-24T11:59:32.952 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-03-24T11:59:32.979 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:32 +0000 (0:00:00.133) 0:01:24.678 ******* 2021-03-24T11:59:33.071 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-03-24T11:59:33.073 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-03-24T11:59:33.098 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:33 +0000 (0:00:00.118) 0:01:24.797 ******* 2021-03-24T11:59:33.327 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-03-24T11:59:33.329 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-24T11:59:33.351 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:33 +0000 (0:00:00.253) 0:01:25.050 ******* 2021-03-24T11:59:33.507 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-24T11:59:33.751 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:33 +0000 (0:00:00.178) 0:01:25.229 ******* TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1616586912, "cache_updated": false, "changed": false} 2021-03-24T11:59:33.771 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:33 +0000 (0:00:00.240) 0:01:25.470 ******* 2021-03-24T11:59:33.901 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-03-24T11:59:33.903 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-03-24T11:59:33.929 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:33 +0000 (0:00:00.157) 0:01:25.628 ******* 2021-03-24T11:59:34.250 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-03-24T11:59:34.252 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:34.379 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:34 +0000 (0:00:00.450) 0:01:26.078 ******* 2021-03-24T11:59:34.450 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-03-24T11:59:34.452 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:34.481 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:34 +0000 (0:00:00.101) 0:01:26.180 ******* 2021-03-24T11:59:34.520 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-24T11:59:34.522 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-03-24T11:59:34.709 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi043.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-03-24T11:59:34.742 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:34 +0000 (0:00:00.260) 0:01:26.440 ******* 2021-03-24T11:59:34.848 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-24T11:59:34.850 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-03-24T11:59:35.170 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-03-24T11:59:35.196 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:35 +0000 (0:00:00.452) 0:01:26.893 ******* 2021-03-24T11:59:35.223 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-03-24T11:59:35.225 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-03-24T11:59:35.250 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:35 +0000 (0:00:00.055) 0:01:26.949 ******* 2021-03-24T11:59:35.343 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-03-24T11:59:35.345 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi043"}, "changed": false} TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-03-24T11:59:35.380 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:35 +0000 (0:00:00.129) 0:01:27.078 ******* 2021-03-24T11:59:35.405 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:35 +0000 (0:00:00.024) 0:01:27.103 ******* 2021-03-24T11:59:35.816 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-24T11:59:35.819 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-03-24T11:59:36.103 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-03-24T11:59:36.323 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-03-24T11:59:36.325 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi043.front.sepia.ceph.com", "ansible_hostname": "smithi043", "ansible_nodename": "smithi043"}, "changed": true, "name": "smithi043"} 2021-03-24T11:59:36.348 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:36 +0000 (0:00:00.942) 0:01:28.046 ******* 2021-03-24T11:59:36.386 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-24T11:59:36.388 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-03-24T11:59:36.416 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:36 +0000 (0:00:00.068) 0:01:28.114 ******* 2021-03-24T11:59:36.496 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-03-24T11:59:36.498 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-03-24T11:59:36.521 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:36 +0000 (0:00:00.104) 0:01:28.219 ******* 2021-03-24T11:59:36.590 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-03-24T11:59:36.592 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:36.616 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:36 +0000 (0:00:00.094) 0:01:28.314 ******* 2021-03-24T11:59:36.685 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-03-24T11:59:36.687 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-24T11:59:36.709 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:36 +0000 (0:00:00.093) 0:01:28.407 ******* 2021-03-24T11:59:36.746 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-03-24T11:59:36.748 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-03-24T11:59:36.772 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:36 +0000 (0:00:00.062) 0:01:28.470 ******* 2021-03-24T11:59:36.788 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-03-24T11:59:36.790 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:36.800 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:36.802 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:36.828 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:36 +0000 (0:00:00.056) 0:01:28.527 ******* 2021-03-24T11:59:36.906 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:36.930 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:36 +0000 (0:00:00.101) 0:01:28.628 ******* 2021-03-24T11:59:37.193 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-03-24T11:59:37.195 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-03-24T11:59:37.221 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:37 +0000 (0:00:00.290) 0:01:28.919 ******* 2021-03-24T11:59:37.751 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-03-24T11:59:37.753 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-03-24T11:59:37.780 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:37 +0000 (0:00:00.559) 0:01:29.478 ******* 2021-03-24T11:59:37.851 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-03-24T11:59:37.853 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:37.876 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:37 +0000 (0:00:00.095) 0:01:29.575 ******* 2021-03-24T11:59:37.955 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-24T11:59:37.957 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:37.982 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:37 +0000 (0:00:00.105) 0:01:29.680 ******* 2021-03-24T11:59:37.988 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-03-24T11:59:37.990 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1616586912, "cache_updated": false, "changed": false} 2021-03-24T11:59:38.016 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:38 +0000 (0:00:00.034) 0:01:29.714 ******* 2021-03-24T11:59:38.047 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-24T11:59:38.049 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:38.073 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:38 +0000 (0:00:00.057) 0:01:29.772 ******* 2021-03-24T11:59:38.135 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-24T11:59:38.137 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:38.160 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:38 +0000 (0:00:00.087) 0:01:29.859 ******* 2021-03-24T11:59:38.232 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-24T11:59:38.234 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:38.259 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:38 +0000 (0:00:00.098) 0:01:29.957 ******* 2021-03-24T11:59:38.328 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-24T11:59:38.330 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:38.352 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:38 +0000 (0:00:00.093) 0:01:30.050 ******* 2021-03-24T11:59:38.390 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-03-24T11:59:38.392 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-03-24T11:59:38.419 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:38 +0000 (0:00:00.066) 0:01:30.117 ******* 2021-03-24T11:59:38.437 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-24T11:59:38.439 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:38.468 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:38 +0000 (0:00:00.048) 0:01:30.166 ******* 2021-03-24T11:59:38.553 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-03-24T11:59:38.555 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:38.581 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:38 +0000 (0:00:00.112) 0:01:30.279 ******* 2021-03-24T11:59:38.663 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-03-24T11:59:38.702 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:38 +0000 (0:00:00.121) 0:01:30.401 ******* 2021-03-24T11:59:38.796 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-03-24T11:59:38.820 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:38 +0000 (0:00:00.117) 0:01:30.519 ******* 2021-03-24T11:59:38.827 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-03-24T11:59:38.829 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-03-24T11:59:38.855 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:38 +0000 (0:00:00.034) 0:01:30.553 ******* 2021-03-24T11:59:38.895 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-03-24T11:59:38.926 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:38 +0000 (0:00:00.071) 0:01:30.624 ******* 2021-03-24T11:59:38.998 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-03-24T11:59:39.000 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:39.023 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:39 +0000 (0:00:00.097) 0:01:30.722 ******* 2021-03-24T11:59:39.063 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-24T11:59:39.065 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-03-24T11:59:39.106 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-03-24T11:59:39.108 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:39.130 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:39 +0000 (0:00:00.107) 0:01:30.829 ******* 2021-03-24T11:59:39.180 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-24T11:59:39.181 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-03-24T11:59:39.207 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:39 +0000 (0:00:00.076) 0:01:30.906 ******* 2021-03-24T11:59:39.209 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:39.214 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-03-24T11:59:39.216 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:39.241 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:39 +0000 (0:00:00.033) 0:01:30.939 ******* 2021-03-24T11:59:39.279 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-03-24T11:59:39.281 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:39.304 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:39 +0000 (0:00:00.063) 0:01:31.003 ******* 2021-03-24T11:59:39.322 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-24T11:59:39.324 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:39.349 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:39 +0000 (0:00:00.044) 0:01:31.047 ******* 2021-03-24T11:59:39.376 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-03-24T11:59:39.378 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-24T11:59:39.402 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:39 +0000 (0:00:00.053) 0:01:31.101 ******* 2021-03-24T11:59:39.421 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-03-24T11:59:39.423 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:39.450 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:39 +0000 (0:00:00.046) 0:01:31.147 ******* 2021-03-24T11:59:39.489 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-03-24T11:59:39.490 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:39.515 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:39 +0000 (0:00:00.067) 0:01:31.214 ******* 2021-03-24T11:59:39.533 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-03-24T11:59:39.535 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:39.558 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:39 +0000 (0:00:00.042) 0:01:31.257 ******* 2021-03-24T11:59:39.633 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:39.656 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:39 +0000 (0:00:00.098) 0:01:31.355 ******* 2021-03-24T11:59:39.736 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:39.764 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:39 +0000 (0:00:00.107) 0:01:31.463 ******* 2021-03-24T11:59:39.834 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-24T11:59:39.836 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:39.859 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:39 +0000 (0:00:00.094) 0:01:31.557 ******* 2021-03-24T11:59:39.918 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-03-24T11:59:39.920 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-03-24T11:59:39.943 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:39 +0000 (0:00:00.084) 0:01:31.641 ******* 2021-03-24T11:59:39.950 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-24T11:59:39.952 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:39.979 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:39 +0000 (0:00:00.036) 0:01:31.678 ******* 2021-03-24T11:59:40.083 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:40.107 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:40 +0000 (0:00:00.128) 0:01:31.806 ******* 2021-03-24T11:59:40.188 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-03-24T11:59:40.189 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:40.211 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:40 +0000 (0:00:00.103) 0:01:31.909 ******* 2021-03-24T11:59:40.218 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-03-24T11:59:40.220 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-24 11:57:57 UTC", "ActiveEnterTimestampMonotonic": "19560723", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service remote-fs.target system.slice -.mount systemd-journald.socket var-run.mount local-fs.target network.target sysinit.target time-sync.target nss-lookup.target basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-24 11:57:57 UTC", "AssertTimestampMonotonic": "19559802", "Before": "multi-user.target getty@tty1.service plymouth-quit.service xdm.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-24 11:57:57 UTC", "ConditionTimestampMonotonic": "19559802", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-03-24T11:59:40.222 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1476", "ExecMainStartTimestamp": "Wed 2021-03-24 11:57:57 UTC", "ExecMainStartTimestampMonotonic": "19560690", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-03-24 11:57:57 UTC] ; stop_time=[n/a] ; pid=1476 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-24 11:57:57 UTC", "InactiveExitTimestampMonotonic": "19560723", "InvocationID": "3f60a68989f946f0ab38f8883c0038cc", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2021-03-24T11:59:40.223 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1476", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2021-03-24T11:59:40.225 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-24 11:57:57 UTC", "StateChangeTimestampMonotonic": "19560723", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2021-03-24 11:57:57 UTC", "WatchdogTimestampMonotonic": "19560722", "WatchdogUSec": "0"}} 2021-03-24T11:59:40.248 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:40 +0000 (0:00:00.037) 0:01:31.947 ******* 2021-03-24T11:59:40.250 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:40.291 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:40.316 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:40 +0000 (0:00:00.067) 0:01:32.014 ******* 2021-03-24T11:59:40.334 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-03-24T11:59:40.336 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:40.364 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:40 +0000 (0:00:00.048) 0:01:32.063 ******* 2021-03-24T11:59:40.404 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-24T11:59:40.405 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:40.432 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:40 +0000 (0:00:00.067) 0:01:32.131 ******* 2021-03-24T11:59:40.449 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-03-24T11:59:40.450 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:40.489 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:40 +0000 (0:00:00.057) 0:01:32.188 ******* 2021-03-24T11:59:40.508 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-03-24T11:59:40.510 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:40.540 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:40 +0000 (0:00:00.050) 0:01:32.238 ******* 2021-03-24T11:59:40.569 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-03-24T11:59:40.571 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:40.597 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:40 +0000 (0:00:00.057) 0:01:32.296 ******* 2021-03-24T11:59:40.625 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-03-24T11:59:40.627 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:40.652 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:40 +0000 (0:00:00.054) 0:01:32.351 ******* 2021-03-24T11:59:40.671 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-03-24T11:59:40.673 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:40.704 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:40 +0000 (0:00:00.051) 0:01:32.402 ******* 2021-03-24T11:59:40.722 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-03-24T11:59:40.724 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:40.755 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:40 +0000 (0:00:00.051) 0:01:32.453 ******* 2021-03-24T11:59:40.783 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-03-24T11:59:40.784 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:40.808 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:40 +0000 (0:00:00.053) 0:01:32.507 ******* 2021-03-24T11:59:40.835 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-03-24T11:59:40.837 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:40.862 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:40 +0000 (0:00:00.053) 0:01:32.561 ******* 2021-03-24T11:59:40.902 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-03-24T11:59:40.904 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:40.927 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:40 +0000 (0:00:00.064) 0:01:32.625 ******* 2021-03-24T11:59:40.934 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-03-24T11:59:40.936 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:40.963 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:40 +0000 (0:00:00.036) 0:01:32.662 ******* 2021-03-24T11:59:41.002 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:41.031 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:41 +0000 (0:00:00.067) 0:01:32.730 ******* 2021-03-24T11:59:41.050 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-03-24T11:59:41.052 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:41.077 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:41 +0000 (0:00:00.045) 0:01:32.775 ******* 2021-03-24T11:59:41.126 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:41.151 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:41 +0000 (0:00:00.073) 0:01:32.849 ******* 2021-03-24T11:59:41.169 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-03-24T11:59:41.170 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:41.204 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:41 +0000 (0:00:00.053) 0:01:32.902 ******* 2021-03-24T11:59:41.243 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-03-24T11:59:41.245 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:41.269 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:41 +0000 (0:00:00.065) 0:01:32.968 ******* 2021-03-24T11:59:41.286 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-03-24T11:59:41.288 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:41.312 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:41 +0000 (0:00:00.043) 0:01:33.011 ******* 2021-03-24T11:59:41.314 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:41.342 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-03-24T11:59:41.344 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:41.368 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:41 +0000 (0:00:00.055) 0:01:33.067 ******* 2021-03-24T11:59:41.448 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-03-24T11:59:41.450 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-03-24T11:59:41.474 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:41 +0000 (0:00:00.106) 0:01:33.173 ******* 2021-03-24T11:59:41.503 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-03-24T11:59:41.505 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005236", "end": "2021-03-24 11:59:41.481786", "rc": 0, "start": "2021-03-24 11:59:41.476550", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T11:59:41.531 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:41 +0000 (0:00:00.056) 0:01:33.229 ******* 2021-03-24T11:59:41.561 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-03-24T11:59:41.563 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-03-24T11:59:41.590 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:41 +0000 (0:00:00.058) 0:01:33.288 ******* 2021-03-24T11:59:41.609 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-03-24T11:59:41.638 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:41 +0000 (0:00:00.048) 0:01:33.336 ******* 2021-03-24T11:59:41.679 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-03-24T11:59:41.680 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-03-24T11:59:41.705 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:41 +0000 (0:00:00.067) 0:01:33.404 ******* 2021-03-24T11:59:41.796 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-03-24T11:59:41.798 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-24T11:59:41.823 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:41 +0000 (0:00:00.117) 0:01:33.521 ******* 2021-03-24T11:59:41.969 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-03-24T11:59:41.971 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-24T11:59:41.993 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:41 +0000 (0:00:00.169) 0:01:33.691 ******* 2021-03-24T11:59:42.042 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-03-24T11:59:42.069 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:42 +0000 (0:00:00.076) 0:01:33.768 ******* 2021-03-24T11:59:42.152 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-03-24T11:59:42.153 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:42.181 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:42 +0000 (0:00:00.112) 0:01:33.880 ******* 2021-03-24T11:59:42.189 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-03-24T11:59:42.216 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:42 +0000 (0:00:00.035) 0:01:33.915 ******* 2021-03-24T11:59:42.296 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-03-24T11:59:42.298 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:42.321 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:42 +0000 (0:00:00.104) 0:01:34.020 ******* 2021-03-24T11:59:42.391 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-03-24T11:59:42.393 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:42.423 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:42 +0000 (0:00:00.101) 0:01:34.121 ******* 2021-03-24T11:59:42.662 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi161.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-03-24T11:59:42.688 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:42 +0000 (0:00:00.264) 0:01:34.386 ******* 2021-03-24T11:59:43.153 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-03-24T11:59:43.154 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-03-24T11:59:43.179 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:43 +0000 (0:00:00.491) 0:01:34.878 ******* 2021-03-24T11:59:43.294 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi161"}, "changed": false} 2021-03-24T11:59:43.318 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:43 +0000 (0:00:00.138) 0:01:35.017 ******* 2021-03-24T11:59:43.567 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-03-24T11:59:43.569 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-03-24T11:59:43.879 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-03-24T11:59:43.881 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi161.front.sepia.ceph.com", "ansible_hostname": "smithi161", "ansible_nodename": "smithi161"}, "changed": true, "name": "smithi161"} 2021-03-24T11:59:43.908 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:43 +0000 (0:00:00.589) 0:01:35.607 ******* 2021-03-24T11:59:44.323 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-03-24T11:59:44.325 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-03-24T11:59:44.351 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:44 +0000 (0:00:00.442) 0:01:36.050 ******* 2021-03-24T11:59:44.530 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-03-24T11:59:44.533 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-03-24T11:59:44.558 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:44 +0000 (0:00:00.207) 0:01:36.257 ******* 2021-03-24T11:59:44.877 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-03-24T11:59:44.879 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-03-24T11:59:44.905 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:44 +0000 (0:00:00.346) 0:01:36.604 ******* 2021-03-24T11:59:45.450 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-03-24T11:59:45.451 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-03-24T11:59:45.474 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:45 +0000 (0:00:00.568) 0:01:37.173 ******* 2021-03-24T11:59:45.555 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:45.583 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:45 +0000 (0:00:00.106) 0:01:37.279 ******* 2021-03-24T11:59:45.599 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [smithi043.front.sepia.ceph.com] => {"cache_update_time": 1616586868, "cache_updated": false, "changed": false} 2021-03-24T11:59:45.627 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:45 +0000 (0:00:00.045) 0:01:37.325 ******* 2021-03-24T11:59:45.656 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-24T11:59:45.658 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:45.686 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:45 +0000 (0:00:00.057) 0:01:37.383 ******* 2021-03-24T11:59:45.711 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-03-24T11:59:45.739 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:45 +0000 (0:00:00.055) 0:01:37.438 ******* 2021-03-24T11:59:45.759 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:45.784 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:45 +0000 (0:00:00.045) 0:01:37.483 ******* 2021-03-24T11:59:45.867 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-24T11:59:45.869 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:45.891 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:45 +0000 (0:00:00.106) 0:01:37.590 ******* 2021-03-24T11:59:45.961 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-03-24T11:59:45.963 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.033985", "end": "2021-03-24 11:59:45.937965", "rc": 0, "start": "2021-03-24 11:59:45.903980", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:45.989 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:45 +0000 (0:00:00.097) 0:01:37.687 ******* 2021-03-24T11:59:46.011 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:46 +0000 (0:00:00.021) 0:01:37.709 ******* 2021-03-24T11:59:46.081 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:46.257 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:46 +0000 (0:00:00.094) 0:01:37.804 ******* TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 24 March 2021 11:59:46 +0000 (0:00:00.093) 0:01:37.897 ******* 2021-03-24T11:59:46.270 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:46.272 INFO:teuthology.task.ansible.out:TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:46.296 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:46 +0000 (0:00:00.097) 0:01:37.994 ******* 2021-03-24T11:59:46.378 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-03-24T11:59:46.404 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:46 +0000 (0:00:00.108) 0:01:38.102 ******* 2021-03-24T11:59:46.474 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-03-24T11:59:46.499 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:46 +0000 (0:00:00.094) 0:01:38.197 ******* 2021-03-24T11:59:46.583 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:46.584 INFO:teuthology.task.ansible.out:TASK [testnode : Enable copr repos] ******************************************** 2021-03-24T11:59:46.607 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:46 +0000 (0:00:00.108) 0:01:38.306 ******* 2021-03-24T11:59:46.678 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-03-24T11:59:46.680 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:46.712 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:46 +0000 (0:00:00.105) 0:01:38.411 ******* 2021-03-24T11:59:46.817 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-03-24T11:59:46.819 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-24T11:59:46.845 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:46 +0000 (0:00:00.132) 0:01:38.544 ******* 2021-03-24T11:59:46.926 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-03-24T11:59:46.928 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:46.951 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:46 +0000 (0:00:00.105) 0:01:38.649 ******* 2021-03-24T11:59:47.043 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-24T11:59:47.045 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:47.066 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:47 +0000 (0:00:00.115) 0:01:38.765 ******* 2021-03-24T11:59:47.146 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-03-24T11:59:47.148 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:47.175 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:47 +0000 (0:00:00.108) 0:01:38.874 ******* 2021-03-24T11:59:47.255 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-03-24T11:59:47.257 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:47.279 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:47 +0000 (0:00:00.104) 0:01:38.978 ******* 2021-03-24T11:59:47.364 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-03-24T11:59:47.365 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:47.412 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:47 +0000 (0:00:00.132) 0:01:39.110 ******* 2021-03-24T11:59:47.546 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:47.577 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:47 +0000 (0:00:00.159) 0:01:39.270 ******* 2021-03-24T11:59:47.677 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:47.706 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:47 +0000 (0:00:00.131) 0:01:39.401 ******* 2021-03-24T11:59:47.802 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:47.825 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:47 +0000 (0:00:00.122) 0:01:39.524 ******* 2021-03-24T11:59:47.918 INFO:teuthology.task.ansible.out: 2021-03-24T11:59:47.920 INFO:teuthology.task.ansible.out:TASK [testnode : Install packages] ********************************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:47.945 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:47 +0000 (0:00:00.119) 0:01:39.643 ******* 2021-03-24T11:59:48.031 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-03-24T11:59:48.033 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:48.056 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:48 +0000 (0:00:00.111) 0:01:39.755 ******* 2021-03-24T11:59:48.151 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-24T11:59:48.152 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:48.179 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:48 +0000 (0:00:00.122) 0:01:39.878 ******* 2021-03-24T11:59:48.270 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-24T11:59:48.272 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:48.297 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:48 +0000 (0:00:00.117) 0:01:39.996 ******* 2021-03-24T11:59:48.395 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-03-24T11:59:48.397 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:48.425 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:48 +0000 (0:00:00.128) 0:01:40.124 ******* 2021-03-24T11:59:48.520 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-03-24T11:59:48.522 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:48.546 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:48 +0000 (0:00:00.120) 0:01:40.244 ******* 2021-03-24T11:59:48.642 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-03-24T11:59:48.644 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:48.681 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:48 +0000 (0:00:00.135) 0:01:40.380 ******* 2021-03-24T11:59:48.783 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:48.813 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:48 +0000 (0:00:00.132) 0:01:40.512 ******* 2021-03-24T11:59:48.894 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-03-24T11:59:48.896 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:48.918 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:48 +0000 (0:00:00.104) 0:01:40.617 ******* 2021-03-24T11:59:48.994 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-03-24T11:59:48.996 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:49.020 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:49 +0000 (0:00:00.101) 0:01:40.719 ******* 2021-03-24T11:59:49.093 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-03-24T11:59:49.097 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"cache_update_time": 1616586868, "cache_updated": false, "changed": false} 2021-03-24T11:59:49.119 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:49 +0000 (0:00:00.098) 0:01:40.817 ******* 2021-03-24T11:59:49.127 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-03-24T11:59:49.129 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:49.157 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:49 +0000 (0:00:00.038) 0:01:40.856 ******* 2021-03-24T11:59:49.249 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-03-24T11:59:49.251 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:49.279 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:49 +0000 (0:00:00.121) 0:01:40.978 ******* 2021-03-24T11:59:49.513 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005156", "end": "2021-03-24 11:59:49.101830", "rc": 0, "start": "2021-03-24 11:59:49.096674", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T11:59:49.541 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:49 +0000 (0:00:00.261) 0:01:41.239 ******* 2021-03-24T11:59:49.639 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-03-24T11:59:49.663 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:49 +0000 (0:00:00.122) 0:01:41.362 ******* 2021-03-24T11:59:50.115 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-03-24T11:59:50.117 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-03-24T11:59:50.140 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:50 +0000 (0:00:00.476) 0:01:41.838 ******* 2021-03-24T11:59:50.230 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-03-24T11:59:50.232 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T11:59:50.254 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:50 +0000 (0:00:00.114) 0:01:41.953 ******* 2021-03-24T11:59:51.327 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* ok: [smithi161.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-03-24T11:59:52.230 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-03-24T11:59:52.256 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:52 +0000 (0:00:02.001) 0:01:43.955 ******* 2021-03-24T11:59:53.265 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-03-24T11:59:53.268 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1616586912, "cache_updated": false, "changed": false} 2021-03-24T11:59:53.304 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:53 +0000 (0:00:01.048) 0:01:45.003 ******* 2021-03-24T11:59:53.421 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-03-24T11:59:53.452 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:53 +0000 (0:00:00.148) 0:01:45.151 ******* 2021-03-24T11:59:53.680 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-03-24T11:59:53.682 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.031122", "end": "2021-03-24 11:59:53.274723", "rc": 0, "start": "2021-03-24 11:59:53.243601", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T11:59:53.706 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:53 +0000 (0:00:00.253) 0:01:45.405 ******* 2021-03-24T11:59:56.713 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-03-24T11:59:56.715 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1616586912, "cache_updated": false, "changed": false} 2021-03-24T11:59:56.742 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:56 +0000 (0:00:03.035) 0:01:48.441 ******* 2021-03-24T11:59:59.699 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-03-24T11:59:59.701 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 28 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137596 files and directorie 2021-03-24T11:59:59.703 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 28 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2021-03-24T11:59:59.704 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137596 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-03-24T11:59:59.725 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 11:59:59 +0000 (0:00:02.983) 0:01:51.424 ******* 2021-03-24T12:00:00.714 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-24T12:00:00.716 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"cache_update_time": 1616586868, "cache_updated": false, "changed": false} 2021-03-24T12:00:00.739 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:00 +0000 (0:00:01.014) 0:01:52.438 ******* 2021-03-24T12:00:00.823 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:00.848 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:00 +0000 (0:00:00.108) 0:01:52.546 ******* 2021-03-24T12:00:06.843 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-03-24T12:00:06.844 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 28 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137596 files and directorie 2021-03-24T12:00:06.846 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 28 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2021-03-24T12:00:06.848 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137596 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-03-24T12:00:06.875 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:06 +0000 (0:00:06.027) 0:01:58.574 ******* 2021-03-24T12:00:08.092 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1616586912, "cache_updated": false, "changed": false} 2021-03-24T12:00:08.130 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:08 +0000 (0:00:01.253) 0:01:59.828 ******* 2021-03-24T12:00:08.234 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-03-24T12:00:08.237 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:08.276 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:08 +0000 (0:00:00.146) 0:01:59.975 ******* 2021-03-24T12:00:18.625 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-24T12:00:18.628 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"cache_update_time": 1616586868, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 27 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 git amd64 1:2.17.1-1ubuntu0.8 [3916 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]\nGet:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.36 [870 kB]\nFetched 14.3 MB in 8s (1687 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database .. 2021-03-24T12:00:18.629 INFO:teuthology.task.ansible.out:. \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137454 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nPreparing to unpack .../4-git_1%3a2.17.1-1ubuntu0.8_amd64.deb ...\r\nUnpacking git (1:2.17.1-1ubuntu0.8) over (1:2.17.1-1ubuntu0.7) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up git (1:2.17.1-1ubuntu0.8) ...\r\nSetti 2021-03-24T12:00:18.631 INFO:teuthology.task.ansible.out:ng up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git", "1 upgraded, 6 newly installed, 0 to remove and 27 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 git amd64 1:2.17.1-1ubuntu0.8 [3916 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]", "Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.1 2021-03-24T12:00:18.633 INFO:teuthology.task.ansible.out:1+dfsg-1ubuntu7.36 [870 kB]", "Fetched 14.3 MB in 8s (1687 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137454 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Preparing to unpack .../4-git_1%3a2.17.1-1ubuntu0.8_amd64.deb ...", "Unpacking git (1:2.17.1-1ubuntu0.8) over (1:2.17.1-1ubuntu0.7) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ub 2021-03-24T12:00:18.635 INFO:teuthology.task.ansible.out:untu7.36_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up git (1:2.17.1-1ubuntu0.8) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-03-24T12:00:18.653 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:18 +0000 (0:00:10.376) 0:02:10.352 ******* 2021-03-24T12:00:19.078 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1616586912, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 27 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 git amd64 1:2.17.1-1ubuntu0.8 [3916 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]\nGet:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.36 [870 kB]\nFetched 14.3 MB in 1s (9995 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database .. 2021-03-24T12:00:19.080 INFO:teuthology.task.ansible.out:. \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137454 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nPreparing to unpack .../4-git_1%3a2.17.1-1ubuntu0.8_amd64.deb ...\r\nUnpacking git (1:2.17.1-1ubuntu0.8) over (1:2.17.1-1ubuntu0.7) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up git (1:2.17.1-1ubuntu0.8) ...\r\nSetti 2021-03-24T12:00:19.082 INFO:teuthology.task.ansible.out:ng up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git", "1 upgraded, 6 newly installed, 0 to remove and 27 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.36 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.36 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 git amd64 1:2.17.1-1ubuntu0.8 [3916 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.36 [5176 kB]", "Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.1 2021-03-24T12:00:19.083 INFO:teuthology.task.ansible.out:1+dfsg-1ubuntu7.36 [870 kB]", "Fetched 14.3 MB in 1s (9995 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137454 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Preparing to unpack .../4-git_1%3a2.17.1-1ubuntu0.8_amd64.deb ...", "Unpacking git (1:2.17.1-1ubuntu0.8) over (1:2.17.1-1ubuntu0.7) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.36_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ub 2021-03-24T12:00:19.085 INFO:teuthology.task.ansible.out:untu7.36_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up git (1:2.17.1-1ubuntu0.8) ...", "Setting up li 2021-03-24T12:00:19.085 INFO:teuthology.task.ansible.out:brbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.36) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.36) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-03-24T12:00:19.113 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:19 +0000 (0:00:00.459) 0:02:10.811 ******* 2021-03-24T12:00:19.647 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* ok: [smithi043.front.sepia.ceph.com] => {"cache_update_time": 1616586868, "cache_updated": false, "changed": false} 2021-03-24T12:00:19.672 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:19 +0000 (0:00:00.558) 0:02:11.370 ******* 2021-03-24T12:00:20.101 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1616586912, "cache_updated": false, "changed": false} 2021-03-24T12:00:20.126 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:20 +0000 (0:00:00.454) 0:02:11.824 ******* 2021-03-24T12:00:20.661 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-03-24T12:00:20.663 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"cache_update_time": 1616586868, "cache_updated": false, "changed": false} 2021-03-24T12:00:20.697 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:20 +0000 (0:00:00.571) 0:02:12.396 ******* 2021-03-24T12:00:20.900 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-03-24T12:00:20.901 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-03-24T12:00:20.924 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:20 +0000 (0:00:00.227) 0:02:12.623 ******* 2021-03-24T12:00:20.995 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-03-24T12:00:20.997 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:21.022 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:21 +0000 (0:00:00.098) 0:02:12.721 ******* 2021-03-24T12:00:21.084 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-03-24T12:00:21.086 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1616586912, "cache_updated": false, "changed": false} 2021-03-24T12:00:21.111 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:21 +0000 (0:00:00.088) 0:02:12.810 ******* 2021-03-24T12:00:21.229 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-03-24T12:00:21.232 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-03-24T12:00:21.254 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:21 +0000 (0:00:00.143) 0:02:12.953 ******* 2021-03-24T12:00:21.303 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-03-24T12:00:21.305 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-03-24T12:00:21.328 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:21 +0000 (0:00:00.074) 0:02:13.027 ******* 2021-03-24T12:00:21.408 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-03-24T12:00:21.410 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:21.431 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:21 +0000 (0:00:00.102) 0:02:13.130 ******* 2021-03-24T12:00:21.617 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-03-24T12:00:21.619 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-03-24T12:00:21.641 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:21 +0000 (0:00:00.209) 0:02:13.339 ******* 2021-03-24T12:00:21.669 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-03-24T12:00:21.670 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-03-24T12:00:21.697 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:21 +0000 (0:00:00.056) 0:02:13.396 ******* 2021-03-24T12:00:21.925 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-03-24T12:00:21.927 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-03-24T12:00:21.950 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:21 +0000 (0:00:00.252) 0:02:13.648 ******* 2021-03-24T12:00:22.056 INFO:teuthology.task.ansible.out: 2021-03-24T12:00:22.058 INFO:teuthology.task.ansible.out:TASK [testnode : Upload /etc/fuse.conf.] *************************************** ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-03-24T12:00:22.088 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:22 +0000 (0:00:00.137) 0:02:13.786 ******* 2021-03-24T12:00:22.142 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi043.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-24T12:00:22.171 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:22 +0000 (0:00:00.083) 0:02:13.870 ******* 2021-03-24T12:00:22.319 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-03-24T12:00:22.321 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-03-24T12:00:22.344 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:22 +0000 (0:00:00.172) 0:02:14.043 ******* 2021-03-24T12:00:22.530 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-03-24T12:00:22.531 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-03-24 11:57:27 UTC", "ActiveEnterTimestampMonotonic": "17948778", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target network.target -.mount nss-lookup.target system.slice remote-fs.target systemd-tmpfiles-setup.service sysinit.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-24 11:57:27 UTC", "AssertTimestampMonotonic": "17481371", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-24 11:57:27 UTC", "ConditionTimestampMonotonic": "17481371", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2021-03-24T12:00:22.533 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1534", "ExecMainStartTimestamp": "Wed 2021-03-24 11:57:27 UTC", "ExecMainStartTimestampMonotonic": "17948768", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-24 11:57:27 UTC", "InactiveExitTimestampMonotonic": "17481990", "InvocationID": "8d459178b78c4c8f96d9e9c262f30f6c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2021-03-24T12:00:22.535 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1534", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2021-03-24T12:00:22.537 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-24 11:57:27 UTC", "StateChangeTimestampMonotonic": "17948778", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2021-03-24 11:57:27 UTC", "WatchdogTimestampMonotonic": "17948777", "WatchdogUSec": "0"}} 2021-03-24T12:00:22.557 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:22 +0000 (0:00:00.212) 0:02:14.256 ******* 2021-03-24T12:00:22.566 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-03-24T12:00:22.568 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-24T12:00:22.595 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:22 +0000 (0:00:00.038) 0:02:14.294 ******* 2021-03-24T12:00:22.634 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-24T12:00:22.636 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:22.661 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:22 +0000 (0:00:00.066) 0:02:14.360 ******* 2021-03-24T12:00:22.745 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-24T12:00:22.747 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:22.770 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:22 +0000 (0:00:00.109) 0:02:14.469 ******* 2021-03-24T12:00:22.866 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-24T12:00:22.868 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:22.903 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:22 +0000 (0:00:00.132) 0:02:14.602 ******* 2021-03-24T12:00:22.960 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-03-24T12:00:22.964 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-03-24 11:57:57 UTC", "ActiveEnterTimestampMonotonic": "20019398", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket nss-lookup.target remote-fs.target sysinit.target basic.target -.mount systemd-tmpfiles-setup.service network.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-24 11:57:57 UTC", "AssertTimestampMonotonic": "19561852", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-24 11:57:57 UTC", "ConditionTimestampMonotonic": "19561852", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2021-03-24T12:00:22.965 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1563", "ExecMainStartTimestamp": "Wed 2021-03-24 11:57:57 UTC", "ExecMainStartTimestampMonotonic": "20019387", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-24 11:57:57 UTC", "InactiveExitTimestampMonotonic": "19563250", "InvocationID": "1920bd0cfb0c4ef4baf7d6db59badd7b", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2021-03-24T12:00:22.967 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1563", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2021-03-24T12:00:22.969 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-24 11:57:57 UTC", "StateChangeTimestampMonotonic": "20019398", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2021-03-24 11:57:57 UTC", "WatchdogTimestampMonotonic": "20019396", "WatchdogUSec": "0"}} 2021-03-24T12:00:22.994 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:22 +0000 (0:00:00.090) 0:02:14.692 ******* 2021-03-24T12:00:23.005 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-24T12:00:23.007 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:23.040 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:23 +0000 (0:00:00.046) 0:02:14.739 ******* 2021-03-24T12:00:23.091 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-24T12:00:23.093 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:23.116 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:23 +0000 (0:00:00.076) 0:02:14.815 ******* 2021-03-24T12:00:23.135 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-24T12:00:23.137 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:23.173 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:23 +0000 (0:00:00.055) 0:02:14.871 ******* 2021-03-24T12:00:23.191 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-24T12:00:23.192 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:23.231 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:23 +0000 (0:00:00.058) 0:02:14.929 ******* 2021-03-24T12:00:23.248 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-24T12:00:23.250 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:23.279 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:23 +0000 (0:00:00.048) 0:02:14.978 ******* 2021-03-24T12:00:23.352 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:23.377 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:23 +0000 (0:00:00.097) 0:02:15.076 ******* 2021-03-24T12:00:23.385 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-24T12:00:23.387 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:23.412 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:23 +0000 (0:00:00.035) 0:02:15.111 ******* 2021-03-24T12:00:23.451 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-24T12:00:23.453 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:23.481 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:23 +0000 (0:00:00.068) 0:02:15.179 ******* 2021-03-24T12:00:23.511 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-24T12:00:23.513 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:23.541 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:23 +0000 (0:00:00.060) 0:02:15.240 ******* 2021-03-24T12:00:23.563 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-24T12:00:23.565 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:23.600 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:23 +0000 (0:00:00.058) 0:02:15.298 ******* 2021-03-24T12:00:23.630 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:23.656 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:23 +0000 (0:00:00.056) 0:02:15.355 ******* 2021-03-24T12:00:23.687 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:23.720 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:23 +0000 (0:00:00.063) 0:02:15.418 ******* 2021-03-24T12:00:23.721 INFO:teuthology.task.ansible.out: 2021-03-24T12:00:23.753 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-24T12:00:23.756 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:23.785 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:23 +0000 (0:00:00.064) 0:02:15.483 ******* 2021-03-24T12:00:23.825 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-24T12:00:23.827 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:23.853 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:23 +0000 (0:00:00.067) 0:02:15.551 ******* 2021-03-24T12:00:23.870 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:23.899 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:23 +0000 (0:00:00.045) 0:02:15.597 ******* 2021-03-24T12:00:23.933 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-24T12:00:23.935 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:23.963 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:23 +0000 (0:00:00.064) 0:02:15.662 ******* 2021-03-24T12:00:24.003 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.029 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.065) 0:02:15.728 ******* 2021-03-24T12:00:24.040 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-24T12:00:24.041 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.074 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.044) 0:02:15.773 ******* 2021-03-24T12:00:24.103 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-24T12:00:24.105 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.131 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.057) 0:02:15.830 ******* 2021-03-24T12:00:24.149 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-24T12:00:24.151 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.176 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.044) 0:02:15.874 ******* 2021-03-24T12:00:24.206 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-24T12:00:24.208 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.243 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.066) 0:02:15.941 ******* 2021-03-24T12:00:24.263 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-24T12:00:24.265 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.294 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.051) 0:02:15.992 ******* 2021-03-24T12:00:24.313 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-24T12:00:24.314 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.354 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.059) 0:02:16.052 ******* 2021-03-24T12:00:24.399 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-24T12:00:24.401 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.428 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.074) 0:02:16.127 ******* 2021-03-24T12:00:24.435 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-24T12:00:24.437 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.476 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.047) 0:02:16.174 ******* 2021-03-24T12:00:24.520 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-24T12:00:24.522 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.549 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.072) 0:02:16.247 ******* 2021-03-24T12:00:24.555 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-24T12:00:24.557 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.584 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.034) 0:02:16.282 ******* 2021-03-24T12:00:24.622 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-24T12:00:24.624 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.652 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.068) 0:02:16.351 ******* 2021-03-24T12:00:24.670 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-24T12:00:24.671 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.700 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.047) 0:02:16.398 ******* 2021-03-24T12:00:24.728 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-24T12:00:24.730 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.756 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.055) 0:02:16.454 ******* 2021-03-24T12:00:24.773 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-24T12:00:24.775 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.810 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.054) 0:02:16.509 ******* 2021-03-24T12:00:24.831 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-24T12:00:24.832 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.863 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.052) 0:02:16.562 ******* 2021-03-24T12:00:24.891 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-24T12:00:24.893 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.919 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.056) 0:02:16.618 ******* 2021-03-24T12:00:24.938 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-24T12:00:24.940 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:24.977 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:24 +0000 (0:00:00.057) 0:02:16.675 ******* 2021-03-24T12:00:25.005 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-24T12:00:25.006 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:25.034 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:25 +0000 (0:00:00.057) 0:02:16.733 ******* 2021-03-24T12:00:25.054 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-24T12:00:25.056 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:25.081 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:25 +0000 (0:00:00.046) 0:02:16.780 ******* 2021-03-24T12:00:25.111 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-24T12:00:25.113 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:25.149 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:25 +0000 (0:00:00.067) 0:02:16.847 ******* 2021-03-24T12:00:25.170 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-24T12:00:25.172 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:25.198 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:25 +0000 (0:00:00.049) 0:02:16.897 ******* 2021-03-24T12:00:25.248 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:25.275 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:25 +0000 (0:00:00.077) 0:02:16.974 ******* 2021-03-24T12:00:25.293 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-24T12:00:25.295 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:25.323 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:25 +0000 (0:00:00.047) 0:02:17.022 ******* 2021-03-24T12:00:25.363 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-24T12:00:25.365 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:25.399 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:25 +0000 (0:00:00.075) 0:02:17.097 ******* 2021-03-24T12:00:25.416 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-24T12:00:25.419 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:25.443 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:25 +0000 (0:00:00.044) 0:02:17.142 ******* 2021-03-24T12:00:25.493 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-24T12:00:25.494 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:25.528 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:25 +0000 (0:00:00.084) 0:02:17.226 ******* 2021-03-24T12:00:25.536 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-24T12:00:25.538 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:25.574 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:25 +0000 (0:00:00.046) 0:02:17.273 ******* 2021-03-24T12:00:25.616 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-03-24T12:00:25.618 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:25.647 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:25 +0000 (0:00:00.072) 0:02:17.345 ******* 2021-03-24T12:00:25.669 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-24T12:00:25.671 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:25.704 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:25 +0000 (0:00:00.057) 0:02:17.403 ******* 2021-03-24T12:00:25.790 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-24T12:00:25.792 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:25.815 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:25 +0000 (0:00:00.111) 0:02:17.514 ******* 2021-03-24T12:00:25.865 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-03-24T12:00:25.867 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-03-24T12:00:25.890 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:25 +0000 (0:00:00.074) 0:02:17.589 ******* 2021-03-24T12:00:25.908 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-24T12:00:25.910 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:25.938 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:25 +0000 (0:00:00.047) 0:02:17.637 ******* 2021-03-24T12:00:26.026 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:26.051 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:26 +0000 (0:00:00.112) 0:02:17.749 ******* 2021-03-24T12:00:26.272 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-03-24T12:00:26.274 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-03-24T12:00:26.297 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:26 +0000 (0:00:00.246) 0:02:17.996 ******* 2021-03-24T12:00:26.325 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-24T12:00:26.327 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-03-24T12:00:26.357 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:26 +0000 (0:00:00.059) 0:02:18.055 ******* 2021-03-24T12:00:26.467 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-24T12:00:26.469 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:26.491 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:26 +0000 (0:00:00.134) 0:02:18.189 ******* 2021-03-24T12:00:26.720 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-24T12:00:26.722 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-03-24T12:00:26.748 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:26 +0000 (0:00:00.257) 0:02:18.447 ******* 2021-03-24T12:00:26.829 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-24T12:00:26.831 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:26.854 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:26 +0000 (0:00:00.106) 0:02:18.553 ******* 2021-03-24T12:00:26.892 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-03-24T12:00:26.894 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-03-24T12:00:26.918 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:26 +0000 (0:00:00.064) 0:02:18.617 ******* 2021-03-24T12:00:27.265 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-03-24T12:00:27.296 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:27 +0000 (0:00:00.377) 0:02:18.994 ******* 2021-03-24T12:00:27.357 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-03-24T12:00:27.359 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-03-24T12:00:27.382 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:27 +0000 (0:00:00.086) 0:02:19.081 ******* 2021-03-24T12:00:27.715 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-03-24T12:00:27.740 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:27 +0000 (0:00:00.358) 0:02:19.439 ******* 2021-03-24T12:00:27.784 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-03-24T12:00:27.786 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-03-24T12:00:27.812 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:27 +0000 (0:00:00.072) 0:02:19.511 ******* 2021-03-24T12:00:28.051 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-03-24T12:00:28.053 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-24T12:00:28.078 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:28 +0000 (0:00:00.265) 0:02:19.776 ******* 2021-03-24T12:00:28.147 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-03-24T12:00:28.149 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:28.185 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:28 +0000 (0:00:00.105) 0:02:19.882 ******* 2021-03-24T12:00:28.193 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-03-24T12:00:28.195 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-03-24T12:00:28.223 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:28 +0000 (0:00:00.038) 0:02:19.921 ******* 2021-03-24T12:00:28.274 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-03-24T12:00:28.276 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:28.305 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:28 +0000 (0:00:00.081) 0:02:20.003 ******* 2021-03-24T12:00:28.385 INFO:teuthology.task.ansible.out: 2021-03-24T12:00:28.387 INFO:teuthology.task.ansible.out:TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-03-24T12:00:28.388 INFO:teuthology.task.ansible.out: skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:28.413 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:28 +0000 (0:00:00.108) 0:02:20.112 ******* 2021-03-24T12:00:28.438 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-03-24T12:00:28.440 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-24T12:00:28.466 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:28 +0000 (0:00:00.053) 0:02:20.165 ******* 2021-03-24T12:00:28.526 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-03-24T12:00:28.529 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:28.560 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:28 +0000 (0:00:00.093) 0:02:20.259 ******* 2021-03-24T12:00:28.569 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:28.606 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:28 +0000 (0:00:00.045) 0:02:20.304 ******* 2021-03-24T12:00:28.645 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:28.671 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:28 +0000 (0:00:00.065) 0:02:20.370 ******* 2021-03-24T12:00:28.689 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-03-24T12:00:28.691 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:28.733 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:28 +0000 (0:00:00.061) 0:02:20.431 ******* 2021-03-24T12:00:28.764 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-24T12:00:28.766 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-03-24T12:00:28.791 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:28 +0000 (0:00:00.058) 0:02:20.490 ******* 2021-03-24T12:00:28.830 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-03-24T12:00:28.832 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:28.854 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:28 +0000 (0:00:00.062) 0:02:20.553 ******* 2021-03-24T12:00:28.893 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-03-24T12:00:28.896 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:28.905 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.131 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [smithi043.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 24 March 2021 12:00:28 +0000 (0:00:00.103) 0:02:20.656 ******* TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi043.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item=dm-3) => {"ansible_lo 2021-03-24T12:00:29.133 INFO:teuthology.task.ansible.out:op_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} Wednesday 24 March 2021 12:00:29 +0000 (0:00:00.064) 0:02:20.720 ******* TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 24 March 2021 12:00:29 +0000 (0:00:00.046) 0:02:20.767 ******* 2021-03-24T12:00:29.148 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-24T12:00:29.151 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-03-24T12:00:29.183 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:29 +0000 (0:00:00.114) 0:02:20.881 ******* 2021-03-24T12:00:29.292 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-03-24T12:00:29.294 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.304 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.306 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.317 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.328 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.349 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-03-24T12:00:29.361 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.363 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.372 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.374 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.384 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.396 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.397 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.408 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.445 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:29 +0000 (0:00:00.262) 0:02:21.143 ******* 2021-03-24T12:00:29.475 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-03-24T12:00:29.478 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.009958", "end": "2021-03-24 12:00:29.446782", "rc": 0, "start": "2021-03-24 12:00:29.436824", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology-lock"]} 2021-03-24T12:00:29.506 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:29 +0000 (0:00:00.061) 0:02:21.205 ******* 2021-03-24T12:00:29.588 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-03-24T12:00:29.590 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.616 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:29 +0000 (0:00:00.109) 0:02:21.315 ******* 2021-03-24T12:00:29.708 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-03-24T12:00:29.710 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.736 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:29 +0000 (0:00:00.120) 0:02:21.435 ******* 2021-03-24T12:00:29.767 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-03-24T12:00:29.769 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004892", "end": "2021-03-24 12:00:29.731511", "rc": 0, "start": "2021-03-24 12:00:29.726619", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology-lock"]} 2021-03-24T12:00:29.799 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:29 +0000 (0:00:00.062) 0:02:21.497 ******* 2021-03-24T12:00:29.827 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-03-24T12:00:29.829 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.865 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:29 +0000 (0:00:00.065) 0:02:21.563 ******* 2021-03-24T12:00:29.895 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-03-24T12:00:29.898 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:29.924 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:29 +0000 (0:00:00.059) 0:02:21.622 ******* 2021-03-24T12:00:30.015 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-03-24T12:00:30.017 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:30.039 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:30 +0000 (0:00:00.115) 0:02:21.737 ******* 2021-03-24T12:00:30.141 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-03-24T12:00:30.143 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:30.172 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:30 +0000 (0:00:00.132) 0:02:21.870 ******* 2021-03-24T12:00:30.847 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi043.front.sepia.ceph.com] => {"cache_update_time": 1616586868, "cache_updated": false, "changed": false} 2021-03-24T12:00:30.873 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:30 +0000 (0:00:00.701) 0:02:22.572 ******* 2021-03-24T12:00:30.944 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:30.979 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:30 +0000 (0:00:00.105) 0:02:22.677 ******* 2021-03-24T12:00:31.063 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi043.front.sepia.ceph.com] => (item={'block_used': 13753819, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341289, 'size_available': 927093919744, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149510, 'block_size': 4096, 'inode_available': 60905466}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341289, "block_size": 4096, "block_total": 240095108, "block_used": 13753819, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905466, "inode_total": 61054976, "inode_used": 149510, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927093919744, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}} 2021-03-24T12:00:31.088 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:31 +0000 (0:00:00.108) 0:02:22.786 ******* 2021-03-24T12:00:31.160 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-03-24T12:00:31.161 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1616586912, "cache_updated": false, "changed": false} 2021-03-24T12:00:31.187 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:31 +0000 (0:00:00.099) 0:02:22.885 ******* 2021-03-24T12:00:31.267 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-03-24T12:00:31.269 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:31.292 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:31 +0000 (0:00:00.104) 0:02:22.990 ******* 2021-03-24T12:00:31.299 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-03-24T12:00:31.301 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009197", "end": "2021-03-24 12:00:31.269389", "rc": 0, "start": "2021-03-24 12:00:31.260192", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:31.331 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:31 +0000 (0:00:00.038) 0:02:23.029 ******* 2021-03-24T12:00:31.369 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-24T12:00:31.372 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'block_used': 13753814, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341294, 'size_available': 927093940224, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149511, 'block_size': 4096, 'inode_available': 60905465}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341294, "block_size": 4096, "block_total": 240095108, "block_used": 13753814, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905465, "inode_total": 61054976, "inode_used": 149511, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927093940224, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}} 2021-03-24T12:00:31.396 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:31 +0000 (0:00:00.065) 0:02:23.095 ******* 2021-03-24T12:00:31.424 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-03-24T12:00:31.426 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'block_used': 13753819, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341289, 'size_available': 927093919744, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149510, 'block_size': 4096, 'inode_available': 60905466}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341289, "block_size": 4096, "block_total": 240095108, "block_used": 13753819, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905466, "inode_total": 61054976, "inode_used": 149510, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927093919744, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:31.454 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:31 +0000 (0:00:00.057) 0:02:23.152 ******* 2021-03-24T12:00:31.545 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-03-24T12:00:31.570 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:31 +0000 (0:00:00.116) 0:02:23.269 ******* 2021-03-24T12:00:31.622 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-03-24T12:00:31.624 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.011001", "end": "2021-03-24 12:00:31.236798", "rc": 0, "start": "2021-03-24 12:00:31.225797", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:31.654 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:31 +0000 (0:00:00.083) 0:02:23.352 ******* 2021-03-24T12:00:31.673 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-24T12:00:31.677 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:31.750 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-03-24T12:00:31.752 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'block_used': 13753814, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341294, 'size_available': 927093940224, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149511, 'block_size': 4096, 'inode_available': 60905465}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341294, "block_size": 4096, "block_total": 240095108, "block_used": 13753814, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905465, "inode_total": 61054976, "inode_used": 149511, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927093940224, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:31.775 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:31 +0000 (0:00:00.121) 0:02:23.473 ******* 2021-03-24T12:00:31.845 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-03-24T12:00:31.869 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:31 +0000 (0:00:00.094) 0:02:23.568 ******* 2021-03-24T12:00:31.982 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-24T12:00:31.985 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:33.347 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8hYCOwYxCf9cdx8I1coCnD9QEacMtMWIRt'], 'uuids': ['dc1c2c88-d758-4139-9ab7-6346611a98c1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.532212", "end": "2021-03-24 12:00:33.319592", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8hYCOwYxCf9cdx8I1coCnD9QEacMtMWIRt"], "labels": [], "masters": [], "uuids": ["dc1c2c88-d758-4139-9ab7-6346611a98c1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:31.787380", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-24T12:00:33.373 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:33.384 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:33.728 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy06cZIifMJyS7zjH1iV1rLc6xp5Qh2uZU9'], 'uuids': ['8c24398f-bd82-46d0-9a9a-bf17fcf817a2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.616454", "end": "2021-03-24 12:00:33.329975", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy06cZIifMJyS7zjH1iV1rLc6xp5Qh2uZU9"], "labels": [], "masters": [], "uuids": ["8c24398f-bd82-46d0-9a9a-bf17fcf817a2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:31.713521", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-24T12:00:33.730 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:33.742 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:34.647 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8hdqXL6oKUT6T0vN8i2l6qAiEn6sRgpdAP'], 'uuids': ['d60829bc-3a43-45d6-a74d-1378f2a9ddd0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.124784", "end": "2021-03-24 12:00:34.619282", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8hdqXL6oKUT6T0vN8i2l6qAiEn6sRgpdAP"], "labels": [], "masters": [], "uuids": ["d60829bc-3a43-45d6-a74d-1378f2a9ddd0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:33.494498", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-24T12:00:34.661 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQ2G', 'wwn-0x5000c500871a8b6f'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQ2G-part1', 'wwn-0x5000c500871a8b6f-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a8b6f', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HQ2G', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQ2G", "wwn-0x5000c500871a8b6f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQ2G-part1", "wwn-0x5000c500871a8b6f-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQ2G", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a8b6f"}}, "skip_reason": 2021-03-24T12:00:34.662 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-03-24T12:00:35.012 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy0v90qotxrwGFMkglunZavLaXXvkLiQuih'], 'uuids': ['6fd8e1d0-cd32-46d4-91dc-aa8316350680']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.128788", "end": "2021-03-24 12:00:34.613174", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy0v90qotxrwGFMkglunZavLaXXvkLiQuih"], "labels": [], "masters": [], "uuids": ["6fd8e1d0-cd32-46d4-91dc-aa8316350680"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:33.484386", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-24T12:00:35.024 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XV0E', 'wwn-0x5000c50092938c4f'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XV0E-part1', 'wwn-0x5000c50092938c4f-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092938c4f', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XV0E', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XV0E", "wwn-0x5000c50092938c4f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XV0E-part1", "wwn-0x5000c50092938c4f-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XV0E", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092938c4f"}}, "skip_reason": 2021-03-24T12:00:35.025 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-03-24T12:00:35.959 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-1EL5ik-avbn-aK6V-U6q2-ECMd-b2O4-6e2eVa', 'nvme-INTEL_SSDPED1D480GA_PHMB751300GH480DGN', 'nvme-nvme.8086-50484d42373531333030474834383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.179060", "end": "2021-03-24 12:00:35.940581", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-1EL5ik-avbn-aK6V-U6q2-ECMd-b2O4-6e2eVa", "nvme-INTEL_SSDPED1D480GA_PHMB751300GH480DGN", "nvme-nvme.8086-50484d42373531333030474834383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:34.761521", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now pa 2021-03-24T12:00:35.962 INFO:teuthology.task.ansible.out:rtition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-24T12:00:35.986 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:35.999 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:36.364 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-AUJciF-GRVa-3Bue-TfFL-zDa9-VblI-9Wbozu', 'nvme-INTEL_SSDPEDMD400G4_CVFT6233001X400BGN', 'nvme-nvme.8086-43564654363233333030315834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.185812", "end": "2021-03-24 12:00:35.960943", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-AUJciF-GRVa-3Bue-TfFL-zDa9-VblI-9Wbozu", "nvme-INTEL_SSDPEDMD400G4_CVFT6233001X400BGN", "nvme-nvme.8086-43564654363233333030315834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:34.775131", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-03-24T12:00:36.366 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-24T12:00:36.387 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:36.400 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:37.279 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8haS0mnZXIclfFynDjQx89GZAbxJuUfbMu'], 'uuids': ['0f6d9a6a-c6c4-4c22-a19a-dad19d1343cd']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.132709", "end": "2021-03-24 12:00:37.236279", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8haS0mnZXIclfFynDjQx89GZAbxJuUfbMu"], "labels": [], "masters": [], "uuids": ["0f6d9a6a-c6c4-4c22-a19a-dad19d1343cd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:36.103570", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-24T12:00:37.282 INFO:teuthology.task.ansible.out: 2021-03-24T12:00:37.292 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:37.303 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:37.741 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy0vZuSAIkyRG3nBcStEtxogHGNZa7LZoh8'], 'uuids': ['5af9ae09-cb99-4834-bfff-52ff97bf8d47']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.188763", "end": "2021-03-24 12:00:37.352112", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy0vZuSAIkyRG3nBcStEtxogHGNZa7LZoh8"], "labels": [], "masters": [], "uuids": ["5af9ae09-cb99-4834-bfff-52ff97bf8d47"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:36.163349", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-24T12:00:37.754 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:37.776 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:38.623 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8hV85JZwdr8fg4VE9WVlIuabzBaFKpaRRo'], 'uuids': ['fe424044-4963-4e85-8996-b0edbf085447']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.117487", "end": "2021-03-24 12:00:38.569769", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8hV85JZwdr8fg4VE9WVlIuabzBaFKpaRRo"], "labels": [], "masters": [], "uuids": ["fe424044-4963-4e85-8996-b0edbf085447"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:37.452282", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-24T12:00:38.637 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:39.101 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy09WM5Y0za5CtK2spO5zslkHUSLxEIxUJX'], 'uuids': ['79c4eea4-356e-47c2-bdd6-16b46146d658']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.133870", "end": "2021-03-24 12:00:38.707096", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy09WM5Y0za5CtK2spO5zslkHUSLxEIxUJX"], "labels": [], "masters": [], "uuids": ["79c4eea4-356e-47c2-bdd6-16b46146d658"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:37.573226", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-24T12:00:39.125 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:39.987 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8hCy0EC5njoocHw7yaOQqjo2Z8T8ry9JW7'], 'uuids': ['f6c9d2e5-73c6-4757-9d88-92307653ab4c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.125305", "end": "2021-03-24 12:00:39.953247", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8hCy0EC5njoocHw7yaOQqjo2Z8T8ry9JW7"], "labels": [], "masters": [], "uuids": ["f6c9d2e5-73c6-4757-9d88-92307653ab4c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:38.827942", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-24T12:00:40.036 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:40 +0000 (0:00:08.166) 0:02:31.734 ******* 2021-03-24T12:00:40.191 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-24T12:00:40.194 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:40.417 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy0jKCKLG9Rco5ApEuiSLBwNBzIrkfJ838u'], 'uuids': ['0256950f-606c-4524-9988-6f053df48120']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.126170", "end": "2021-03-24 12:00:40.024654", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy0jKCKLG9Rco5ApEuiSLBwNBzIrkfJ838u"], "labels": [], "masters": [], "uuids": ["0256950f-606c-4524-9988-6f053df48120"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:38.898484", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk u 2021-03-24T12:00:40.419 INFO:teuthology.task.ansible.out:sing fdisk or", "other utilities."]} 2021-03-24T12:00:40.461 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:40 +0000 (0:00:00.425) 0:02:32.160 ******* 2021-03-24T12:00:40.476 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-24T12:00:40.477 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8hYCOwYxCf9cdx8I1coCnD9QEacMtMWIRt'], 'uuids': ['dc1c2c88-d758-4139-9ab7-6346611a98c1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.114856", "end": "2021-03-24 12:00:40.418503", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8hYCOwYxCf9cdx8I1coCnD9QEacMtMWIRt"], "labels": [], "masters": [], "uuids": ["dc1c2c88-d758-4139-9ab7-6346611a98c1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:40.303647", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.109851 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.109851 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:40.479 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:40.481 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:40.609 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:40.725 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8hdqXL6oKUT6T0vN8i2l6qAiEn6sRgpdAP'], 'uuids': ['d60829bc-3a43-45d6-a74d-1378f2a9ddd0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.110024", "end": "2021-03-24 12:00:40.691670", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8hdqXL6oKUT6T0vN8i2l6qAiEn6sRgpdAP"], "labels": [], "masters": [], "uuids": ["d60829bc-3a43-45d6-a74d-1378f2a9ddd0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:40.581646", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.10627 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.10627 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:40.737 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQ2G', 'wwn-0x5000c500871a8b6f'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQ2G-part1', 'wwn-0x5000c500871a8b6f-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a8b6f', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HQ2G', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQ2G", "wwn-0x5000c500871a8b6f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQ2G-part1", "wwn-0x5000c500871a8b6f-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQ2G", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a8b6f"}}, "skip_reason": 2021-03-24T12:00:40.739 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-03-24T12:00:40.907 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy06cZIifMJyS7zjH1iV1rLc6xp5Qh2uZU9'], 'uuids': ['8c24398f-bd82-46d0-9a9a-bf17fcf817a2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.152201", "end": "2021-03-24 12:00:40.517059", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy06cZIifMJyS7zjH1iV1rLc6xp5Qh2uZU9"], "labels": [], "masters": [], "uuids": ["8c24398f-bd82-46d0-9a9a-bf17fcf817a2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:40.364858", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.147365 s, 783 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.147365 s, 783 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:40.931 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:40.953 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:40.955 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-1EL5ik-avbn-aK6V-U6q2-ECMd-b2O4-6e2eVa', 'nvme-INTEL_SSDPED1D480GA_PHMB751300GH480DGN', 'nvme-nvme.8086-50484d42373531333030474834383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.049090", "end": "2021-03-24 12:00:40.919242", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-1EL5ik-avbn-aK6V-U6q2-ECMd-b2O4-6e2eVa", "nvme-INTEL_SSDPED1D480GA_PHMB751300GH480DGN", "nvme-nvme.8086-50484d42373531333030474834383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:40.870152", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0444511 s, 2.6 GB/s", "stderr_lines": [" 2021-03-24T12:00:40.957 INFO:teuthology.task.ansible.out:110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0444511 s, 2.6 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:40.966 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:40.980 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:41.235 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8haS0mnZXIclfFynDjQx89GZAbxJuUfbMu'], 'uuids': ['0f6d9a6a-c6c4-4c22-a19a-dad19d1343cd']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.110734", "end": "2021-03-24 12:00:41.208551", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8haS0mnZXIclfFynDjQx89GZAbxJuUfbMu"], "labels": [], "masters": [], "uuids": ["0f6d9a6a-c6c4-4c22-a19a-dad19d1343cd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:41.097817", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.107052 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.107052 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:41.247 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:41.259 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy0v90qotxrwGFMkglunZavLaXXvkLiQuih'], 'uuids': ['6fd8e1d0-cd32-46d4-91dc-aa8316350680']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.165197", "end": "2021-03-24 12:00:40.875544", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy0v90qotxrwGFMkglunZavLaXXvkLiQuih"], "labels": [], "masters": [], "uuids": ["6fd8e1d0-cd32-46d4-91dc-aa8316350680"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:40.710347", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.160933 s, 717 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.160933 s, 717 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:41.272 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XV0E', 'wwn-0x5000c50092938c4f'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XV0E-part1', 'wwn-0x5000c50092938c4f-part1'], 'uuids': ['c2492a7c-537b-4f45-893c-50f733187038']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092938c4f', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XV0E', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XV0E", "wwn-0x5000c50092938c4f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XV0E-part1", "wwn-0x5000c50092938c4f-part1"], "labels": [], "masters": [], "uuids": ["c2492a7c-537b-4f45-893c-50f733187038"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XV0E", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092938c4f"}}, "skip_reason": 2021-03-24T12:00:41.274 INFO:teuthology.task.ansible.out:"Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:41.477 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-AUJciF-GRVa-3Bue-TfFL-zDa9-VblI-9Wbozu', 'nvme-INTEL_SSDPEDMD400G4_CVFT6233001X400BGN', 'nvme-nvme.8086-43564654363233333030315834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.052123", "end": "2021-03-24 12:00:41.083338", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-AUJciF-GRVa-3Bue-TfFL-zDa9-VblI-9Wbozu", "nvme-INTEL_SSDPEDMD400G4_CVFT6233001X400BGN", "nvme-nvme.8086-43564654363233333030315834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:41.031215", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0476087 s, 2.4 GB/s", "std 2021-03-24T12:00:41.479 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0476087 s, 2.4 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:41.490 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:41.514 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:41.537 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8hV85JZwdr8fg4VE9WVlIuabzBaFKpaRRo'], 'uuids': ['fe424044-4963-4e85-8996-b0edbf085447']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.110884", "end": "2021-03-24 12:00:41.497499", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8hV85JZwdr8fg4VE9WVlIuabzBaFKpaRRo"], "labels": [], "masters": [], "uuids": ["fe424044-4963-4e85-8996-b0edbf085447"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:41.386615", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.106096 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.106096 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:41.538 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:41.804 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8hCy0EC5njoocHw7yaOQqjo2Z8T8ry9JW7'], 'uuids': ['f6c9d2e5-73c6-4757-9d88-92307653ab4c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.111486", "end": "2021-03-24 12:00:41.770037", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-GtJGePHEZazvyHIlAlYYSWUmocq5CH8hCy0EC5njoocHw7yaOQqjo2Z8T8ry9JW7"], "labels": [], "masters": [], "uuids": ["f6c9d2e5-73c6-4757-9d88-92307653ab4c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:41.658551", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.106701 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.106701 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:41.824 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy0vZuSAIkyRG3nBcStEtxogHGNZa7LZoh8'], 'uuids': ['5af9ae09-cb99-4834-bfff-52ff97bf8d47']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.161524", "end": "2021-03-24 12:00:41.423745", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy0vZuSAIkyRG3nBcStEtxogHGNZa7LZoh8"], "labels": [], "masters": [], "uuids": ["5af9ae09-cb99-4834-bfff-52ff97bf8d47"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:41.262221", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158454 s, 728 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158454 s, 728 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:41.825 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:41.852 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:41 +0000 (0:00:01.390) 0:02:33.551 ******* 2021-03-24T12:00:41.865 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:42.167 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy09WM5Y0za5CtK2spO5zslkHUSLxEIxUJX'], 'uuids': ['79c4eea4-356e-47c2-bdd6-16b46146d658']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.159929", "end": "2021-03-24 12:00:41.774913", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy09WM5Y0za5CtK2spO5zslkHUSLxEIxUJX"], "labels": [], "masters": [], "uuids": ["79c4eea4-356e-47c2-bdd6-16b46146d658"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:41.614984", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155111 s, 744 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155111 s, 744 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:42.169 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:42.223 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi043.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.133147", "end": "2021-03-24 12:00:42.120743", "rc": 0, "start": "2021-03-24 12:00:41.987596", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:42.248 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:42 +0000 (0:00:00.396) 0:02:33.947 ******* 2021-03-24T12:00:42.469 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-03-24T12:00:42.471 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.075656", "end": "2021-03-24 12:00:42.448101", "rc": 0, "start": "2021-03-24 12:00:42.372445", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:42.494 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:42 +0000 (0:00:00.245) 0:02:34.192 ******* 2021-03-24T12:00:42.512 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-24T12:00:42.514 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy0jKCKLG9Rco5ApEuiSLBwNBzIrkfJ838u'], 'uuids': ['0256950f-606c-4524-9988-6f053df48120']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.156625", "end": "2021-03-24 12:00:42.103560", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-3S4WrP5tiIVq3fin5lPJbrVnDJ7JXuy0jKCKLG9Rco5ApEuiSLBwNBzIrkfJ838u"], "labels": [], "masters": [], "uuids": ["0256950f-606c-4524-9988-6f053df48120"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-24 12:00:41.946935", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.151716 s, 760 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.151716 s, 760 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:42.613 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-03-24T12:00:42.710 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:42 +0000 (0:00:00.216) 0:02:34.408 ******* 2021-03-24T12:00:42.741 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-24T12:00:42.757 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:42.791 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:42 +0000 (0:00:00.081) 0:02:34.490 ******* 2021-03-24T12:00:42.814 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:42 +0000 (0:00:00.023) 0:02:34.513 ******* 2021-03-24T12:00:42.833 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-03-24T12:00:42.836 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:42.871 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:42 +0000 (0:00:00.056) 0:02:34.569 ******* 2021-03-24T12:00:42.915 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:42.951 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:42 +0000 (0:00:00.080) 0:02:34.650 ******* 2021-03-24T12:00:42.982 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-03-24T12:00:42.984 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:43.010 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:43 +0000 (0:00:00.058) 0:02:34.708 ******* 2021-03-24T12:00:43.154 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-03-24T12:00:43.156 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-24T12:00:43.183 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:43 +0000 (0:00:00.172) 0:02:34.881 ******* 2021-03-24T12:00:43.191 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-03-24T12:00:43.193 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.141871", "end": "2021-03-24 12:00:42.792792", "rc": 0, "start": "2021-03-24 12:00:42.650921", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:43.224 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:43 +0000 (0:00:00.040) 0:02:34.922 ******* 2021-03-24T12:00:43.242 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-24T12:00:43.244 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'block_used': 13753819, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341289, 'size_available': 927093919744, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149510, 'block_size': 4096, 'inode_available': 60905466}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341289, "block_size": 4096, "block_total": 240095108, "block_used": 13753819, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905466, "inode_total": 61054976, "inode_used": 149510, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927093919744, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:43.273 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:43 +0000 (0:00:00.050) 0:02:34.972 ******* 2021-03-24T12:00:43.319 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-03-24T12:00:43.321 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:43.347 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:43 +0000 (0:00:00.074) 0:02:35.046 ******* 2021-03-24T12:00:43.378 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-24T12:00:43.380 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:43.405 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:43 +0000 (0:00:00.057) 0:02:35.104 ******* 2021-03-24T12:00:43.444 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-24T12:00:43.446 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for physical volumes] *********************************** changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.062164", "end": "2021-03-24 12:00:43.060662", "rc": 0, "start": "2021-03-24 12:00:42.998498", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:43.470 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:43 +0000 (0:00:00.064) 0:02:35.168 ******* 2021-03-24T12:00:43.497 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:43 +0000 (0:00:00.027) 0:02:35.195 ******* 2021-03-24T12:00:43.516 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-03-24T12:00:43.518 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:43.541 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:43 +0000 (0:00:00.044) 0:02:35.240 ******* 2021-03-24T12:00:43.549 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-03-24T12:00:43.588 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:43 +0000 (0:00:00.046) 0:02:35.286 ******* 2021-03-24T12:00:43.597 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-03-24T12:00:43.598 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:43.630 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:43 +0000 (0:00:00.041) 0:02:35.328 ******* 2021-03-24T12:00:43.639 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:43.674 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:43 +0000 (0:00:00.044) 0:02:35.373 ******* 2021-03-24T12:00:43.681 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-03-24T12:00:43.683 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:43.716 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:43 +0000 (0:00:00.042) 0:02:35.415 ******* 2021-03-24T12:00:43.728 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-03-24T12:00:43.730 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:43.914 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:43 +0000 (0:00:00.197) 0:02:35.612 ******* 2021-03-24T12:00:43.953 INFO:teuthology.task.ansible.out: 2021-03-24T12:00:43.956 INFO:teuthology.task.ansible.out:TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:44.006 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:43 +0000 (0:00:00.087) 0:02:35.700 ******* 2021-03-24T12:00:44.030 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-03-24T12:00:44.032 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:44.060 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:44 +0000 (0:00:00.058) 0:02:35.759 ******* 2021-03-24T12:00:44.220 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-24T12:00:44.253 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:44 +0000 (0:00:00.193) 0:02:35.952 ******* 2021-03-24T12:00:44.305 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-24T12:00:44.307 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'block_used': 13753814, 'uuid': 'c2492a7c-537b-4f45-893c-50f733187038', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341294, 'size_available': 927093940224, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149511, 'block_size': 4096, 'inode_available': 60905465}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341294, "block_size": 4096, "block_total": 240095108, "block_used": 13753814, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905465, "inode_total": 61054976, "inode_used": 149511, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927093940224, "size_total": 983429562368, "uuid": "c2492a7c-537b-4f45-893c-50f733187038"}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:44.330 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:44 +0000 (0:00:00.076) 0:02:36.029 ******* 2021-03-24T12:00:44.360 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:44.385 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:44 +0000 (0:00:00.054) 0:02:36.084 ******* 2021-03-24T12:00:44.393 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-03-24T12:00:44.395 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-03-24T12:00:44.426 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:44 +0000 (0:00:00.041) 0:02:36.125 ******* 2021-03-24T12:00:44.434 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-24T12:00:44.437 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:44.468 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:44 +0000 (0:00:00.041) 0:02:36.166 ******* 2021-03-24T12:00:44.510 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-24T12:00:44.512 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:44.554 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:44 +0000 (0:00:00.076) 0:02:36.243 ******* 2021-03-24T12:00:44.593 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:44.621 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:44 +0000 (0:00:00.076) 0:02:36.320 ******* 2021-03-24T12:00:44.665 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-03-24T12:00:44.668 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:44.692 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:44 +0000 (0:00:00.070) 0:02:36.390 ******* 2021-03-24T12:00:44.731 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-03-24T12:00:44.735 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:44.765 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:44 +0000 (0:00:00.073) 0:02:36.463 ******* 2021-03-24T12:00:44.925 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-24T12:00:44.926 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-24T12:00:45.139 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-03-24T12:00:45.141 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-03-24T12:00:45.173 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:45 +0000 (0:00:00.408) 0:02:36.872 ******* 2021-03-24T12:00:45.208 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-24T12:00:45.458 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-24T12:00:45.547 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-24T12:00:45.746 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-24T12:00:45.811 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-24T12:00:46.011 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-24T12:00:46.045 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:46 +0000 (0:00:00.871) 0:02:37.743 ******* 2021-03-24T12:00:46.096 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-24T12:00:46.240 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-24T12:00:46.242 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-03-24T12:00:46.270 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:46 +0000 (0:00:00.225) 0:02:37.969 ******* 2021-03-24T12:00:46.367 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-24T12:00:46.369 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-24T12:00:46.469 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-24T12:00:46.471 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-24T12:00:46.592 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-24T12:00:46.593 INFO:teuthology.task.ansible.out: 2021-03-24T12:00:46.627 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-24T12:00:46.656 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:46 +0000 (0:00:00.384) 0:02:38.354 ******* 2021-03-24T12:00:46.726 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-24T12:00:46.728 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-24T12:00:46.804 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-24T12:00:46.806 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-03-24T12:00:46.835 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:46 +0000 (0:00:00.179) 0:02:38.533 ******* 2021-03-24T12:00:46.855 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-24T12:00:46.857 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-24T12:00:46.879 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:46.908 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:46 +0000 (0:00:00.073) 0:02:38.606 ******* 2021-03-24T12:00:46.947 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:46.972 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:46 +0000 (0:00:00.064) 0:02:38.670 ******* 2021-03-24T12:00:46.993 INFO:teuthology.task.ansible.out: 2021-03-24T12:00:46.995 INFO:teuthology.task.ansible.out:TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-24T12:00:47.006 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:47.037 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:47 +0000 (0:00:00.065) 0:02:38.736 ******* 2021-03-24T12:00:47.119 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-24T12:00:47.121 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-24T12:00:47.196 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-03-24T12:00:47.198 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-03-24T12:00:47.223 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:47 +0000 (0:00:00.186) 0:02:38.922 ******* 2021-03-24T12:00:47.263 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-24T12:00:47.265 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-24T12:00:47.266 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-03-24T12:00:47.267 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-03-24T12:00:47.296 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:47 +0000 (0:00:00.073) 0:02:38.995 ******* 2021-03-24T12:00:47.368 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-24T12:00:47.370 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-24T12:00:47.381 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:47.419 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:47 +0000 (0:00:00.122) 0:02:39.118 ******* 2021-03-24T12:00:47.449 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-03-24T12:00:47.451 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:47.476 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:47 +0000 (0:00:00.056) 0:02:39.174 ******* 2021-03-24T12:00:47.513 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-03-24T12:00:47.515 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:47.538 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:47 +0000 (0:00:00.062) 0:02:39.237 ******* 2021-03-24T12:00:47.616 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-03-24T12:00:47.618 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"changed": true} 2021-03-24T12:00:47.646 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:47 +0000 (0:00:00.107) 0:02:39.344 ******* 2021-03-24T12:00:47.687 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-03-24T12:00:47.688 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-03-24T12:00:47.714 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:47 +0000 (0:00:00.068) 0:02:39.413 ******* 2021-03-24T12:00:47.754 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-03-24T12:00:47.756 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-03-24T12:00:47.783 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:47 +0000 (0:00:00.068) 0:02:39.482 ******* 2021-03-24T12:00:47.996 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-03-24T12:00:48.023 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:48 +0000 (0:00:00.240) 0:02:39.722 ******* 2021-03-24T12:00:48.031 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-03-24T12:00:48.033 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true} 2021-03-24T12:00:48.063 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:48 +0000 (0:00:00.039) 0:02:39.761 ******* 2021-03-24T12:00:48.071 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-03-24T12:00:48.073 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:48.110 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:48 +0000 (0:00:00.046) 0:02:39.808 ******* 2021-03-24T12:00:48.143 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-03-24T12:00:48.145 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:48.169 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:48 +0000 (0:00:00.059) 0:02:39.868 ******* 2021-03-24T12:00:48.197 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-24T12:00:48.200 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:48.225 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:48 +0000 (0:00:00.055) 0:02:39.924 ******* 2021-03-24T12:00:48.252 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-24T12:00:48.254 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:48.282 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:48 +0000 (0:00:00.057) 0:02:39.981 ******* 2021-03-24T12:00:48.305 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-03-24T12:00:48.307 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-03-24T12:00:48.339 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:48 +0000 (0:00:00.056) 0:02:40.037 ******* 2021-03-24T12:00:48.367 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-03-24T12:00:48.369 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:48.393 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:48 +0000 (0:00:00.054) 0:02:40.092 ******* 2021-03-24T12:00:48.421 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-03-24T12:00:48.423 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:48.447 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:48 +0000 (0:00:00.053) 0:02:40.146 ******* 2021-03-24T12:00:48.465 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-03-24T12:00:48.468 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-03-24T12:00:48.496 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:48 +0000 (0:00:00.049) 0:02:40.195 ******* 2021-03-24T12:00:48.509 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-24T12:00:48.511 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:48.536 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:48 +0000 (0:00:00.039) 0:02:40.234 ******* 2021-03-24T12:00:48.565 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-24T12:00:48.567 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:48.606 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:48 +0000 (0:00:00.069) 0:02:40.304 ******* 2021-03-24T12:00:48.647 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-03-24T12:00:48.679 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:48 +0000 (0:00:00.073) 0:02:40.378 ******* 2021-03-24T12:00:48.793 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-03-24T12:00:48.796 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-03-24T12:00:48.832 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:48 +0000 (0:00:00.152) 0:02:40.530 ******* 2021-03-24T12:00:48.979 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-03-24T12:00:48.981 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-03-24T12:00:49.003 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:48 +0000 (0:00:00.171) 0:02:40.702 ******* 2021-03-24T12:00:49.086 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-03-24T12:00:49.088 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-03-24T12:00:49.112 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:49 +0000 (0:00:00.109) 0:02:40.811 ******* 2021-03-24T12:00:49.364 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-03-24T12:00:49.391 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:49 +0000 (0:00:00.279) 0:02:41.090 ******* 2021-03-24T12:00:49.393 INFO:teuthology.task.ansible.out: 2021-03-24T12:00:49.488 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-03-24T12:00:49.491 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-03-24T12:00:49.523 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:49 +0000 (0:00:00.131) 0:02:41.221 ******* 2021-03-24T12:00:49.775 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-03-24T12:00:49.808 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:49 +0000 (0:00:00.284) 0:02:41.506 ******* 2021-03-24T12:00:50.526 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-03-24T12:00:50.528 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"cache_update_time": 1616586868, "cache_updated": false, "changed": false} 2021-03-24T12:00:50.551 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:50 +0000 (0:00:00.743) 0:02:42.250 ******* 2021-03-24T12:00:50.725 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1616586912, "cache_updated": false, "changed": false} 2021-03-24T12:00:50.760 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:50 +0000 (0:00:00.208) 0:02:42.458 ******* 2021-03-24T12:00:50.770 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-03-24T12:00:50.773 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.047391", "end": "2021-03-24 12:00:50.743740", "rc": 0, "start": "2021-03-24 12:00:50.696349", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-03-24T12:00:50.808 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:50 +0000 (0:00:00.047) 0:02:42.506 ******* 2021-03-24T12:00:50.851 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-03-24T12:00:50.853 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:50.875 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:50 +0000 (0:00:00.067) 0:02:42.574 ******* 2021-03-24T12:00:50.903 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-03-24T12:00:50.905 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:50.927 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:50 +0000 (0:00:00.051) 0:02:42.625 ******* 2021-03-24T12:00:50.965 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-03-24T12:00:50.967 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.047557", "end": "2021-03-24 12:00:50.579536", "rc": 0, "start": "2021-03-24 12:00:50.531979", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-03-24T12:00:51.007 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:51 +0000 (0:00:00.080) 0:02:42.706 ******* 2021-03-24T12:00:51.038 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-03-24T12:00:51.040 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:51.063 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:51 +0000 (0:00:00.055) 0:02:42.762 ******* 2021-03-24T12:00:51.091 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-03-24T12:00:51.093 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:51.116 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:51 +0000 (0:00:00.052) 0:02:42.815 ******* 2021-03-24T12:00:51.799 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-03-24T12:00:51.801 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"cache_update_time": 1616586868, "cache_updated": false, "changed": false} 2021-03-24T12:00:51.832 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:51 +0000 (0:00:00.716) 0:02:43.531 ******* 2021-03-24T12:00:51.874 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-03-24T12:00:51.876 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:51.900 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:51 +0000 (0:00:00.067) 0:02:43.598 ******* 2021-03-24T12:00:52.003 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-03-24T12:00:52.186 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1616586912, "cache_updated": false, "changed": false} Wednesday 24 March 2021 12:00:52 +0000 (0:00:00.135) 0:02:43.734 ******* TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 24 March 2021 12:00:52 +0000 (0:00:00.050) 0:02:43.785 ******* 2021-03-24T12:00:52.275 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-03-24T12:00:52.276 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-03-24T12:00:52.315 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:52 +0000 (0:00:00.228) 0:02:44.013 ******* 2021-03-24T12:00:52.344 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-03-24T12:00:52.346 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:52.372 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:52 +0000 (0:00:00.057) 0:02:44.071 ******* 2021-03-24T12:00:52.446 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-03-24T12:00:52.449 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-03-24T12:00:52.473 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:52 +0000 (0:00:00.100) 0:02:44.171 ******* 2021-03-24T12:00:52.500 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-03-24T12:00:52.502 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:52.532 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:52 +0000 (0:00:00.058) 0:02:44.230 ******* 2021-03-24T12:00:52.622 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-03-24T12:00:52.623 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-24 11:57:33 UTC", "ActiveEnterTimestampMonotonic": "23636443", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount basic.target sysinit.target system.slice network.target systemd-tmpfiles-setup.service systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-24 11:57:26 UTC", "AssertTimestampMonotonic": "17084165", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-24 11:57:26 UTC", "ConditionTimestampMonotonic": "17084165", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2021-03-24T12:00:52.625 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2066", "ExecMainStartTimestamp": "Wed 2021-03-24 11:57:33 UTC", "ExecMainStartTimestampMonotonic": "23636413", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-24 11:57:26 UTC", "InactiveExitTimestampMonotonic": "17084994", "InvocationID": "bd70725a23bb4088ab45e42cfbbd6949", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2021-03-24T12:00:52.626 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2066", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-24 11:57:33 UTC", "S 2021-03-24T12:00:52.628 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "23636443", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2021-03-24 11:57:33 UTC", "WatchdogTimestampMonotonic": "23636441", "WatchdogUSec": "0"}} 2021-03-24T12:00:52.652 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:52 +0000 (0:00:00.119) 0:02:44.350 ******* 2021-03-24T12:00:52.691 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-24T12:00:52.692 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-03-24T12:00:52.715 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:52 +0000 (0:00:00.063) 0:02:44.414 ******* 2021-03-24T12:00:52.754 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-24T12:00:52.755 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:52.757 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-03-24T12:00:52.759 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-24 11:58:03 UTC", "ActiveEnterTimestampMonotonic": "25845908", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service -.mount network.target sysinit.target systemd-journald.socket system.slice basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-24 11:57:56 UTC", "AssertTimestampMonotonic": "19300069", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-24 11:57:56 UTC", "ConditionTimestampMonotonic": "19300069", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2021-03-24T12:00:52.760 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2071", "ExecMainStartTimestamp": "Wed 2021-03-24 11:58:03 UTC", "ExecMainStartTimestampMonotonic": "25845880", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-24 11:57:56 UTC", "InactiveExitTimestampMonotonic": "19300802", "InvocationID": "6bf743a4509d4992822f5ba08c28cb0e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2021-03-24T12:00:52.762 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2071", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-24 11:58:03 UTC", "S 2021-03-24T12:00:52.764 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "25845908", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2021-03-24 11:58:03 UTC", "WatchdogTimestampMonotonic": "25845906", "WatchdogUSec": "0"}} 2021-03-24T12:00:52.787 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:52 +0000 (0:00:00.072) 0:02:44.486 ******* 2021-03-24T12:00:52.810 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:52 +0000 (0:00:00.022) 0:02:44.508 ******* 2021-03-24T12:00:52.829 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:52.857 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:52 +0000 (0:00:00.047) 0:02:44.555 ******* 2021-03-24T12:00:52.864 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-24T12:00:52.867 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-03-24T12:00:52.893 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:52 +0000 (0:00:00.035) 0:02:44.591 ******* 2021-03-24T12:00:52.933 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-24T12:00:52.935 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:52.970 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:52 +0000 (0:00:00.077) 0:02:44.668 ******* 2021-03-24T12:00:53.039 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-03-24T12:00:53.040 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:53.069 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:53 +0000 (0:00:00.099) 0:02:44.767 ******* 2021-03-24T12:00:53.798 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-03-24T12:00:53.800 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"cache_update_time": 1616586868, "cache_updated": false, "changed": false} 2021-03-24T12:00:53.842 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:53 +0000 (0:00:00.772) 0:02:45.540 ******* 2021-03-24T12:00:53.873 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:53.899 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:53 +0000 (0:00:00.057) 0:02:45.598 ******* 2021-03-24T12:00:54.007 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-03-24T12:00:54.009 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1616586912, "cache_updated": false, "changed": false} 2021-03-24T12:00:54.036 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:54 +0000 (0:00:00.136) 0:02:45.735 ******* 2021-03-24T12:00:54.053 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-03-24T12:00:54.055 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-03-24T12:00:54.078 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:54 +0000 (0:00:00.041) 0:02:45.776 ******* 2021-03-24T12:00:54.085 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-03-24T12:00:54.087 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:54.112 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:54 +0000 (0:00:00.033) 0:02:45.810 ******* 2021-03-24T12:00:54.247 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-03-24T12:00:54.248 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-03-24T12:00:54.278 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:54 +0000 (0:00:00.166) 0:02:45.976 ******* 2021-03-24T12:00:54.443 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-03-24T12:00:54.445 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-03-24T12:00:54.469 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:54 +0000 (0:00:00.191) 0:02:46.168 ******* 2021-03-24T12:00:54.625 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-03-24T12:00:54.657 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:54 +0000 (0:00:00.187) 0:02:46.355 ******* 2021-03-24T12:00:55.444 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-03-24T12:00:55.446 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-03-24T12:00:55.473 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:55 +0000 (0:00:00.816) 0:02:47.171 ******* 2021-03-24T12:00:55.501 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-03-24T12:00:55.531 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:55 +0000 (0:00:00.058) 0:02:47.229 ******* 2021-03-24T12:00:55.999 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-03-24T12:00:56.001 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false} 2021-03-24T12:00:56.029 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:56 +0000 (0:00:00.498) 0:02:47.728 ******* 2021-03-24T12:00:56.070 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false} 2021-03-24T12:00:56.072 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-03-24T12:00:56.096 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:56 +0000 (0:00:00.065) 0:02:47.794 ******* 2021-03-24T12:00:56.120 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:56 +0000 (0:00:00.024) 0:02:47.818 ******* 2021-03-24T12:00:56.137 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2021-03-24T12:00:56.164 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:56 +0000 (0:00:00.044) 0:02:47.862 ******* 2021-03-24T12:00:56.280 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-03-24T12:00:56.282 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1616586844.6761825, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1616586844.6721826, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 262873, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1616586844.6721826, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3476867264", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-03-24T12:00:56.314 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:56 +0000 (0:00:00.150) 0:02:48.013 ******* 2021-03-24T12:00:56.327 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1616586793.9077156, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1616586793.9037175, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 262873, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1616586793.9037175, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "3476867264", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-03-24T12:00:56.359 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:56 +0000 (0:00:00.044) 0:02:48.057 ******* 2021-03-24T12:00:56.892 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-03-24T12:00:56.893 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-03-24T12:00:56.930 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:56 +0000 (0:00:00.571) 0:02:48.628 ******* 2021-03-24T12:00:56.939 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-03-24T12:00:56.973 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:56 +0000 (0:00:00.042) 0:02:48.671 ******* 2021-03-24T12:00:56.999 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-03-24T12:00:57.001 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-03-24T12:00:57.031 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:57 +0000 (0:00:00.058) 0:02:48.729 ******* 2021-03-24T12:00:57.039 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-03-24T12:00:57.084 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:57 +0000 (0:00:00.053) 0:02:48.782 ******* 2021-03-24T12:00:57.099 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-03-24T12:00:57.101 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.129 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:57 +0000 (0:00:00.044) 0:02:48.827 ******* 2021-03-24T12:00:57.138 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.170 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:57 +0000 (0:00:00.040) 0:02:48.868 ******* 2021-03-24T12:00:57.283 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-03-24T12:00:57.285 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-03-24T12:00:57.311 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:57 +0000 (0:00:00.140) 0:02:49.008 ******* 2021-03-24T12:00:57.339 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-03-24T12:00:57.368 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:57 +0000 (0:00:00.057) 0:02:49.066 ******* 2021-03-24T12:00:57.462 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-03-24T12:00:57.464 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-03-24T12:00:57.495 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:57 +0000 (0:00:00.127) 0:02:49.194 ******* 2021-03-24T12:00:57.517 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-03-24T12:00:57.545 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:57 +0000 (0:00:00.049) 0:02:49.243 ******* 2021-03-24T12:00:57.557 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-03-24T12:00:57.559 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.594 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:57 +0000 (0:00:00.050) 0:02:49.293 ******* 2021-03-24T12:00:57.609 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.649 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:57 +0000 (0:00:00.054) 0:02:49.347 ******* 2021-03-24T12:00:57.658 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi161.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.660 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.671 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.673 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.683 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.718 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:57 +0000 (0:00:00.069) 0:02:49.417 ******* 2021-03-24T12:00:57.729 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.733 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.745 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.747 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.757 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.802 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:57 +0000 (0:00:00.083) 0:02:49.500 ******* 2021-03-24T12:00:57.815 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-03-24T12:00:57.818 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.819 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.821 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.823 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.858 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:57 +0000 (0:00:00.057) 0:02:49.557 ******* 2021-03-24T12:00:57.879 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.881 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi043.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.892 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.895 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.920 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:57 +0000 (0:00:00.062) 0:02:49.619 ******* 2021-03-24T12:00:57.928 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-24T12:00:57.930 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:57.963 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:57 +0000 (0:00:00.042) 0:02:49.662 ******* 2021-03-24T12:00:57.972 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:58.002 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:57 +0000 (0:00:00.038) 0:02:49.700 ******* 2021-03-24T12:00:58.009 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-03-24T12:00:58.012 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:58.039 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:58 +0000 (0:00:00.037) 0:02:49.738 ******* 2021-03-24T12:00:58.048 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:58.079 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:58 +0000 (0:00:00.039) 0:02:49.778 ******* 2021-03-24T12:00:58.098 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-03-24T12:00:58.100 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:58.127 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:58 +0000 (0:00:00.047) 0:02:49.826 ******* 2021-03-24T12:00:58.136 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:58.170 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:58 +0000 (0:00:00.043) 0:02:49.869 ******* 2021-03-24T12:00:58.185 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-03-24T12:00:58.187 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:58.218 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:58 +0000 (0:00:00.047) 0:02:49.917 ******* 2021-03-24T12:00:58.226 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:58.262 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:58 +0000 (0:00:00.043) 0:02:49.961 ******* 2021-03-24T12:00:58.270 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-03-24T12:00:58.272 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:58.304 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:58 +0000 (0:00:00.041) 0:02:50.003 ******* 2021-03-24T12:00:58.313 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:58.345 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:58 +0000 (0:00:00.040) 0:02:50.043 ******* 2021-03-24T12:00:58.347 INFO:teuthology.task.ansible.out: 2021-03-24T12:00:58.357 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-24T12:00:58.359 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:58.394 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:58 +0000 (0:00:00.049) 0:02:50.093 ******* 2021-03-24T12:00:58.404 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:58.434 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:58 +0000 (0:00:00.040) 0:02:50.133 ******* 2021-03-24T12:00:58.443 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-03-24T12:00:58.445 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:58.475 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:58 +0000 (0:00:00.040) 0:02:50.173 ******* 2021-03-24T12:00:58.483 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:58.517 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:58 +0000 (0:00:00.042) 0:02:50.216 ******* 2021-03-24T12:00:58.528 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:58.565 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:58 +0000 (0:00:00.047) 0:02:50.264 ******* 2021-03-24T12:00:58.576 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:00:58.615 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:58 +0000 (0:00:00.050) 0:02:50.314 ******* 2021-03-24T12:00:58.755 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi161.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010643", "end": "2021-03-24 12:00:58.371630", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-03-24 12:00:58.360987", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:58.788 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011122", "end": "2021-03-24 12:00:58.753783", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-03-24 12:00:58.742661", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:58.884 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005970", "end": "2021-03-24 12:00:58.507513", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-03-24 12:00:58.501543", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:58.885 INFO:teuthology.task.ansible.out: 2021-03-24T12:00:58.918 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006191", "end": "2021-03-24 12:00:58.892389", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-03-24 12:00:58.886198", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:58.920 INFO:teuthology.task.ansible.out: 2021-03-24T12:00:59.019 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005478", "end": "2021-03-24 12:00:58.640551", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-03-24 12:00:58.635073", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:59.063 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005686", "end": "2021-03-24 12:00:59.031609", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-03-24 12:00:59.025923", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:59.065 INFO:teuthology.task.ansible.out: 2021-03-24T12:00:59.152 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.007769", "end": "2021-03-24 12:00:58.772783", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-03-24 12:00:58.765014", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:59.182 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:59 +0000 (0:00:00.566) 0:02:50.880 ******* 2021-03-24T12:00:59.210 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.007119", "end": "2021-03-24 12:00:59.178367", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-03-24 12:00:59.171248", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T12:00:59.212 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-03-24T12:00:59.253 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:59 +0000 (0:00:00.070) 0:02:50.952 ******* 2021-03-24T12:00:59.288 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:59 +0000 (0:00:00.035) 0:02:50.987 ******* 2021-03-24T12:00:59.327 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:59 +0000 (0:00:00.038) 0:02:51.026 ******* 2021-03-24T12:00:59.452 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-03-24T12:00:59.454 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-03-24T12:00:59.518 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-03-24T12:00:59.601 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-03-24T12:00:59.620 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:59 +0000 (0:00:00.292) 0:02:51.319 ******* 2021-03-24T12:00:59.644 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:00:59 +0000 (0:00:00.024) 0:02:51.343 ******* 2021-03-24T12:01:00.415 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi043.front.sepia.ceph.com] 2021-03-24T12:01:00.506 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] Wednesday 24 March 2021 12:01:00 +0000 (0:00:00.834) 0:02:52.178 ******* 2021-03-24T12:01:00.529 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:00 +0000 (0:00:00.049) 0:02:52.228 ******* 2021-03-24T12:01:00.537 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi043.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-03-24T12:01:00.564 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:00 +0000 (0:00:00.035) 0:02:52.263 ******* 2021-03-24T12:01:00.572 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-03-24T12:01:00.599 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:00 +0000 (0:00:00.034) 0:02:52.298 ******* 2021-03-24T12:01:00.607 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-24T12:01:00.611 INFO:teuthology.task.ansible.out:skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:01:00.635 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:00 +0000 (0:00:00.036) 0:02:52.334 ******* 2021-03-24T12:01:00.644 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:01:00.672 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:00 +0000 (0:00:00.036) 0:02:52.370 ******* 2021-03-24T12:01:00.706 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-03-24T12:01:00.708 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-03-24T12:01:00.738 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:00 +0000 (0:00:00.065) 0:02:52.436 ******* 2021-03-24T12:01:00.745 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-03-24T12:01:00.777 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:00 +0000 (0:00:00.039) 0:02:52.476 ******* 2021-03-24T12:01:01.706 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-03-24T12:01:01.708 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"cache_update_time": 1616586868, "cache_updated": false, "changed": false} 2021-03-24T12:01:01.748 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:01 +0000 (0:00:00.970) 0:02:53.447 ******* 2021-03-24T12:01:01.768 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1616586912, "cache_updated": false, "changed": false} 2021-03-24T12:01:01.808 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:01 +0000 (0:00:00.059) 0:02:53.507 ******* 2021-03-24T12:01:01.818 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:01:01.869 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:01 +0000 (0:00:00.060) 0:02:53.567 ******* 2021-03-24T12:01:01.885 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-24T12:01:01.933 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:01 +0000 (0:00:00.064) 0:02:53.632 ******* 2021-03-24T12:01:01.941 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-24T12:01:01.944 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-03-24T12:01:01.975 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:01 +0000 (0:00:00.041) 0:02:53.673 ******* 2021-03-24T12:01:02.019 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-03-24T12:01:02.064 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:02 +0000 (0:00:00.089) 0:02:53.763 ******* 2021-03-24T12:01:02.275 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* changed: [smithi043.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-24T12:01:02.415 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-24T12:01:02.443 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-24T12:01:02.448 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-24T12:01:02.510 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:02 +0000 (0:00:00.446) 0:02:54.209 ******* 2021-03-24T12:01:02.553 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:02 +0000 (0:00:00.041) 0:02:54.250 ******* 2021-03-24T12:01:03.114 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-03-24T12:01:03.116 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616587262.62174-32036-31615553942021/source", "state": "file", "uid": 0} 2021-03-24T12:01:03.177 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616587262.720896-32041-257921169823752/source", "state": "file", "uid": 0} 2021-03-24T12:01:03.612 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616587263.1691864-32036-105281661944226/source", "state": "file", "uid": 0} 2021-03-24T12:01:03.658 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:03 +0000 (0:00:01.106) 0:02:55.357 ******* 2021-03-24T12:01:03.668 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616587263.2456415-32041-250704132796033/source", "state": "file", "uid": 0} 2021-03-24T12:01:03.699 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:03 +0000 (0:00:00.040) 0:02:55.398 ******* 2021-03-24T12:01:07.284 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-03-24T12:01:07.286 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-rx7DL0-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-rx7DL0-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packag 2021-03-24T12:01:07.288 INFO:teuthology.task.ansible.out:es/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-03-24T12:01:07.319 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:07 +0000 (0:00:03.619) 0:02:59.018 ******* 2021-03-24T12:01:07.331 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-CAvHy3-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-CAvHy3-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packag 2021-03-24T12:01:07.333 INFO:teuthology.task.ansible.out:es/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-03-24T12:01:07.370 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:07 +0000 (0:00:00.050) 0:02:59.069 ******* 2021-03-24T12:01:07.478 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-03-24T12:01:07.479 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-03-24T12:01:07.518 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:07 +0000 (0:00:00.147) 0:02:59.216 ******* 2021-03-24T12:01:07.526 INFO:teuthology.task.ansible.out:ok: [smithi043.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-03-24T12:01:07.555 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:07 +0000 (0:00:00.037) 0:02:59.254 ******* 2021-03-24T12:01:07.906 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-03-24T12:01:07.909 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616587267.5773838-342-173612134425981/source", "state": "file", "uid": 0} 2021-03-24T12:01:07.941 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:07 +0000 (0:00:00.386) 0:02:59.640 ******* 2021-03-24T12:01:07.967 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1616587267.618885-345-223270074934337/source", "state": "file", "uid": 0} 2021-03-24T12:01:08.011 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:08 +0000 (0:00:00.069) 0:02:59.709 ******* 2021-03-24T12:01:08.223 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-03-24T12:01:08.225 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.121649", "end": "2021-03-24 12:01:07.855986", "rc": 0, "start": "2021-03-24 12:01:07.734337", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T12:01:08.258 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:08 +0000 (0:00:00.247) 0:02:59.957 ******* 2021-03-24T12:01:08.311 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.125584", "end": "2021-03-24 12:01:08.286016", "rc": 0, "start": "2021-03-24 12:01:08.160432", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-24T12:01:08.348 INFO:teuthology.task.ansible.out:Wednesday 24 March 2021 12:01:08 +0000 (0:00:00.089) 0:03:00.046 ******* 2021-03-24T12:01:11.842 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-03-24T12:01:11.845 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sysinit.target containerd.service system.slice systemd-journald.socket docker.socket basic.target network-online.target firewalld.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMa 2021-03-24T12:01:11.847 INFO:teuthology.task.ansible.out:inStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "12802 2021-03-24T12:01:11.849 INFO:teuthology.task.ansible.out:9", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target docker.socket system.slice", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-24 11:59:59 UTC", "StateChangeTimestampMonotonic": "141343341", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "S 2021-03-24T12:01:11.851 INFO:teuthology.task.ansible.out:uccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-24T12:01:12.040 INFO:teuthology.task.ansible.out:changed: [smithi043.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "docker.socket systemd-journald.socket containerd.service sysinit.target basic.target system.slice firewalld.service network-online.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMa 2021-03-24T12:01:12.042 INFO:teuthology.task.ansible.out:inStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "12805 2021-03-24T12:01:12.044 INFO:teuthology.task.ansible.out:3", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-24 11:59:51 UTC", "StateChangeTimestampMonotonic": "162115333", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "S 2021-03-24T12:01:12.045 INFO:teuthology.task.ansible.out:uccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-24T12:01:12.119 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-03-24T12:01:12.121 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** 2021-03-24T12:01:12.124 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi043.front.sepia.ceph.com : ok=127 changed=36 unreachable=0 failed=0 skipped=184 rescued=0 ignored=0 smithi161.front.sepia.ceph.com : ok=127 changed=36 unreachable=0 failed=0 skipped=184 rescued=0 ignored=0 Wednesday 24 March 2021 12:01:12 +0000 (0:00:03.776) 0:03:03.822 ******* =============================================================================== 2021-03-24T12:01:12.125 INFO:teuthology.task.ansible.out:Create all admin users with sudo access. ------------------------------- 21.45s testnode : Install packages -------------------------------------------- 10.38s users : Update authorized_keys using the keys repo ---------------------- 8.42s 2021-03-24T12:01:12.125 INFO:teuthology.task.ansible.out:testnode : Zap all non-root disks --------------------------------------- 8.17s container-host : Restart docker service --------------------------------- 3.78s container-host : Install registries-conf-ctl ---------------------------- 3.62s testnode : Update apt cache. -------------------------------------------- 3.04s testnode : Ensure packages are not present. ----------------------------- 2.98s testnode : Install apt keys --------------------------------------------- 2.00s users : Clone the keys repo --------------------------------------------- 1.93s Gathering Facts --------------------------------------------------------- 1.85s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.39s testnode : Upgrade packages --------------------------------------------- 1.25s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 1.11s container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert --- 1.11s testnode : Install python-apt ------------------------------------------- 1.05s container-host : Install container packages --------------- 2021-03-24T12:01:12.127 INFO:teuthology.task.ansible.out:-------------- 0.97s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 0.94s common : Update apt cache ----------------------------------------------- 0.90s testnode : Create logical volume(s) ------------------------------------- 0.87s 2021-03-24T12:01:12.554 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi043.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com')] 2021-03-24T12:01:12.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-24T12:01:12.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-24T12:01:12.681 DEBUG:teuthology.orchestra.run.smithi043:> true 2021-03-24T12:01:12.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-24T12:01:12.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-24T12:01:12.905 DEBUG:teuthology.orchestra.run.smithi161:> true 2021-03-24T12:01:13.103 INFO:teuthology.run_tasks:Running task clock... 2021-03-24T12:01:13.117 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-03-24T12:01:13.118 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-03-24T12:01:13.120 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-03-24T12:01:13.195 INFO:teuthology.orchestra.run.smithi043.stdout:24 Mar 12:01:13 ntpd[8726]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-03-24T12:01:13.195 INFO:teuthology.orchestra.run.smithi043.stdout:24 Mar 12:01:13 ntpd[8726]: Command line: ntpd -gq 2021-03-24T12:01:13.196 INFO:teuthology.orchestra.run.smithi043.stdout:24 Mar 12:01:13 ntpd[8726]: proto: precision = 0.126 usec (-23) 2021-03-24T12:01:13.197 INFO:teuthology.orchestra.run.smithi043.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-24T12:01:13.197 INFO:teuthology.orchestra.run.smithi043.stdout:24 Mar 12:01:13 ntpd[8726]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-24T12:01:13.198 INFO:teuthology.orchestra.run.smithi043.stderr:restrict ::: KOD does nothing without LIMITED. 2021-03-24T12:01:13.199 INFO:teuthology.orchestra.run.smithi043.stdout:24 Mar 12:01:13 ntpd[8726]: restrict ::: KOD does nothing without LIMITED. 2021-03-24T12:01:13.199 INFO:teuthology.orchestra.run.smithi043.stdout:24 Mar 12:01:13 ntpd[8726]: Listen and drop on 0 v6wildcard [::]:123 2021-03-24T12:01:13.200 INFO:teuthology.orchestra.run.smithi043.stdout:24 Mar 12:01:13 ntpd[8726]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-03-24T12:01:13.200 INFO:teuthology.orchestra.run.smithi043.stdout:24 Mar 12:01:13 ntpd[8726]: Listen normally on 2 lo 127.0.0.1:123 2021-03-24T12:01:13.200 INFO:teuthology.orchestra.run.smithi043.stdout:24 Mar 12:01:13 ntpd[8726]: Listen normally on 3 ens1f0 172.21.15.43:123 2021-03-24T12:01:13.200 INFO:teuthology.orchestra.run.smithi043.stdout:24 Mar 12:01:13 ntpd[8726]: Listen normally on 4 lo [::1]:123 2021-03-24T12:01:13.201 INFO:teuthology.orchestra.run.smithi043.stdout:24 Mar 12:01:13 ntpd[8726]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1358%3]:123 2021-03-24T12:01:13.201 INFO:teuthology.orchestra.run.smithi043.stdout:24 Mar 12:01:13 ntpd[8726]: Listening on routing socket on fd #22 for interface updates 2021-03-24T12:01:15.197 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:15 ntpd[8726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:15.197 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:15 ntpd[8726]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:15.198 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:15 ntpd[8726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:15.198 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:15 ntpd[8726]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:15.198 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:15 ntpd[8726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:15.198 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:15 ntpd[8726]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:15.199 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:15 ntpd[8726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:15.199 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:15 ntpd[8726]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:16.196 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:16 ntpd[8726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:16.196 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:16 ntpd[8726]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:16.196 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:16 ntpd[8726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:16.197 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:16 ntpd[8726]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:17.196 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:17 ntpd[8726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:17.197 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:17 ntpd[8726]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:17.197 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:17 ntpd[8726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:17.197 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:17 ntpd[8726]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:17.197 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:17 ntpd[8726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:17.198 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:17 ntpd[8726]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:17.198 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:17 ntpd[8726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:17.198 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:17 ntpd[8726]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:18.196 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:18 ntpd[8726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:18.197 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:18 ntpd[8726]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:18.197 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:18 ntpd[8726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:18.197 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:18 ntpd[8726]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:18.197 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:18 ntpd[8726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:18.198 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:18 ntpd[8726]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:18.198 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:18 ntpd[8726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:18.198 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:18 ntpd[8726]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:19.197 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:19 ntpd[8726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:19.198 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:19 ntpd[8726]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:19.198 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:19 ntpd[8726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:19.199 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:19 ntpd[8726]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:19.199 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:19 ntpd[8726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:19.199 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:19 ntpd[8726]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:19.200 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:19 ntpd[8726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:19.200 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:19 ntpd[8726]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:20.196 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:20 ntpd[8726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:20.196 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:20 ntpd[8726]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:20.197 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:20 ntpd[8726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:20.197 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:20 ntpd[8726]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:20.197 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:20 ntpd[8726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:20.198 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:20 ntpd[8726]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:20.198 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:20 ntpd[8726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:20.198 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:20 ntpd[8726]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:21.197 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:21 ntpd[8726]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:21.197 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:21 ntpd[8726]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:21.198 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:21 ntpd[8726]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:21.198 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:21 ntpd[8726]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:21.199 INFO:teuthology.orchestra.run.smithi043.stdout:24 Mar 12:01:21 ntpd[8726]: ntpd: time slew +0.002935 s 2021-03-24T12:01:21.200 INFO:teuthology.orchestra.run.smithi043.stdout:ntpd: time slew +0.002935s 2021-03-24T12:01:21.201 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:21 ntpd[8726]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-03-24T12:01:21.202 INFO:teuthology.orchestra.run.smithi043.stderr:24 Mar 12:01:21 ntpd[8726]: can't open /var/log/ntpstats/loopstats.20210324: Permission denied 2021-03-24T12:01:21.243 INFO:teuthology.orchestra.run.smithi043.stdout: remote refid st t when poll reach delay offset jitter 2021-03-24T12:01:21.243 INFO:teuthology.orchestra.run.smithi043.stdout:============================================================================== 2021-03-24T12:01:21.244 INFO:teuthology.orchestra.run.smithi043.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-24T12:01:21.244 INFO:teuthology.orchestra.run.smithi043.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-24T12:01:21.244 INFO:teuthology.orchestra.run.smithi043.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-24T12:01:21.244 INFO:teuthology.orchestra.run.smithi043.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-24T12:01:21.246 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-03-24T12:01:21.248 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-03-24T12:01:21.308 INFO:teuthology.orchestra.run.smithi161.stdout:24 Mar 12:01:21 ntpd[8643]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-03-24T12:01:21.309 INFO:teuthology.orchestra.run.smithi161.stdout:24 Mar 12:01:21 ntpd[8643]: Command line: ntpd -gq 2021-03-24T12:01:21.310 INFO:teuthology.orchestra.run.smithi161.stdout:24 Mar 12:01:21 ntpd[8643]: proto: precision = 0.123 usec (-23) 2021-03-24T12:01:21.310 INFO:teuthology.orchestra.run.smithi161.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-24T12:01:21.311 INFO:teuthology.orchestra.run.smithi161.stdout:24 Mar 12:01:21 ntpd[8643]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-24T12:01:21.312 INFO:teuthology.orchestra.run.smithi161.stderr:restrict ::: KOD does nothing without LIMITED. 2021-03-24T12:01:21.314 INFO:teuthology.orchestra.run.smithi161.stdout:24 Mar 12:01:21 ntpd[8643]: restrict ::: KOD does nothing without LIMITED. 2021-03-24T12:01:21.315 INFO:teuthology.orchestra.run.smithi161.stdout:24 Mar 12:01:21 ntpd[8643]: Listen and drop on 0 v6wildcard [::]:123 2021-03-24T12:01:21.315 INFO:teuthology.orchestra.run.smithi161.stdout:24 Mar 12:01:21 ntpd[8643]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-03-24T12:01:21.316 INFO:teuthology.orchestra.run.smithi161.stdout:24 Mar 12:01:21 ntpd[8643]: Listen normally on 2 lo 127.0.0.1:123 2021-03-24T12:01:21.316 INFO:teuthology.orchestra.run.smithi161.stdout:24 Mar 12:01:21 ntpd[8643]: Listen normally on 3 enp3s0f1 172.21.15.161:123 2021-03-24T12:01:21.317 INFO:teuthology.orchestra.run.smithi161.stdout:24 Mar 12:01:21 ntpd[8643]: Listen normally on 4 lo [::1]:123 2021-03-24T12:01:21.317 INFO:teuthology.orchestra.run.smithi161.stdout:24 Mar 12:01:21 ntpd[8643]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7251%5]:123 2021-03-24T12:01:21.318 INFO:teuthology.orchestra.run.smithi161.stdout:24 Mar 12:01:21 ntpd[8643]: Listening on routing socket on fd #22 for interface updates 2021-03-24T12:01:22.310 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:22 ntpd[8643]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:22.311 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:22 ntpd[8643]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:22.311 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:22 ntpd[8643]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:22.311 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:22 ntpd[8643]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:24.309 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:24 ntpd[8643]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:24.310 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:24 ntpd[8643]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:24.310 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:24 ntpd[8643]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:24.310 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:24 ntpd[8643]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:24.310 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:24 ntpd[8643]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:24.311 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:24 ntpd[8643]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:24.311 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:24 ntpd[8643]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:24.311 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:24 ntpd[8643]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:25.309 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:25 ntpd[8643]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:25.310 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:25 ntpd[8643]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:25.310 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:25 ntpd[8643]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:25.310 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:25 ntpd[8643]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:25.310 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:25 ntpd[8643]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:25.311 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:25 ntpd[8643]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:25.311 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:25 ntpd[8643]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:25.311 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:25 ntpd[8643]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:26.314 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:26 ntpd[8643]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:26.315 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:26 ntpd[8643]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:26.316 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:26 ntpd[8643]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:26.316 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:26 ntpd[8643]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:26.317 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:26 ntpd[8643]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:26.317 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:26 ntpd[8643]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:26.318 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:26 ntpd[8643]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:26.318 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:26 ntpd[8643]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:27.309 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:27 ntpd[8643]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:27.310 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:27 ntpd[8643]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:27.310 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:27 ntpd[8643]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:27.310 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:27 ntpd[8643]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:27.310 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:27 ntpd[8643]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:27.311 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:27 ntpd[8643]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:27.311 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:27 ntpd[8643]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:27.311 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:27 ntpd[8643]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:28.309 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:28 ntpd[8643]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:28.309 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:28 ntpd[8643]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:28.310 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:28 ntpd[8643]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:28.310 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:28 ntpd[8643]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:28.310 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:28 ntpd[8643]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-24T12:01:28.310 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:28 ntpd[8643]: can't open /var/log/ntpstats/rawstats.20210324: Permission denied 2021-03-24T12:01:28.311 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:28 ntpd[8643]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-24T12:01:28.311 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:28 ntpd[8643]: can't open /var/log/ntpstats/peerstats.20210324: Permission denied 2021-03-24T12:01:28.311 INFO:teuthology.orchestra.run.smithi161.stdout:24 Mar 12:01:28 ntpd[8643]: ntpd: time slew -0.003522 s 2021-03-24T12:01:28.312 INFO:teuthology.orchestra.run.smithi161.stdout:ntpd: time slew -0.003522s 2021-03-24T12:01:28.312 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:28 ntpd[8643]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-03-24T12:01:28.313 INFO:teuthology.orchestra.run.smithi161.stderr:24 Mar 12:01:28 ntpd[8643]: can't open /var/log/ntpstats/loopstats.20210324: Permission denied 2021-03-24T12:01:28.351 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2021-03-24T12:01:28.352 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2021-03-24T12:01:28.352 INFO:teuthology.orchestra.run.smithi161.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-24T12:01:28.352 INFO:teuthology.orchestra.run.smithi161.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-24T12:01:28.353 INFO:teuthology.orchestra.run.smithi161.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-24T12:01:28.353 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-24T12:01:28.354 INFO:teuthology.run_tasks:Running task install... 2021-03-24T12:01:28.366 DEBUG:teuthology.task.install:project ceph 2021-03-24T12:01:28.370 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'branch': 'octopus', 'sha1': '666a545dfbb7fc4fe7736e3c0e891b149a8ef286'}} 2021-03-24T12:01:28.370 DEBUG:teuthology.task.install:config {'branch': 'octopus', 'sha1': '666a545dfbb7fc4fe7736e3c0e891b149a8ef286'} 2021-03-24T12:01:28.371 INFO:teuthology.task.install:Using flavor: basic 2021-03-24T12:01:28.380 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-03-24T12:01:28.382 INFO:teuthology.task.install:extra packages: [] 2021-03-24T12:01:28.383 DEBUG:teuthology.orchestra.run.smithi043:> sudo lsb_release -is 2021-03-24T12:01:28.436 INFO:teuthology.orchestra.run.smithi043.stdout:Ubuntu 2021-03-24T12:01:28.442 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-03-24T12:01:28.443 DEBUG:teuthology.orchestra.run.smithi161:> sudo lsb_release -is 2021-03-24T12:01:28.444 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-key list | grep Ceph 2021-03-24T12:01:28.499 INFO:teuthology.orchestra.run.smithi161.stdout:Ubuntu 2021-03-24T12:01:28.505 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-03-24T12:01:28.505 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-key list | grep Ceph 2021-03-24T12:01:28.544 INFO:teuthology.orchestra.run.smithi043.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-03-24T12:01:28.599 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-03-24T12:01:28.606 INFO:teuthology.orchestra.run.smithi043.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-03-24T12:01:28.607 INFO:teuthology.orchestra.run.smithi043.stdout:uid [ unknown] Ceph.com (release key) 2021-03-24T12:01:28.609 DEBUG:teuthology.orchestra.run.smithi043:> sudo lsb_release -is 2021-03-24T12:01:28.655 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-03-24T12:01:28.656 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph.com (release key) 2021-03-24T12:01:28.656 DEBUG:teuthology.orchestra.run.smithi161:> sudo lsb_release -is 2021-03-24T12:01:28.664 INFO:teuthology.orchestra.run.smithi043.stdout:Ubuntu 2021-03-24T12:01:28.669 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-03-24T12:01:28.677 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-03-24T12:01:28.677 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-03-24T12:01:28.678 INFO:teuthology.packaging:ref: None 2021-03-24T12:01:28.678 INFO:teuthology.packaging:tag: None 2021-03-24T12:01:28.678 INFO:teuthology.packaging:branch: octopus 2021-03-24T12:01:28.679 INFO:teuthology.packaging:sha1: 666a545dfbb7fc4fe7736e3c0e891b149a8ef286 2021-03-24T12:01:28.680 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=octopus 2021-03-24T12:01:28.706 INFO:teuthology.orchestra.run.smithi161.stdout:Ubuntu 2021-03-24T12:01:28.711 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-03-24T12:01:28.712 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-03-24T12:01:28.713 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-03-24T12:01:28.713 INFO:teuthology.packaging:ref: None 2021-03-24T12:01:28.714 INFO:teuthology.packaging:tag: None 2021-03-24T12:01:28.714 INFO:teuthology.packaging:branch: octopus 2021-03-24T12:01:28.715 INFO:teuthology.packaging:sha1: 666a545dfbb7fc4fe7736e3c0e891b149a8ef286 2021-03-24T12:01:28.716 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=octopus 2021-03-24T12:01:28.927 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default/ 2021-03-24T12:01:28.928 INFO:teuthology.task.install.deb:Package version is 15.2.10-72-g13f4488c-1bionic 2021-03-24T12:01:28.935 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default/ 2021-03-24T12:01:28.936 INFO:teuthology.task.install.deb:Package version is 15.2.10-72-g13f4488c-1bionic 2021-03-24T12:01:29.046 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:01:29.046 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-03-24T12:01:29.051 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:01:29.052 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-03-24T12:01:29.068 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get update 2021-03-24T12:01:29.070 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2021-03-24T12:01:29.248 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-03-24T12:01:29.303 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic InRelease 2021-03-24T12:01:29.310 INFO:teuthology.orchestra.run.smithi043.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic InRelease 2021-03-24T12:01:29.323 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic Release [7,690 B] 2021-03-24T12:01:29.330 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic Release [7,690 B] 2021-03-24T12:01:29.346 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic Release.gpg 2021-03-24T12:01:29.353 INFO:teuthology.orchestra.run.smithi043.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic Release.gpg 2021-03-24T12:01:29.366 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-03-24T12:01:29.367 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,098 B] 2021-03-24T12:01:29.382 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:4 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-03-24T12:01:29.382 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-03-24T12:01:29.383 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,098 B] 2021-03-24T12:01:29.407 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2021-03-24T12:01:29.422 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2021-03-24T12:01:29.445 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-03-24T12:01:29.448 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-03-24T12:01:29.526 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-03-24T12:01:29.528 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-03-24T12:01:29.856 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 26.6 kB in 1s (46.3 kB/s) 2021-03-24T12:01:29.990 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 26.6 kB in 1s (37.2 kB/s) 2021-03-24T12:01:31.147 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2021-03-24T12:01:31.195 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.10-72-g13f4488c-1bionic cephadm=15.2.10-72-g13f4488c-1bionic ceph-mds=15.2.10-72-g13f4488c-1bionic ceph-mgr=15.2.10-72-g13f4488c-1bionic ceph-common=15.2.10-72-g13f4488c-1bionic ceph-fuse=15.2.10-72-g13f4488c-1bionic ceph-test=15.2.10-72-g13f4488c-1bionic radosgw=15.2.10-72-g13f4488c-1bionic python3-rados=15.2.10-72-g13f4488c-1bionic python3-rgw=15.2.10-72-g13f4488c-1bionic python3-cephfs=15.2.10-72-g13f4488c-1bionic python3-rbd=15.2.10-72-g13f4488c-1bionic libcephfs2=15.2.10-72-g13f4488c-1bionic libcephfs-dev=15.2.10-72-g13f4488c-1bionic librados2=15.2.10-72-g13f4488c-1bionic librbd1=15.2.10-72-g13f4488c-1bionic rbd-fuse=15.2.10-72-g13f4488c-1bionic 2021-03-24T12:01:31.282 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2021-03-24T12:01:31.295 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2021-03-24T12:01:31.342 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.10-72-g13f4488c-1bionic cephadm=15.2.10-72-g13f4488c-1bionic ceph-mds=15.2.10-72-g13f4488c-1bionic ceph-mgr=15.2.10-72-g13f4488c-1bionic ceph-common=15.2.10-72-g13f4488c-1bionic ceph-fuse=15.2.10-72-g13f4488c-1bionic ceph-test=15.2.10-72-g13f4488c-1bionic radosgw=15.2.10-72-g13f4488c-1bionic python3-rados=15.2.10-72-g13f4488c-1bionic python3-rgw=15.2.10-72-g13f4488c-1bionic python3-cephfs=15.2.10-72-g13f4488c-1bionic python3-rbd=15.2.10-72-g13f4488c-1bionic libcephfs2=15.2.10-72-g13f4488c-1bionic libcephfs-dev=15.2.10-72-g13f4488c-1bionic librados2=15.2.10-72-g13f4488c-1bionic librbd1=15.2.10-72-g13f4488c-1bionic rbd-fuse=15.2.10-72-g13f4488c-1bionic 2021-03-24T12:01:31.429 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2021-03-24T12:01:31.546 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2021-03-24T12:01:31.547 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2021-03-24T12:01:31.698 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2021-03-24T12:01:31.699 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2021-03-24T12:01:31.717 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2021-03-24T12:01:31.718 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-03-24T12:01:31.719 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-03-24T12:01:31.721 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2021-03-24T12:01:31.721 INFO:teuthology.orchestra.run.smithi161.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-03-24T12:01:31.722 INFO:teuthology.orchestra.run.smithi161.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2021-03-24T12:01:31.722 INFO:teuthology.orchestra.run.smithi161.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2021-03-24T12:01:31.723 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2021-03-24T12:01:31.723 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2021-03-24T12:01:31.723 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy3 python3-cryptography python3-cycler python3-dateutil 2021-03-24T12:01:31.724 INFO:teuthology.orchestra.run.smithi161.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2021-03-24T12:01:31.724 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-03-24T12:01:31.725 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-03-24T12:01:31.725 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2021-03-24T12:01:31.726 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2021-03-24T12:01:31.726 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2021-03-24T12:01:31.727 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2021-03-24T12:01:31.727 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2021-03-24T12:01:31.728 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2021-03-24T12:01:31.728 INFO:teuthology.orchestra.run.smithi161.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2021-03-24T12:01:31.729 INFO:teuthology.orchestra.run.smithi161.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2021-03-24T12:01:31.729 INFO:teuthology.orchestra.run.smithi161.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2021-03-24T12:01:31.730 INFO:teuthology.orchestra.run.smithi161.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2021-03-24T12:01:31.730 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-03-24T12:01:31.731 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2021-03-24T12:01:31.731 INFO:teuthology.orchestra.run.smithi161.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2021-03-24T12:01:31.732 INFO:teuthology.orchestra.run.smithi161.stdout: python-pytest-xdist python-mock python-cryptography-doc 2021-03-24T12:01:31.732 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2021-03-24T12:01:31.733 INFO:teuthology.orchestra.run.smithi161.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2021-03-24T12:01:31.733 INFO:teuthology.orchestra.run.smithi161.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2021-03-24T12:01:31.733 INFO:teuthology.orchestra.run.smithi161.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2021-03-24T12:01:31.734 INFO:teuthology.orchestra.run.smithi161.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2021-03-24T12:01:31.734 INFO:teuthology.orchestra.run.smithi161.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2021-03-24T12:01:31.735 INFO:teuthology.orchestra.run.smithi161.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2021-03-24T12:01:31.735 INFO:teuthology.orchestra.run.smithi161.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2021-03-24T12:01:31.736 INFO:teuthology.orchestra.run.smithi161.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2021-03-24T12:01:31.736 INFO:teuthology.orchestra.run.smithi161.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2021-03-24T12:01:31.736 INFO:teuthology.orchestra.run.smithi161.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2021-03-24T12:01:31.737 INFO:teuthology.orchestra.run.smithi161.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2021-03-24T12:01:31.737 INFO:teuthology.orchestra.run.smithi161.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2021-03-24T12:01:31.826 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2021-03-24T12:01:31.827 INFO:teuthology.orchestra.run.smithi161.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-03-24T12:01:31.827 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-03-24T12:01:31.827 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-03-24T12:01:31.828 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev 2021-03-24T12:01:31.828 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2021-03-24T12:01:31.831 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 nvme-cli 2021-03-24T12:01:31.832 INFO:teuthology.orchestra.run.smithi161.stdout: python-attr python-funcsigs python-pastedeploy-tpl python-pluggy python-py 2021-03-24T12:01:31.832 INFO:teuthology.orchestra.run.smithi161.stdout: python-pytest python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2021-03-24T12:01:31.832 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs 2021-03-24T12:01:31.832 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi-backend python3-cherrypy3 python3-cryptography python3-cycler 2021-03-24T12:01:31.833 INFO:teuthology.orchestra.run.smithi161.stdout: python3-dateutil python3-decorator python3-fasteners python3-html5lib 2021-03-24T12:01:31.833 INFO:teuthology.orchestra.run.smithi161.stdout: python3-httplib2 python3-jinja2 python3-joblib python3-json-pointer 2021-03-24T12:01:31.833 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch python3-jwt python3-kubernetes python3-logutils 2021-03-24T12:01:31.833 INFO:teuthology.orchestra.run.smithi161.stdout: python3-lxml python3-mako python3-markupsafe python3-matplotlib 2021-03-24T12:01:31.833 INFO:teuthology.orchestra.run.smithi161.stdout: python3-monotonic python3-numpy python3-oauth2client python3-olefile 2021-03-24T12:01:31.834 INFO:teuthology.orchestra.run.smithi161.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2021-03-24T12:01:31.834 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan python3-pil python3-pluggy python3-prettytable python3-py 2021-03-24T12:01:31.835 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing 2021-03-24T12:01:31.835 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2021-03-24T12:01:31.835 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2021-03-24T12:01:31.835 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-03-24T12:01:31.835 INFO:teuthology.orchestra.run.smithi161.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2021-03-24T12:01:31.836 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2021-03-24T12:01:31.836 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2021-03-24T12:01:31.836 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-03-24T12:01:31.837 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages will be upgraded: 2021-03-24T12:01:31.837 INFO:teuthology.orchestra.run.smithi161.stdout: librados2 librbd1 2021-03-24T12:01:31.880 INFO:teuthology.orchestra.run.smithi043.stdout:The following additional packages will be installed: 2021-03-24T12:01:31.881 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-03-24T12:01:31.881 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-03-24T12:01:31.883 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2021-03-24T12:01:31.883 INFO:teuthology.orchestra.run.smithi043.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-03-24T12:01:31.884 INFO:teuthology.orchestra.run.smithi043.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2021-03-24T12:01:31.885 INFO:teuthology.orchestra.run.smithi043.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2021-03-24T12:01:31.885 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2021-03-24T12:01:31.885 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2021-03-24T12:01:31.886 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy3 python3-cryptography python3-cycler python3-dateutil 2021-03-24T12:01:31.886 INFO:teuthology.orchestra.run.smithi043.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2021-03-24T12:01:31.886 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-03-24T12:01:31.887 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-03-24T12:01:31.887 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2021-03-24T12:01:31.887 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2021-03-24T12:01:31.888 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2021-03-24T12:01:31.888 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2021-03-24T12:01:31.888 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2021-03-24T12:01:31.889 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2021-03-24T12:01:31.889 INFO:teuthology.orchestra.run.smithi043.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2021-03-24T12:01:31.890 INFO:teuthology.orchestra.run.smithi043.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2021-03-24T12:01:31.890 INFO:teuthology.orchestra.run.smithi043.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2021-03-24T12:01:31.890 INFO:teuthology.orchestra.run.smithi043.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2021-03-24T12:01:31.891 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-03-24T12:01:31.891 INFO:teuthology.orchestra.run.smithi043.stdout:Suggested packages: 2021-03-24T12:01:31.892 INFO:teuthology.orchestra.run.smithi043.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2021-03-24T12:01:31.892 INFO:teuthology.orchestra.run.smithi043.stdout: python-pytest-xdist python-mock python-cryptography-doc 2021-03-24T12:01:31.893 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2021-03-24T12:01:31.894 INFO:teuthology.orchestra.run.smithi043.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2021-03-24T12:01:31.894 INFO:teuthology.orchestra.run.smithi043.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2021-03-24T12:01:31.896 INFO:teuthology.orchestra.run.smithi043.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2021-03-24T12:01:31.897 INFO:teuthology.orchestra.run.smithi043.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2021-03-24T12:01:31.897 INFO:teuthology.orchestra.run.smithi043.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2021-03-24T12:01:31.897 INFO:teuthology.orchestra.run.smithi043.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2021-03-24T12:01:31.897 INFO:teuthology.orchestra.run.smithi043.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2021-03-24T12:01:31.898 INFO:teuthology.orchestra.run.smithi043.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2021-03-24T12:01:31.898 INFO:teuthology.orchestra.run.smithi043.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2021-03-24T12:01:31.898 INFO:teuthology.orchestra.run.smithi043.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2021-03-24T12:01:31.898 INFO:teuthology.orchestra.run.smithi043.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2021-03-24T12:01:31.899 INFO:teuthology.orchestra.run.smithi043.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2021-03-24T12:01:31.972 INFO:teuthology.orchestra.run.smithi161.stdout:2 upgraded, 111 newly installed, 0 to remove and 27 not upgraded. 2021-03-24T12:01:32.338 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 156 MB of archives. 2021-03-24T12:01:32.338 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 725 MB of additional disk space will be used. 2021-03-24T12:01:32.338 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.10-72-g13f4488c-1bionic [1,639 kB] 2021-03-24T12:01:32.340 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2021-03-24T12:01:32.340 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-03-24T12:01:32.341 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.10-72-g13f4488c-1bionic [3,061 kB] 2021-03-24T12:01:32.342 INFO:teuthology.orchestra.run.smithi043.stdout:The following NEW packages will be installed: 2021-03-24T12:01:32.342 INFO:teuthology.orchestra.run.smithi043.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-03-24T12:01:32.343 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-03-24T12:01:32.343 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-03-24T12:01:32.343 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev 2021-03-24T12:01:32.343 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2021-03-24T12:01:32.344 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 nvme-cli 2021-03-24T12:01:32.344 INFO:teuthology.orchestra.run.smithi043.stdout: python-attr python-funcsigs python-pastedeploy-tpl python-pluggy python-py 2021-03-24T12:01:32.344 INFO:teuthology.orchestra.run.smithi043.stdout: python-pytest python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2021-03-24T12:01:32.344 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs 2021-03-24T12:01:32.345 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi-backend python3-cherrypy3 python3-cryptography python3-cycler 2021-03-24T12:01:32.345 INFO:teuthology.orchestra.run.smithi043.stdout: python3-dateutil python3-decorator python3-fasteners python3-html5lib 2021-03-24T12:01:32.345 INFO:teuthology.orchestra.run.smithi043.stdout: python3-httplib2 python3-jinja2 python3-joblib python3-json-pointer 2021-03-24T12:01:32.346 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch python3-jwt python3-kubernetes python3-logutils 2021-03-24T12:01:32.346 INFO:teuthology.orchestra.run.smithi043.stdout: python3-lxml python3-mako python3-markupsafe python3-matplotlib 2021-03-24T12:01:32.346 INFO:teuthology.orchestra.run.smithi043.stdout: python3-monotonic python3-numpy python3-oauth2client python3-olefile 2021-03-24T12:01:32.346 INFO:teuthology.orchestra.run.smithi043.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2021-03-24T12:01:32.347 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan python3-pil python3-pluggy python3-prettytable python3-py 2021-03-24T12:01:32.347 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing 2021-03-24T12:01:32.347 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2021-03-24T12:01:32.347 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2021-03-24T12:01:32.348 INFO:teuthology.orchestra.run.smithi043.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-03-24T12:01:32.348 INFO:teuthology.orchestra.run.smithi043.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2021-03-24T12:01:32.348 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2021-03-24T12:01:32.348 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2021-03-24T12:01:32.348 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-03-24T12:01:32.349 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages will be upgraded: 2021-03-24T12:01:32.349 INFO:teuthology.orchestra.run.smithi043.stdout: librados2 librbd1 2021-03-24T12:01:32.349 INFO:teuthology.orchestra.run.smithi043.stdout:2 upgraded, 111 newly installed, 0 to remove and 27 not upgraded. 2021-03-24T12:01:32.349 INFO:teuthology.orchestra.run.smithi043.stdout:Need to get 156 MB of archives. 2021-03-24T12:01:32.350 INFO:teuthology.orchestra.run.smithi043.stdout:After this operation, 725 MB of additional disk space will be used. 2021-03-24T12:01:32.350 INFO:teuthology.orchestra.run.smithi043.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.10-72-g13f4488c-1bionic [1,639 kB] 2021-03-24T12:01:32.350 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2021-03-24T12:01:32.351 INFO:teuthology.orchestra.run.smithi043.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.10-72-g13f4488c-1bionic [3,061 kB] 2021-03-24T12:01:32.351 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.10-72-g13f4488c-1bionic [436 kB] 2021-03-24T12:01:32.368 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2021-03-24T12:01:32.368 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.10-72-g13f4488c-1bionic [345 kB] 2021-03-24T12:01:32.381 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-03-24T12:01:32.388 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.10-72-g13f4488c-1bionic [20.7 kB] 2021-03-24T12:01:32.389 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.10-72-g13f4488c-1bionic [133 kB] 2021-03-24T12:01:32.389 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2021-03-24T12:01:32.390 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.10-72-g13f4488c-1bionic [29.1 kB] 2021-03-24T12:01:32.391 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.10-72-g13f4488c-1bionic [326 kB] 2021-03-24T12:01:32.413 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.10-72-g13f4488c-1bionic [2,902 kB] 2021-03-24T12:01:32.424 INFO:teuthology.orchestra.run.smithi043.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-03-24T12:01:32.499 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-03-24T12:01:32.513 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-03-24T12:01:32.541 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-03-24T12:01:32.545 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2021-03-24T12:01:32.553 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2021-03-24T12:01:32.564 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2021-03-24T12:01:32.568 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.10-72-g13f4488c-1bionic [99.7 kB] 2021-03-24T12:01:32.573 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.4 [220 kB] 2021-03-24T12:01:32.582 INFO:teuthology.orchestra.run.smithi043.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.10-72-g13f4488c-1bionic [436 kB] 2021-03-24T12:01:32.585 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.10-72-g13f4488c-1bionic [338 kB] 2021-03-24T12:01:32.596 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.10-72-g13f4488c-1bionic [18.8 MB] 2021-03-24T12:01:32.603 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2021-03-24T12:01:32.607 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2021-03-24T12:01:32.610 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2021-03-24T12:01:32.617 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.10-72-g13f4488c-1bionic [345 kB] 2021-03-24T12:01:32.625 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2021-03-24T12:01:32.651 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.10-72-g13f4488c-1bionic [20.7 kB] 2021-03-24T12:01:32.652 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.10-72-g13f4488c-1bionic [133 kB] 2021-03-24T12:01:32.657 INFO:teuthology.orchestra.run.smithi043.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.10-72-g13f4488c-1bionic [29.1 kB] 2021-03-24T12:01:32.658 INFO:teuthology.orchestra.run.smithi043.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.10-72-g13f4488c-1bionic [326 kB] 2021-03-24T12:01:32.692 INFO:teuthology.orchestra.run.smithi043.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.10-72-g13f4488c-1bionic [2,902 kB] 2021-03-24T12:01:32.693 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2021-03-24T12:01:32.694 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2021-03-24T12:01:32.694 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2021-03-24T12:01:32.695 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2021-03-24T12:01:32.696 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2021-03-24T12:01:32.697 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-03-24T12:01:32.698 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2021-03-24T12:01:32.771 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2021-03-24T12:01:32.772 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2021-03-24T12:01:32.773 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-03-24T12:01:32.849 INFO:teuthology.orchestra.run.smithi043.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2021-03-24T12:01:32.851 INFO:teuthology.orchestra.run.smithi043.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-03-24T12:01:32.852 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-03-24T12:01:32.852 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2021-03-24T12:01:32.852 INFO:teuthology.orchestra.run.smithi161.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2021-03-24T12:01:32.852 INFO:teuthology.orchestra.run.smithi161.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2021-03-24T12:01:32.855 INFO:teuthology.orchestra.run.smithi161.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-03-24T12:01:32.863 INFO:teuthology.orchestra.run.smithi161.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2021-03-24T12:01:32.867 INFO:teuthology.orchestra.run.smithi161.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2021-03-24T12:01:32.889 INFO:teuthology.orchestra.run.smithi043.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2021-03-24T12:01:32.922 INFO:teuthology.orchestra.run.smithi043.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.10-72-g13f4488c-1bionic [99.7 kB] 2021-03-24T12:01:32.925 INFO:teuthology.orchestra.run.smithi043.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.10-72-g13f4488c-1bionic [338 kB] 2021-03-24T12:01:32.929 INFO:teuthology.orchestra.run.smithi161.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2021-03-24T12:01:32.930 INFO:teuthology.orchestra.run.smithi161.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2021-03-24T12:01:32.968 INFO:teuthology.orchestra.run.smithi043.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.10-72-g13f4488c-1bionic [18.8 MB] 2021-03-24T12:01:33.014 INFO:teuthology.orchestra.run.smithi161.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2021-03-24T12:01:33.014 INFO:teuthology.orchestra.run.smithi161.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2021-03-24T12:01:33.143 INFO:teuthology.orchestra.run.smithi043.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-03-24T12:01:33.145 INFO:teuthology.orchestra.run.smithi043.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-03-24T12:01:33.197 INFO:teuthology.orchestra.run.smithi043.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-03-24T12:01:33.206 INFO:teuthology.orchestra.run.smithi043.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2021-03-24T12:01:33.216 INFO:teuthology.orchestra.run.smithi043.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2021-03-24T12:01:33.229 INFO:teuthology.orchestra.run.smithi043.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2021-03-24T12:01:33.236 INFO:teuthology.orchestra.run.smithi043.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.4 [220 kB] 2021-03-24T12:01:33.276 INFO:teuthology.orchestra.run.smithi043.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2021-03-24T12:01:33.279 INFO:teuthology.orchestra.run.smithi043.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2021-03-24T12:01:33.281 INFO:teuthology.orchestra.run.smithi043.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2021-03-24T12:01:33.305 INFO:teuthology.orchestra.run.smithi043.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2021-03-24T12:01:33.306 INFO:teuthology.orchestra.run.smithi043.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2021-03-24T12:01:33.306 INFO:teuthology.orchestra.run.smithi161.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2021-03-24T12:01:33.307 INFO:teuthology.orchestra.run.smithi043.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2021-03-24T12:01:33.309 INFO:teuthology.orchestra.run.smithi043.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2021-03-24T12:01:33.333 INFO:teuthology.orchestra.run.smithi161.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2021-03-24T12:01:33.333 INFO:teuthology.orchestra.run.smithi161.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2021-03-24T12:01:33.383 INFO:teuthology.orchestra.run.smithi161.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2021-03-24T12:01:33.384 INFO:teuthology.orchestra.run.smithi161.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2021-03-24T12:01:33.384 INFO:teuthology.orchestra.run.smithi161.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.3 [28.8 kB] 2021-03-24T12:01:33.385 INFO:teuthology.orchestra.run.smithi161.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2021-03-24T12:01:33.385 INFO:teuthology.orchestra.run.smithi161.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2021-03-24T12:01:33.385 INFO:teuthology.orchestra.run.smithi161.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2021-03-24T12:01:33.386 INFO:teuthology.orchestra.run.smithi043.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2021-03-24T12:01:33.386 INFO:teuthology.orchestra.run.smithi043.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2021-03-24T12:01:33.387 INFO:teuthology.orchestra.run.smithi043.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-03-24T12:01:33.387 INFO:teuthology.orchestra.run.smithi161.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2021-03-24T12:01:33.389 INFO:teuthology.orchestra.run.smithi043.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2021-03-24T12:01:33.391 INFO:teuthology.orchestra.run.smithi043.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2021-03-24T12:01:33.394 INFO:teuthology.orchestra.run.smithi043.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2021-03-24T12:01:33.465 INFO:teuthology.orchestra.run.smithi043.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-03-24T12:01:33.466 INFO:teuthology.orchestra.run.smithi161.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2021-03-24T12:01:33.468 INFO:teuthology.orchestra.run.smithi161.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2021-03-24T12:01:33.476 INFO:teuthology.orchestra.run.smithi161.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-03-24T12:01:33.487 INFO:teuthology.orchestra.run.smithi161.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-03-24T12:01:33.489 INFO:teuthology.orchestra.run.smithi161.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2021-03-24T12:01:33.490 INFO:teuthology.orchestra.run.smithi161.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2021-03-24T12:01:33.490 INFO:teuthology.orchestra.run.smithi161.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-03-24T12:01:33.491 INFO:teuthology.orchestra.run.smithi161.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-03-24T12:01:33.492 INFO:teuthology.orchestra.run.smithi161.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-03-24T12:01:33.547 INFO:teuthology.orchestra.run.smithi161.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-03-24T12:01:33.573 INFO:teuthology.orchestra.run.smithi161.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-03-24T12:01:33.577 INFO:teuthology.orchestra.run.smithi161.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-03-24T12:01:33.584 INFO:teuthology.orchestra.run.smithi161.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-03-24T12:01:33.586 INFO:teuthology.orchestra.run.smithi161.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-03-24T12:01:33.587 INFO:teuthology.orchestra.run.smithi161.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-03-24T12:01:33.587 INFO:teuthology.orchestra.run.smithi161.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-03-24T12:01:33.588 INFO:teuthology.orchestra.run.smithi161.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-03-24T12:01:33.588 INFO:teuthology.orchestra.run.smithi161.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-03-24T12:01:33.589 INFO:teuthology.orchestra.run.smithi043.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-03-24T12:01:33.590 INFO:teuthology.orchestra.run.smithi043.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2021-03-24T12:01:33.591 INFO:teuthology.orchestra.run.smithi043.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2021-03-24T12:01:33.593 INFO:teuthology.orchestra.run.smithi043.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2021-03-24T12:01:33.596 INFO:teuthology.orchestra.run.smithi043.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-03-24T12:01:33.627 INFO:teuthology.orchestra.run.smithi161.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2021-03-24T12:01:33.671 INFO:teuthology.orchestra.run.smithi161.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2021-03-24T12:01:33.671 INFO:teuthology.orchestra.run.smithi161.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2021-03-24T12:01:33.672 INFO:teuthology.orchestra.run.smithi161.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2021-03-24T12:01:33.676 INFO:teuthology.orchestra.run.smithi161.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.3 [1,097 kB] 2021-03-24T12:01:33.686 INFO:teuthology.orchestra.run.smithi043.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2021-03-24T12:01:33.689 INFO:teuthology.orchestra.run.smithi043.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2021-03-24T12:01:33.689 INFO:teuthology.orchestra.run.smithi043.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2021-03-24T12:01:33.690 INFO:teuthology.orchestra.run.smithi043.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2021-03-24T12:01:33.692 INFO:teuthology.orchestra.run.smithi161.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.10-72-g13f4488c-1bionic [5,175 kB] 2021-03-24T12:01:33.704 INFO:teuthology.orchestra.run.smithi161.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-03-24T12:01:33.705 INFO:teuthology.orchestra.run.smithi161.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2021-03-24T12:01:33.706 INFO:teuthology.orchestra.run.smithi161.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2021-03-24T12:01:33.838 INFO:teuthology.orchestra.run.smithi161.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2021-03-24T12:01:33.838 INFO:teuthology.orchestra.run.smithi161.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2021-03-24T12:01:33.840 INFO:teuthology.orchestra.run.smithi161.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.5 [330 kB] 2021-03-24T12:01:33.846 INFO:teuthology.orchestra.run.smithi161.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2021-03-24T12:01:33.846 INFO:teuthology.orchestra.run.smithi161.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2021-03-24T12:01:33.847 INFO:teuthology.orchestra.run.smithi161.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2021-03-24T12:01:33.847 INFO:teuthology.orchestra.run.smithi161.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2021-03-24T12:01:33.848 INFO:teuthology.orchestra.run.smithi161.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2021-03-24T12:01:33.866 INFO:teuthology.orchestra.run.smithi161.stdout:Get:95 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2021-03-24T12:01:33.899 INFO:teuthology.orchestra.run.smithi161.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.10-72-g13f4488c-1bionic [161 kB] 2021-03-24T12:01:33.904 INFO:teuthology.orchestra.run.smithi161.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.10-72-g13f4488c-1bionic [1,284 kB] 2021-03-24T12:01:33.962 INFO:teuthology.orchestra.run.smithi043.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2021-03-24T12:01:33.962 INFO:teuthology.orchestra.run.smithi043.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2021-03-24T12:01:33.970 INFO:teuthology.orchestra.run.smithi161.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.10-72-g13f4488c-1bionic [5,944 kB] 2021-03-24T12:01:34.315 INFO:teuthology.orchestra.run.smithi161.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.10-72-g13f4488c-1bionic [22.8 MB] 2021-03-24T12:01:34.542 INFO:teuthology.orchestra.run.smithi043.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.10-72-g13f4488c-1bionic [5,175 kB] 2021-03-24T12:01:34.772 INFO:teuthology.orchestra.run.smithi043.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2021-03-24T12:01:34.840 INFO:teuthology.orchestra.run.smithi043.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2021-03-24T12:01:34.848 INFO:teuthology.orchestra.run.smithi043.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2021-03-24T12:01:34.928 INFO:teuthology.orchestra.run.smithi043.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2021-03-24T12:01:34.929 INFO:teuthology.orchestra.run.smithi043.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2021-03-24T12:01:34.930 INFO:teuthology.orchestra.run.smithi043.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.3 [28.8 kB] 2021-03-24T12:01:34.931 INFO:teuthology.orchestra.run.smithi043.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2021-03-24T12:01:34.933 INFO:teuthology.orchestra.run.smithi043.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2021-03-24T12:01:34.934 INFO:teuthology.orchestra.run.smithi043.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2021-03-24T12:01:34.935 INFO:teuthology.orchestra.run.smithi043.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2021-03-24T12:01:34.944 INFO:teuthology.orchestra.run.smithi043.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.10-72-g13f4488c-1bionic [161 kB] 2021-03-24T12:01:34.954 INFO:teuthology.orchestra.run.smithi043.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.10-72-g13f4488c-1bionic [1,284 kB] 2021-03-24T12:01:34.957 INFO:teuthology.orchestra.run.smithi043.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2021-03-24T12:01:34.958 INFO:teuthology.orchestra.run.smithi043.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2021-03-24T12:01:35.015 INFO:teuthology.orchestra.run.smithi043.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-03-24T12:01:35.017 INFO:teuthology.orchestra.run.smithi043.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-03-24T12:01:35.024 INFO:teuthology.orchestra.run.smithi043.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2021-03-24T12:01:35.025 INFO:teuthology.orchestra.run.smithi043.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2021-03-24T12:01:35.026 INFO:teuthology.orchestra.run.smithi043.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-03-24T12:01:35.072 INFO:teuthology.orchestra.run.smithi043.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.10-72-g13f4488c-1bionic [5,944 kB] 2021-03-24T12:01:35.095 INFO:teuthology.orchestra.run.smithi043.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-03-24T12:01:35.223 INFO:teuthology.orchestra.run.smithi043.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-03-24T12:01:35.223 INFO:teuthology.orchestra.run.smithi043.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-03-24T12:01:35.224 INFO:teuthology.orchestra.run.smithi043.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-03-24T12:01:35.224 INFO:teuthology.orchestra.run.smithi043.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-03-24T12:01:35.225 INFO:teuthology.orchestra.run.smithi043.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-03-24T12:01:35.225 INFO:teuthology.orchestra.run.smithi043.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-03-24T12:01:35.225 INFO:teuthology.orchestra.run.smithi043.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-03-24T12:01:35.226 INFO:teuthology.orchestra.run.smithi043.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-03-24T12:01:35.226 INFO:teuthology.orchestra.run.smithi043.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-03-24T12:01:35.255 INFO:teuthology.orchestra.run.smithi043.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-03-24T12:01:35.260 INFO:teuthology.orchestra.run.smithi043.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2021-03-24T12:01:35.261 INFO:teuthology.orchestra.run.smithi043.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2021-03-24T12:01:35.262 INFO:teuthology.orchestra.run.smithi043.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2021-03-24T12:01:35.263 INFO:teuthology.orchestra.run.smithi043.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2021-03-24T12:01:35.335 INFO:teuthology.orchestra.run.smithi043.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.3 [1,097 kB] 2021-03-24T12:01:35.379 INFO:teuthology.orchestra.run.smithi043.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-03-24T12:01:35.381 INFO:teuthology.orchestra.run.smithi043.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2021-03-24T12:01:35.383 INFO:teuthology.orchestra.run.smithi043.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2021-03-24T12:01:35.494 INFO:teuthology.orchestra.run.smithi043.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2021-03-24T12:01:35.494 INFO:teuthology.orchestra.run.smithi043.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2021-03-24T12:01:35.496 INFO:teuthology.orchestra.run.smithi043.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.5 [330 kB] 2021-03-24T12:01:35.509 INFO:teuthology.orchestra.run.smithi043.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2021-03-24T12:01:35.510 INFO:teuthology.orchestra.run.smithi043.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2021-03-24T12:01:35.511 INFO:teuthology.orchestra.run.smithi043.stdout:Get:95 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2021-03-24T12:01:35.512 INFO:teuthology.orchestra.run.smithi043.stdout:Get:96 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2021-03-24T12:01:35.517 INFO:teuthology.orchestra.run.smithi043.stdout:Get:97 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2021-03-24T12:01:35.517 INFO:teuthology.orchestra.run.smithi043.stdout:Get:98 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2021-03-24T12:01:35.551 INFO:teuthology.orchestra.run.smithi161.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.10-72-g13f4488c-1bionic [3,948 B] 2021-03-24T12:01:35.551 INFO:teuthology.orchestra.run.smithi161.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.10-72-g13f4488c-1bionic [516 kB] 2021-03-24T12:01:35.555 INFO:teuthology.orchestra.run.smithi043.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.10-72-g13f4488c-1bionic [22.8 MB] 2021-03-24T12:01:35.593 INFO:teuthology.orchestra.run.smithi161.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.10-72-g13f4488c-1bionic [1,853 kB] 2021-03-24T12:01:35.683 INFO:teuthology.orchestra.run.smithi161.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.10-72-g13f4488c-1bionic [52.3 kB] 2021-03-24T12:01:35.684 INFO:teuthology.orchestra.run.smithi161.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.10-72-g13f4488c-1bionic [58.0 kB] 2021-03-24T12:01:35.685 INFO:teuthology.orchestra.run.smithi161.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.10-72-g13f4488c-1bionic [3,197 kB] 2021-03-24T12:01:35.879 INFO:teuthology.orchestra.run.smithi161.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.10-72-g13f4488c-1bionic [34.3 kB] 2021-03-24T12:01:35.880 INFO:teuthology.orchestra.run.smithi161.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.10-72-g13f4488c-1bionic [7,869 kB] 2021-03-24T12:01:36.318 INFO:teuthology.orchestra.run.smithi161.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.10-72-g13f4488c-1bionic [4,064 B] 2021-03-24T12:01:36.318 INFO:teuthology.orchestra.run.smithi161.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.10-72-g13f4488c-1bionic [22.5 kB] 2021-03-24T12:01:36.319 INFO:teuthology.orchestra.run.smithi161.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.10-72-g13f4488c-1bionic [44.1 MB] 2021-03-24T12:01:37.378 INFO:teuthology.orchestra.run.smithi043.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.10-72-g13f4488c-1bionic [3,948 B] 2021-03-24T12:01:37.378 INFO:teuthology.orchestra.run.smithi043.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.10-72-g13f4488c-1bionic [516 kB] 2021-03-24T12:01:37.436 INFO:teuthology.orchestra.run.smithi043.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.10-72-g13f4488c-1bionic [1,853 kB] 2021-03-24T12:01:37.589 INFO:teuthology.orchestra.run.smithi043.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.10-72-g13f4488c-1bionic [52.3 kB] 2021-03-24T12:01:37.591 INFO:teuthology.orchestra.run.smithi043.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.10-72-g13f4488c-1bionic [58.0 kB] 2021-03-24T12:01:37.593 INFO:teuthology.orchestra.run.smithi043.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.10-72-g13f4488c-1bionic [3,197 kB] 2021-03-24T12:01:37.839 INFO:teuthology.orchestra.run.smithi043.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.10-72-g13f4488c-1bionic [34.3 kB] 2021-03-24T12:01:37.840 INFO:teuthology.orchestra.run.smithi043.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.10-72-g13f4488c-1bionic [7,869 kB] 2021-03-24T12:01:38.381 INFO:teuthology.orchestra.run.smithi043.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.10-72-g13f4488c-1bionic [4,064 B] 2021-03-24T12:01:38.382 INFO:teuthology.orchestra.run.smithi043.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.10-72-g13f4488c-1bionic [22.5 kB] 2021-03-24T12:01:38.383 INFO:teuthology.orchestra.run.smithi043.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.10-72-g13f4488c-1bionic [44.1 MB] 2021-03-24T12:01:38.885 INFO:teuthology.orchestra.run.smithi161.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.10-72-g13f4488c-1bionic [18.0 kB] 2021-03-24T12:01:38.886 INFO:teuthology.orchestra.run.smithi161.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.10-72-g13f4488c-1bionic [8,881 kB] 2021-03-24T12:01:39.432 INFO:teuthology.orchestra.run.smithi161.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.10-72-g13f4488c-1bionic [63.1 kB] 2021-03-24T12:01:40.141 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 156 MB in 8s (20.6 MB/s) 2021-03-24T12:01:40.291 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-uritemplate. 2021-03-24T12:01:40.344 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137597 files and directories currently installed.) 2021-03-24T12:01:40.348 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../000-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2021-03-24T12:01:40.381 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2021-03-24T12:01:40.382 INFO:teuthology.orchestra.run.smithi043.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.10-72-g13f4488c-1bionic [18.0 kB] 2021-03-24T12:01:40.383 INFO:teuthology.orchestra.run.smithi043.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.10-72-g13f4488c-1bionic [8,881 kB] 2021-03-24T12:01:40.669 INFO:teuthology.orchestra.run.smithi043.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.10-72-g13f4488c-1bionic [63.1 kB] 2021-03-24T12:01:40.692 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-03-24T12:01:40.706 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../001-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-03-24T12:01:40.792 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-03-24T12:01:41.142 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../002-librbd1_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:41.287 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librbd1 (15.2.10-72-g13f4488c-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-03-24T12:01:41.406 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 156 MB in 9s (18.1 MB/s) 2021-03-24T12:01:41.559 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-uritemplate. 2021-03-24T12:01:41.610 INFO:teuthology.orchestra.run.smithi043.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137597 files and directories currently installed.) 2021-03-24T12:01:41.614 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../000-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2021-03-24T12:01:41.658 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2021-03-24T12:01:41.831 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../003-librados2_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:41.963 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-03-24T12:01:41.976 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../001-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-03-24T12:01:42.015 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librados2 (15.2.10-72-g13f4488c-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-03-24T12:01:42.045 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-03-24T12:01:42.453 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../002-librbd1_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:42.573 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking librbd1 (15.2.10-72-g13f4488c-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-03-24T12:01:42.662 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs2. 2021-03-24T12:01:42.994 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../004-libcephfs2_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:42.994 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs2 (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:43.039 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rados. 2021-03-24T12:01:43.054 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../005-python3-rados_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:43.096 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rados (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:43.107 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../003-librados2_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:43.235 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking librados2 (15.2.10-72-g13f4488c-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-03-24T12:01:43.466 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-03-24T12:01:43.481 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../006-python3-ceph-argparse_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:01:43.525 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-argparse (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:43.819 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cephfs. 2021-03-24T12:01:43.879 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libcephfs2. 2021-03-24T12:01:43.880 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../004-libcephfs2_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:43.880 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../007-python3-cephfs_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:43.881 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cephfs (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:43.906 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libcephfs2 (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:44.204 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-common. 2021-03-24T12:01:44.218 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../008-python3-ceph-common_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:01:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-rados. 2021-03-24T12:01:44.255 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-common (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:44.265 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../005-python3-rados_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:44.308 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-rados (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:44.607 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-prettytable. 2021-03-24T12:01:44.623 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../009-python3-prettytable_0.7.2-3_all.deb ... 2021-03-24T12:01:44.666 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2021-03-24T12:01:44.669 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-03-24T12:01:44.682 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../006-python3-ceph-argparse_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:01:44.719 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-ceph-argparse (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:44.918 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rbd. 2021-03-24T12:01:44.933 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../010-python3-rbd_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:44.976 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rbd (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:45.014 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cephfs. 2021-03-24T12:01:45.034 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../007-python3-cephfs_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:45.063 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cephfs (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:45.332 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-ceph-common. 2021-03-24T12:01:45.346 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../008-python3-ceph-common_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:01:45.371 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-03-24T12:01:45.374 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-ceph-common (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:45.385 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../011-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-03-24T12:01:45.429 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-03-24T12:01:45.685 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-prettytable. 2021-03-24T12:01:45.700 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../009-python3-prettytable_0.7.2-3_all.deb ... 2021-03-24T12:01:45.873 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2021-03-24T12:01:45.873 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-03-24T12:01:45.874 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../012-librdkafka1_0.11.3-1build1_amd64.deb ... 2021-03-24T12:01:45.874 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2021-03-24T12:01:46.129 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-rbd. 2021-03-24T12:01:46.144 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../010-python3-rbd_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:46.159 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librgw2. 2021-03-24T12:01:46.175 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../013-librgw2_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:46.188 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-rbd (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:46.217 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librgw2 (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:46.557 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-03-24T12:01:46.577 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../011-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-03-24T12:01:46.607 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-03-24T12:01:46.728 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rgw. 2021-03-24T12:01:46.837 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../014-python3-rgw_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:46.838 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rgw (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:46.876 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-03-24T12:01:46.890 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../012-librdkafka1_0.11.3-1build1_amd64.deb ... 2021-03-24T12:01:46.943 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2021-03-24T12:01:47.105 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-03-24T12:01:47.120 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../015-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-03-24T12:01:47.164 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-03-24T12:01:47.262 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package librgw2. 2021-03-24T12:01:47.278 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../013-librgw2_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:47.321 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking librgw2 (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:47.500 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-03-24T12:01:47.514 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../016-libleveldb1v5_1.20-2_amd64.deb ... 2021-03-24T12:01:47.558 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-03-24T12:01:47.848 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-rgw. 2021-03-24T12:01:47.862 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../014-python3-rgw_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:47.898 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-rgw (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:47.936 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liboath0. 2021-03-24T12:01:47.951 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../017-liboath0_2.6.1-1_amd64.deb ... 2021-03-24T12:01:47.995 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-03-24T12:01:48.183 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-03-24T12:01:48.199 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../015-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-03-24T12:01:48.250 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-03-24T12:01:48.331 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libradosstriper1. 2021-03-24T12:01:48.348 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../018-libradosstriper1_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:48.405 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libradosstriper1 (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:48.545 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-03-24T12:01:48.558 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../016-libleveldb1v5_1.20-2_amd64.deb ... 2021-03-24T12:01:48.603 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-03-24T12:01:48.850 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-common. 2021-03-24T12:01:48.864 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../019-ceph-common_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:48.908 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-common (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:48.972 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package liboath0. 2021-03-24T12:01:48.988 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../017-liboath0_2.6.1-1_amd64.deb ... 2021-03-24T12:01:49.031 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-03-24T12:01:49.342 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libradosstriper1. 2021-03-24T12:01:49.357 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../018-libradosstriper1_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:49.401 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libradosstriper1 (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:49.771 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-common. 2021-03-24T12:01:49.787 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../019-ceph-common_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:49.828 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-common (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:50.688 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-base. 2021-03-24T12:01:50.701 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../020-ceph-base_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:50.747 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-base (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:51.634 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-dateutil. 2021-03-24T12:01:51.650 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../021-python3-dateutil_2.6.1-1_all.deb ... 2021-03-24T12:01:51.691 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-base. 2021-03-24T12:01:51.693 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2021-03-24T12:01:51.706 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../020-ceph-base_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:01:51.759 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-base (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:52.053 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-asn1crypto. 2021-03-24T12:01:52.069 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../022-python3-asn1crypto_0.24.0-1_all.deb ... 2021-03-24T12:01:52.112 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2021-03-24T12:01:52.414 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cffi-backend. 2021-03-24T12:01:52.430 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../023-python3-cffi-backend_1.11.5-1_amd64.deb ... 2021-03-24T12:01:52.506 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2021-03-24T12:01:52.662 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-dateutil. 2021-03-24T12:01:52.675 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../021-python3-dateutil_2.6.1-1_all.deb ... 2021-03-24T12:01:52.714 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2021-03-24T12:01:52.825 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cryptography. 2021-03-24T12:01:52.840 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../024-python3-cryptography_2.1.4-1ubuntu1.4_amd64.deb ... 2021-03-24T12:01:52.892 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-03-24T12:01:53.023 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-asn1crypto. 2021-03-24T12:01:53.037 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../022-python3-asn1crypto_0.24.0-1_all.deb ... 2021-03-24T12:01:53.107 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2021-03-24T12:01:53.254 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-openssl. 2021-03-24T12:01:53.268 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../025-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2021-03-24T12:01:53.314 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2021-03-24T12:01:53.384 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cffi-backend. 2021-03-24T12:01:53.400 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../023-python3-cffi-backend_1.11.5-1_amd64.deb ... 2021-03-24T12:01:53.442 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2021-03-24T12:01:53.581 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-03-24T12:01:53.597 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../026-ceph-mgr-modules-core_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:01:53.639 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-modules-core (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:53.778 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cryptography. 2021-03-24T12:01:53.793 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../024-python3-cryptography_2.1.4-1ubuntu1.4_amd64.deb ... 2021-03-24T12:01:53.837 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-03-24T12:01:54.001 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-bcrypt. 2021-03-24T12:01:54.017 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../027-python3-bcrypt_3.1.4-2_amd64.deb ... 2021-03-24T12:01:54.060 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2021-03-24T12:01:54.273 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-openssl. 2021-03-24T12:01:54.288 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../025-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2021-03-24T12:01:54.332 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2021-03-24T12:01:54.362 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cherrypy3. 2021-03-24T12:01:54.378 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-2_all.deb ... 2021-03-24T12:01:54.420 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2021-03-24T12:01:54.584 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-03-24T12:01:54.598 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../026-ceph-mgr-modules-core_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:01:54.642 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-modules-core (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:01:54.782 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jwt. 2021-03-24T12:01:54.798 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../029-python3-jwt_1.5.3+ds1-1_all.deb ... 2021-03-24T12:01:54.840 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2021-03-24T12:01:55.038 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-bcrypt. 2021-03-24T12:01:55.053 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../027-python3-bcrypt_3.1.4-2_amd64.deb ... 2021-03-24T12:01:55.104 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2021-03-24T12:01:55.134 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-logutils. 2021-03-24T12:01:55.150 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-5_all.deb ... 2021-03-24T12:01:55.193 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-logutils (0.3.3-5) ... 2021-03-24T12:01:55.407 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cherrypy3. 2021-03-24T12:01:55.478 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-2_all.deb ... 2021-03-24T12:01:55.479 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2021-03-24T12:01:55.520 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-markupsafe. 2021-03-24T12:01:55.535 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../031-python3-markupsafe_1.0-1build1_amd64.deb ... 2021-03-24T12:01:55.587 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2021-03-24T12:01:55.819 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jwt. 2021-03-24T12:01:55.832 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../029-python3-jwt_1.5.3+ds1-1_all.deb ... 2021-03-24T12:01:55.868 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2021-03-24T12:01:55.906 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-mako. 2021-03-24T12:01:55.922 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../032-python3-mako_1.0.7+ds1-1_all.deb ... 2021-03-24T12:01:55.965 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2021-03-24T12:01:56.181 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-logutils. 2021-03-24T12:01:56.194 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-5_all.deb ... 2021-03-24T12:01:56.238 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-logutils (0.3.3-5) ... 2021-03-24T12:01:56.292 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplegeneric. 2021-03-24T12:01:56.308 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-1_all.deb ... 2021-03-24T12:01:56.351 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2021-03-24T12:01:56.532 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-markupsafe. 2021-03-24T12:01:56.547 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../031-python3-markupsafe_1.0-1build1_amd64.deb ... 2021-03-24T12:01:56.591 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2021-03-24T12:01:56.678 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-singledispatch. 2021-03-24T12:01:56.694 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2_all.deb ... 2021-03-24T12:01:56.736 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2021-03-24T12:01:56.893 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-mako. 2021-03-24T12:01:56.907 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../032-python3-mako_1.0.7+ds1-1_all.deb ... 2021-03-24T12:01:56.951 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2021-03-24T12:01:57.039 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webob. 2021-03-24T12:01:57.052 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../035-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-03-24T12:01:57.089 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2021-03-24T12:01:57.296 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-simplegeneric. 2021-03-24T12:01:57.361 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-1_all.deb ... 2021-03-24T12:01:57.362 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2021-03-24T12:01:57.551 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-bs4. 2021-03-24T12:01:57.566 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../036-python3-bs4_4.6.0-1_all.deb ... 2021-03-24T12:01:57.625 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2021-03-24T12:01:57.665 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-singledispatch. 2021-03-24T12:01:57.679 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2_all.deb ... 2021-03-24T12:01:57.723 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2021-03-24T12:01:57.927 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-waitress. 2021-03-24T12:01:57.941 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../037-python3-waitress_1.0.1-1_all.deb ... 2021-03-24T12:01:57.978 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-waitress (1.0.1-1) ... 2021-03-24T12:01:58.009 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-webob. 2021-03-24T12:01:58.024 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../035-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-03-24T12:01:58.059 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2021-03-24T12:01:58.305 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tempita. 2021-03-24T12:01:58.321 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../038-python3-tempita_0.5.2-2_all.deb ... 2021-03-24T12:01:58.363 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-bs4. 2021-03-24T12:01:58.372 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tempita (0.5.2-2) ... 2021-03-24T12:01:58.377 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../036-python3-bs4_4.6.0-1_all.deb ... 2021-03-24T12:01:58.420 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2021-03-24T12:01:58.691 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-paste. 2021-03-24T12:01:58.707 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../039-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-03-24T12:01:58.739 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-waitress. 2021-03-24T12:01:58.750 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-03-24T12:01:58.753 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../037-python3-waitress_1.0.1-1_all.deb ... 2021-03-24T12:01:58.798 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-waitress (1.0.1-1) ... 2021-03-24T12:01:59.070 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-03-24T12:01:59.082 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../040-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-03-24T12:01:59.117 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-tempita. 2021-03-24T12:01:59.121 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-03-24T12:01:59.131 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../038-python3-tempita_0.5.2-2_all.deb ... 2021-03-24T12:01:59.167 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-tempita (0.5.2-2) ... 2021-03-24T12:01:59.430 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastedeploy. 2021-03-24T12:01:59.446 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../041-python3-pastedeploy_1.5.2-4_all.deb ... 2021-03-24T12:01:59.470 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-paste. 2021-03-24T12:01:59.485 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../039-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-03-24T12:01:59.488 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2021-03-24T12:01:59.528 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-03-24T12:01:59.825 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webtest. 2021-03-24T12:01:59.839 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../042-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2021-03-24T12:01:59.865 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-03-24T12:01:59.879 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../040-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-03-24T12:01:59.883 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2021-03-24T12:01:59.923 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-03-24T12:02:00.210 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pecan. 2021-03-24T12:02:00.226 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../043-python3-pecan_1.2.1-2_all.deb ... 2021-03-24T12:02:00.242 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pastedeploy. 2021-03-24T12:02:00.259 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../041-python3-pastedeploy_1.5.2-4_all.deb ... 2021-03-24T12:02:00.271 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pecan (1.2.1-2) ... 2021-03-24T12:02:00.300 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2021-03-24T12:02:00.586 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-webtest. 2021-03-24T12:02:00.603 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../042-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2021-03-24T12:02:00.614 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-werkzeug. 2021-03-24T12:02:00.630 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../044-python3-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-03-24T12:02:00.644 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2021-03-24T12:02:00.697 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-03-24T12:02:00.989 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pecan. 2021-03-24T12:02:01.002 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../043-python3-pecan_1.2.1-2_all.deb ... 2021-03-24T12:02:01.039 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pecan (1.2.1-2) ... 2021-03-24T12:02:01.070 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr. 2021-03-24T12:02:01.083 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../045-ceph-mgr_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:01.127 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:01.418 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-werkzeug. 2021-03-24T12:02:01.431 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../044-python3-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-03-24T12:02:01.468 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-03-24T12:02:01.578 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mon. 2021-03-24T12:02:01.594 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../046-ceph-mon_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:01.636 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mon (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:01.838 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr. 2021-03-24T12:02:01.853 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../045-ceph-mgr_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:01.896 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:02.482 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mon. 2021-03-24T12:02:02.497 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../046-ceph-mon_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:02.716 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mon (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:03.215 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-osd. 2021-03-24T12:02:03.231 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../047-ceph-osd_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:03.273 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-osd (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:03.844 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-osd. 2021-03-24T12:02:03.859 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../047-ceph-osd_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:03.902 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-osd (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:05.212 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph. 2021-03-24T12:02:05.227 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../048-ceph_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:05.272 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:05.607 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-fuse. 2021-03-24T12:02:05.622 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../049-ceph-fuse_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:05.665 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-fuse (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:05.839 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph. 2021-03-24T12:02:05.855 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../048-ceph_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:05.907 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:06.068 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mds. 2021-03-24T12:02:06.083 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../050-ceph-mds_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:06.126 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mds (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:06.233 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-fuse. 2021-03-24T12:02:06.248 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../049-ceph-fuse_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:06.295 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-fuse (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:06.596 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephadm. 2021-03-24T12:02:06.609 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../051-cephadm_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:06.645 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephadm (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:06.687 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mds. 2021-03-24T12:02:06.703 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../050-ceph-mds_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:06.747 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mds (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:06.931 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jinja2. 2021-03-24T12:02:06.947 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../052-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2021-03-24T12:02:06.990 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-03-24T12:02:07.317 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-03-24T12:02:07.335 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../053-ceph-mgr-cephadm_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:02:07.356 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package cephadm. 2021-03-24T12:02:07.367 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-cephadm (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:07.370 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../051-cephadm_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:07.423 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking cephadm (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:07.662 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-repoze.lru. 2021-03-24T12:02:07.676 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../054-python3-repoze.lru_0.7-1_all.deb ... 2021-03-24T12:02:07.712 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2021-03-24T12:02:07.750 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jinja2. 2021-03-24T12:02:07.767 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../052-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2021-03-24T12:02:07.808 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-03-24T12:02:08.049 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-routes. 2021-03-24T12:02:08.065 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../055-python3-routes_2.4.1-1_all.deb ... 2021-03-24T12:02:08.179 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-routes (2.4.1-1) ... 2021-03-24T12:02:08.179 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-03-24T12:02:08.180 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../053-ceph-mgr-cephadm_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:02:08.195 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-cephadm (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:08.443 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-03-24T12:02:08.458 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:02:08.492 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-dashboard (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:08.506 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-repoze.lru. 2021-03-24T12:02:08.522 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../054-python3-repoze.lru_0.7-1_all.deb ... 2021-03-24T12:02:08.564 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2021-03-24T12:02:08.880 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-routes. 2021-03-24T12:02:08.895 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../055-python3-routes_2.4.1-1_all.deb ... 2021-03-24T12:02:08.938 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-routes (2.4.1-1) ... 2021-03-24T12:02:09.265 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-03-24T12:02:09.280 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:02:09.323 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-dashboard (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:09.372 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-03-24T12:02:09.388 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../057-ceph-mgr-diskprediction-cloud_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:02:09.431 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:09.742 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-numpy. 2021-03-24T12:02:09.759 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../058-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2021-03-24T12:02:09.800 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2021-03-24T12:02:10.259 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-03-24T12:02:10.277 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../057-ceph-mgr-diskprediction-cloud_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:02:10.318 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:10.431 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-decorator. 2021-03-24T12:02:10.445 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../059-python3-decorator_4.1.2-1_all.deb ... 2021-03-24T12:02:10.497 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-decorator (4.1.2-1) ... 2021-03-24T12:02:10.671 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-numpy. 2021-03-24T12:02:10.687 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../058-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2021-03-24T12:02:10.742 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2021-03-24T12:02:10.801 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-scipy. 2021-03-24T12:02:10.815 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../060-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-03-24T12:02:10.858 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2021-03-24T12:02:11.348 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-decorator. 2021-03-24T12:02:11.362 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../059-python3-decorator_4.1.2-1_all.deb ... 2021-03-24T12:02:11.406 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-decorator (4.1.2-1) ... 2021-03-24T12:02:11.742 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-scipy. 2021-03-24T12:02:11.759 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../060-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-03-24T12:02:11.809 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2021-03-24T12:02:12.240 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-03-24T12:02:12.255 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../061-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2021-03-24T12:02:12.289 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2021-03-24T12:02:13.135 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-joblib. 2021-03-24T12:02:13.149 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../062-python3-joblib_0.11-1_all.deb ... 2021-03-24T12:02:13.214 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-joblib (0.11-1) ... 2021-03-24T12:02:13.471 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-03-24T12:02:13.487 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../061-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2021-03-24T12:02:13.529 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2021-03-24T12:02:13.546 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn. 2021-03-24T12:02:13.560 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../063-python3-sklearn_0.19.1-3_all.deb ... 2021-03-24T12:02:13.596 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2021-03-24T12:02:14.066 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-joblib. 2021-03-24T12:02:14.079 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../062-python3-joblib_0.11-1_all.deb ... 2021-03-24T12:02:14.132 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-joblib (0.11-1) ... 2021-03-24T12:02:14.154 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-03-24T12:02:14.169 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../064-ceph-mgr-diskprediction-local_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:02:14.211 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:14.485 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-sklearn. 2021-03-24T12:02:14.668 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../063-python3-sklearn_0.19.1-3_all.deb ... 2021-03-24T12:02:14.669 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2021-03-24T12:02:15.093 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-03-24T12:02:15.106 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../064-ceph-mgr-diskprediction-local_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:02:15.150 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:15.339 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-monotonic. 2021-03-24T12:02:15.356 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../065-python3-monotonic_1.1-2_all.deb ... 2021-03-24T12:02:15.408 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-monotonic (1.1-2) ... 2021-03-24T12:02:15.727 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-fasteners. 2021-03-24T12:02:15.741 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../066-python3-fasteners_0.12.0-3_all.deb ... 2021-03-24T12:02:15.785 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2021-03-24T12:02:16.088 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-httplib2. 2021-03-24T12:02:16.102 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../067-python3-httplib2_0.9.2+dfsg-1ubuntu0.3_all.deb ... 2021-03-24T12:02:16.146 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-03-24T12:02:16.286 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-monotonic. 2021-03-24T12:02:16.301 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../065-python3-monotonic_1.1-2_all.deb ... 2021-03-24T12:02:16.344 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-monotonic (1.1-2) ... 2021-03-24T12:02:16.466 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1. 2021-03-24T12:02:16.502 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../068-python3-pyasn1_0.4.2-3_all.deb ... 2021-03-24T12:02:16.524 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2021-03-24T12:02:16.662 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-fasteners. 2021-03-24T12:02:16.677 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../066-python3-fasteners_0.12.0-3_all.deb ... 2021-03-24T12:02:16.720 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2021-03-24T12:02:16.852 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-03-24T12:02:16.868 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../069-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-03-24T12:02:16.911 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2021-03-24T12:02:17.023 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-httplib2. 2021-03-24T12:02:17.038 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../067-python3-httplib2_0.9.2+dfsg-1ubuntu0.3_all.deb ... 2021-03-24T12:02:17.081 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-03-24T12:02:17.230 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rsa. 2021-03-24T12:02:17.252 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../070-python3-rsa_3.4.2-1_all.deb ... 2021-03-24T12:02:17.306 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rsa (3.4.2-1) ... 2021-03-24T12:02:17.384 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pyasn1. 2021-03-24T12:02:17.398 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../068-python3-pyasn1_0.4.2-3_all.deb ... 2021-03-24T12:02:17.442 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2021-03-24T12:02:17.633 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sqlalchemy. 2021-03-24T12:02:17.650 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../071-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-03-24T12:02:17.693 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-03-24T12:02:17.812 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-03-24T12:02:17.826 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../069-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-03-24T12:02:17.879 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2021-03-24T12:02:18.154 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-oauth2client. 2021-03-24T12:02:18.169 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../072-python3-oauth2client_4.1.2-3_all.deb ... 2021-03-24T12:02:18.212 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2021-03-24T12:02:18.227 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-rsa. 2021-03-24T12:02:18.240 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../070-python3-rsa_3.4.2-1_all.deb ... 2021-03-24T12:02:18.282 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-rsa (3.4.2-1) ... 2021-03-24T12:02:18.565 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-setuptools. 2021-03-24T12:02:18.580 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../073-python3-setuptools_39.0.1-2_all.deb ... 2021-03-24T12:02:18.623 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2021-03-24T12:02:18.635 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-sqlalchemy. 2021-03-24T12:02:18.650 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../071-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-03-24T12:02:18.693 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-03-24T12:02:19.052 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-websocket. 2021-03-24T12:02:19.151 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-oauth2client. 2021-03-24T12:02:19.151 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../072-python3-oauth2client_4.1.2-3_all.deb ... 2021-03-24T12:02:19.152 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../074-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2021-03-24T12:02:19.152 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2021-03-24T12:02:19.188 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2021-03-24T12:02:19.422 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-kubernetes. 2021-03-24T12:02:19.438 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../075-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-03-24T12:02:19.480 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2021-03-24T12:02:19.609 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-setuptools. 2021-03-24T12:02:19.625 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../073-python3-setuptools_39.0.1-2_all.deb ... 2021-03-24T12:02:19.667 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2021-03-24T12:02:19.893 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-03-24T12:02:19.908 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:02:19.951 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-k8sevents (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:20.071 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-websocket. 2021-03-24T12:02:20.085 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../074-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2021-03-24T12:02:20.129 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2021-03-24T12:02:20.303 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-json-pointer. 2021-03-24T12:02:20.318 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../077-python3-json-pointer_1.10-1_all.deb ... 2021-03-24T12:02:20.378 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-json-pointer (1.10-1) ... 2021-03-24T12:02:20.440 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-kubernetes. 2021-03-24T12:02:20.455 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../075-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-03-24T12:02:20.498 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2021-03-24T12:02:20.731 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jsonpatch. 2021-03-24T12:02:20.746 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../078-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2021-03-24T12:02:20.793 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-03-24T12:02:20.920 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-03-24T12:02:20.934 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:02:20.977 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-k8sevents (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:21.101 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-03-24T12:02:21.116 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../079-ceph-mgr-rook_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:02:21.159 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-rook (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:21.339 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-json-pointer. 2021-03-24T12:02:21.353 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../077-python3-json-pointer_1.10-1_all.deb ... 2021-03-24T12:02:21.397 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-json-pointer (1.10-1) ... 2021-03-24T12:02:21.520 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libonig4:amd64. 2021-03-24T12:02:21.535 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../080-libonig4_6.7.0-1_amd64.deb ... 2021-03-24T12:02:21.672 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-03-24T12:02:21.750 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jsonpatch. 2021-03-24T12:02:21.765 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../078-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2021-03-24T12:02:21.811 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-03-24T12:02:22.042 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjq1:amd64. 2021-03-24T12:02:22.057 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../081-libjq1_1.5+dfsg-2_amd64.deb ... 2021-03-24T12:02:22.100 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-03-24T12:02:22.111 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-03-24T12:02:22.127 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../079-ceph-mgr-rook_15.2.10-72-g13f4488c-1bionic_all.deb ... 2021-03-24T12:02:22.170 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-rook (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:22.378 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package jq. 2021-03-24T12:02:22.394 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../082-jq_1.5+dfsg-2_amd64.deb ... 2021-03-24T12:02:22.461 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-03-24T12:02:22.514 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libonig4:amd64. 2021-03-24T12:02:22.529 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../080-libonig4_6.7.0-1_amd64.deb ... 2021-03-24T12:02:22.657 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-03-24T12:02:22.734 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package socat. 2021-03-24T12:02:22.745 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../083-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-03-24T12:02:22.797 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-03-24T12:02:23.053 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libjq1:amd64. 2021-03-24T12:02:23.071 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../081-libjq1_1.5+dfsg-2_amd64.deb ... 2021-03-24T12:02:23.111 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-03-24T12:02:23.192 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-03-24T12:02:23.208 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../084-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-03-24T12:02:23.250 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-03-24T12:02:23.388 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package jq. 2021-03-24T12:02:23.404 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../082-jq_1.5+dfsg-2_amd64.deb ... 2021-03-24T12:02:23.446 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-03-24T12:02:23.528 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package xmlstarlet. 2021-03-24T12:02:23.542 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2_amd64.deb ... 2021-03-24T12:02:23.586 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-03-24T12:02:23.699 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package socat. 2021-03-24T12:02:23.714 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../083-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-03-24T12:02:23.757 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-03-24T12:02:23.932 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-test. 2021-03-24T12:02:23.948 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../086-ceph-test_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:23.990 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-test (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:24.128 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-03-24T12:02:24.143 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../084-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-03-24T12:02:24.178 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-03-24T12:02:24.430 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package xmlstarlet. 2021-03-24T12:02:24.446 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2_amd64.deb ... 2021-03-24T12:02:24.488 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-03-24T12:02:24.793 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-test. 2021-03-24T12:02:24.809 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../086-ceph-test_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:24.843 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-test (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:27.244 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs-dev. 2021-03-24T12:02:27.258 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../087-libcephfs-dev_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:27.302 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs-dev (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:27.596 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package nvme-cli. 2021-03-24T12:02:27.612 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../088-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-03-24T12:02:27.671 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-03-24T12:02:28.026 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-attr. 2021-03-24T12:02:28.091 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../089-python-attr_17.4.0-2_all.deb ... 2021-03-24T12:02:28.092 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-attr (17.4.0-2) ... 2021-03-24T12:02:28.196 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libcephfs-dev. 2021-03-24T12:02:28.212 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../087-libcephfs-dev_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:28.254 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libcephfs-dev (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:28.370 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-funcsigs. 2021-03-24T12:02:28.387 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../090-python-funcsigs_1.0.2-4_all.deb ... 2021-03-24T12:02:28.421 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-03-24T12:02:28.524 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package nvme-cli. 2021-03-24T12:02:28.541 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../088-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-03-24T12:02:28.582 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-03-24T12:02:28.741 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-pluggy. 2021-03-24T12:02:28.758 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../091-python-pluggy_0.6.0-1_all.deb ... 2021-03-24T12:02:28.798 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-03-24T12:02:28.892 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python-attr. 2021-03-24T12:02:28.892 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../089-python-attr_17.4.0-2_all.deb ... 2021-03-24T12:02:28.904 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python-attr (17.4.0-2) ... 2021-03-24T12:02:29.101 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-py. 2021-03-24T12:02:29.115 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../092-python-py_1.5.2-1_all.deb ... 2021-03-24T12:02:29.159 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-py (1.5.2-1) ... 2021-03-24T12:02:29.231 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python-funcsigs. 2021-03-24T12:02:29.246 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../090-python-funcsigs_1.0.2-4_all.deb ... 2021-03-24T12:02:29.289 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-03-24T12:02:29.496 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-pytest. 2021-03-24T12:02:29.512 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../093-python-pytest_3.3.2-2_all.deb ... 2021-03-24T12:02:29.555 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-03-24T12:02:29.567 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python-pluggy. 2021-03-24T12:02:29.582 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../091-python-pluggy_0.6.0-1_all.deb ... 2021-03-24T12:02:29.634 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-03-24T12:02:29.920 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python-py. 2021-03-24T12:02:29.935 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../092-python-py_1.5.2-1_all.deb ... 2021-03-24T12:02:29.941 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-attr. 2021-03-24T12:02:29.957 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../094-python3-attr_17.4.0-2_all.deb ... 2021-03-24T12:02:29.978 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python-py (1.5.2-1) ... 2021-03-24T12:02:30.008 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-attr (17.4.0-2) ... 2021-03-24T12:02:30.282 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python-pytest. 2021-03-24T12:02:30.294 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cycler. 2021-03-24T12:02:30.300 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../093-python-pytest_3.3.2-2_all.deb ... 2021-03-24T12:02:30.310 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../095-python3-cycler_0.10.0-1_all.deb ... 2021-03-24T12:02:30.341 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-03-24T12:02:30.352 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cycler (0.10.0-1) ... 2021-03-24T12:02:30.655 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webencodings. 2021-03-24T12:02:30.670 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../096-python3-webencodings_0.5-2_all.deb ... 2021-03-24T12:02:30.677 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-attr. 2021-03-24T12:02:30.694 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../094-python3-attr_17.4.0-2_all.deb ... 2021-03-24T12:02:30.735 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-attr (17.4.0-2) ... 2021-03-24T12:02:30.738 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webencodings (0.5-2) ... 2021-03-24T12:02:31.030 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cycler. 2021-03-24T12:02:31.041 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-html5lib. 2021-03-24T12:02:31.044 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../095-python3-cycler_0.10.0-1_all.deb ... 2021-03-24T12:02:31.059 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../097-python3-html5lib_0.999999999-1_all.deb ... 2021-03-24T12:02:31.088 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cycler (0.10.0-1) ... 2021-03-24T12:02:31.108 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2021-03-24T12:02:31.391 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-webencodings. 2021-03-24T12:02:31.406 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../096-python3-webencodings_0.5-2_all.deb ... 2021-03-24T12:02:31.450 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-webencodings (0.5-2) ... 2021-03-24T12:02:31.453 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-03-24T12:02:31.468 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../098-python3-lxml_4.2.1-1ubuntu0.3_amd64.deb ... 2021-03-24T12:02:31.511 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-03-24T12:02:31.752 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-html5lib. 2021-03-24T12:02:31.766 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../097-python3-html5lib_0.999999999-1_all.deb ... 2021-03-24T12:02:31.811 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2021-03-24T12:02:31.964 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyparsing. 2021-03-24T12:02:31.982 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../099-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-03-24T12:02:32.014 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-03-24T12:02:32.147 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-03-24T12:02:32.161 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../098-python3-lxml_4.2.1-1ubuntu0.3_amd64.deb ... 2021-03-24T12:02:32.205 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-03-24T12:02:32.342 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tz. 2021-03-24T12:02:32.357 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../100-python3-tz_2018.3-2_all.deb ... 2021-03-24T12:02:32.400 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tz (2018.3-2) ... 2021-03-24T12:02:32.625 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pyparsing. 2021-03-24T12:02:32.641 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../099-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-03-24T12:02:32.684 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-03-24T12:02:32.703 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-matplotlib. 2021-03-24T12:02:32.717 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../101-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2021-03-24T12:02:32.786 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2021-03-24T12:02:32.986 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-tz. 2021-03-24T12:02:33.001 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../100-python3-tz_2018.3-2_all.deb ... 2021-03-24T12:02:33.036 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-tz (2018.3-2) ... 2021-03-24T12:02:33.339 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-matplotlib. 2021-03-24T12:02:33.354 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../101-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2021-03-24T12:02:33.398 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2021-03-24T12:02:33.484 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-olefile. 2021-03-24T12:02:33.498 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../102-python3-olefile_0.45.1-1_all.deb ... 2021-03-24T12:02:33.542 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-olefile (0.45.1-1) ... 2021-03-24T12:02:33.878 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastescript. 2021-03-24T12:02:33.893 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-2_all.deb ... 2021-03-24T12:02:33.936 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2021-03-24T12:02:34.053 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-olefile. 2021-03-24T12:02:34.071 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../102-python3-olefile_0.45.1-1_all.deb ... 2021-03-24T12:02:34.111 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-olefile (0.45.1-1) ... 2021-03-24T12:02:34.256 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pil:amd64. 2021-03-24T12:02:34.272 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../104-python3-pil_5.1.0-1ubuntu0.5_amd64.deb ... 2021-03-24T12:02:34.315 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.5) ... 2021-03-24T12:02:34.405 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pastescript. 2021-03-24T12:02:34.422 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-2_all.deb ... 2021-03-24T12:02:34.464 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2021-03-24T12:02:34.676 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pluggy. 2021-03-24T12:02:34.692 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../105-python3-pluggy_0.6.0-1_all.deb ... 2021-03-24T12:02:34.735 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2021-03-24T12:02:34.817 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pil:amd64. 2021-03-24T12:02:34.831 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../104-python3-pil_5.1.0-1ubuntu0.5_amd64.deb ... 2021-03-24T12:02:34.875 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.5) ... 2021-03-24T12:02:35.062 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-py. 2021-03-24T12:02:35.077 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../106-python3-py_1.5.2-1_all.deb ... 2021-03-24T12:02:35.121 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-py (1.5.2-1) ... 2021-03-24T12:02:35.263 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pluggy. 2021-03-24T12:02:35.278 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../105-python3-pluggy_0.6.0-1_all.deb ... 2021-03-24T12:02:35.321 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2021-03-24T12:02:35.466 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyinotify. 2021-03-24T12:02:35.480 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1_all.deb ... 2021-03-24T12:02:35.524 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2021-03-24T12:02:35.648 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-py. 2021-03-24T12:02:35.663 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../106-python3-py_1.5.2-1_all.deb ... 2021-03-24T12:02:35.707 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-py (1.5.2-1) ... 2021-03-24T12:02:35.910 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pytest. 2021-03-24T12:02:35.927 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../108-python3-pytest_3.3.2-2_all.deb ... 2021-03-24T12:02:35.976 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pytest (3.3.2-2) ... 2021-03-24T12:02:36.043 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pyinotify. 2021-03-24T12:02:36.060 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1_all.deb ... 2021-03-24T12:02:36.109 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2021-03-24T12:02:36.313 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplejson. 2021-03-24T12:02:36.330 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../109-python3-simplejson_3.13.2-1_amd64.deb ... 2021-03-24T12:02:36.380 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2021-03-24T12:02:36.412 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pytest. 2021-03-24T12:02:36.427 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../108-python3-pytest_3.3.2-2_all.deb ... 2021-03-24T12:02:36.472 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pytest (3.3.2-2) ... 2021-03-24T12:02:36.742 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tk:amd64. 2021-03-24T12:02:36.756 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../110-python3-tk_3.6.9-1~18.04_amd64.deb ... 2021-03-24T12:02:36.799 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2021-03-24T12:02:36.816 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-simplejson. 2021-03-24T12:02:36.830 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../109-python3-simplejson_3.13.2-1_amd64.deb ... 2021-03-24T12:02:36.891 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2021-03-24T12:02:37.227 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-tk:amd64. 2021-03-24T12:02:37.242 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../110-python3-tk_3.6.9-1~18.04_amd64.deb ... 2021-03-24T12:02:37.285 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2021-03-24T12:02:37.287 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package radosgw. 2021-03-24T12:02:37.301 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../111-radosgw_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:37.345 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking radosgw (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:37.739 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package radosgw. 2021-03-24T12:02:37.754 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../111-radosgw_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:37.797 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking radosgw (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:38.290 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package rbd-fuse. 2021-03-24T12:02:38.303 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../112-rbd-fuse_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:38.349 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking rbd-fuse (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:38.669 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-logutils (0.3.3-5) ... 2021-03-24T12:02:38.776 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package rbd-fuse. 2021-03-24T12:02:38.790 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../112-rbd-fuse_15.2.10-72-g13f4488c-1bionic_amd64.deb ... 2021-03-24T12:02:38.834 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking rbd-fuse (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:38.978 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-03-24T12:02:39.147 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-logutils (0.3.3-5) ... 2021-03-24T12:02:39.331 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2021-03-24T12:02:39.455 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-03-24T12:02:39.464 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-03-24T12:02:39.832 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2021-03-24T12:02:39.975 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-03-24T12:02:40.059 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.5) ... 2021-03-24T12:02:40.451 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2021-03-24T12:02:40.594 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.5) ... 2021-03-24T12:02:40.744 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webencodings (0.5-2) ... 2021-03-24T12:02:40.979 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2021-03-24T12:02:41.037 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-attr (17.4.0-2) ... 2021-03-24T12:02:41.238 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2021-03-24T12:02:41.272 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-webencodings (0.5-2) ... 2021-03-24T12:02:41.364 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-py (1.5.2-1) ... 2021-03-24T12:02:41.583 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python-attr (17.4.0-2) ... 2021-03-24T12:02:41.709 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-waitress (1.0.1-1) ... 2021-03-24T12:02:41.782 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2021-03-24T12:02:41.925 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-py (1.5.2-1) ... 2021-03-24T12:02:42.091 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-03-24T12:02:42.260 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-waitress (1.0.1-1) ... 2021-03-24T12:02:42.418 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-olefile (0.45.1-1) ... 2021-03-24T12:02:42.583 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-03-24T12:02:42.711 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-argparse (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:42.871 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-olefile (0.45.1-1) ... 2021-03-24T12:02:43.037 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tempita (0.5.2-2) ... 2021-03-24T12:02:43.164 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-ceph-argparse (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:43.346 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-03-24T12:02:43.473 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-tempita (0.5.2-2) ... 2021-03-24T12:02:43.997 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2021-03-24T12:02:44.241 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-03-24T12:02:44.384 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2021-03-24T12:02:44.968 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2021-03-24T12:02:45.310 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2021-03-24T12:02:45.345 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2021-03-24T12:02:45.595 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-py (1.5.2-1) ... 2021-03-24T12:02:45.671 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2021-03-24T12:02:45.821 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplejson (3.13.2-1) ... 2021-03-24T12:02:45.964 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python-py (1.5.2-1) ... 2021-03-24T12:02:46.156 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-json-pointer (1.10-1) ... 2021-03-24T12:02:46.199 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-simplejson (3.13.2-1) ... 2021-03-24T12:02:46.246 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2021-03-24T12:02:46.473 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-03-24T12:02:46.550 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-json-pointer (1.10-1) ... 2021-03-24T12:02:46.617 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-03-24T12:02:46.640 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2021-03-24T12:02:46.834 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2021-03-24T12:02:46.877 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-03-24T12:02:47.003 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-03-24T12:02:47.351 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-03-24T12:02:47.352 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2021-03-24T12:02:47.461 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cycler (0.10.0-1) ... 2021-03-24T12:02:47.496 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-03-24T12:02:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2021-03-24T12:02:47.822 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cycler (0.10.0-1) ... 2021-03-24T12:02:48.124 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2021-03-24T12:02:48.147 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-bs4 (4.6.0-1) ... 2021-03-24T12:02:48.482 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pluggy (0.6.0-1) ... 2021-03-24T12:02:48.500 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-bs4 (4.6.0-1) ... 2021-03-24T12:02:48.791 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephadm (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:48.820 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pluggy (0.6.0-1) ... 2021-03-24T12:02:49.113 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up cephadm (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:49.534 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user cephadm....done 2021-03-24T12:02:49.698 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2021-03-24T12:02:49.797 INFO:teuthology.orchestra.run.smithi043.stdout:Adding system user cephadm....done 2021-03-24T12:02:49.952 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2021-03-24T12:02:50.007 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-03-24T12:02:50.150 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-03-24T12:02:50.262 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-03-24T12:02:50.335 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2021-03-24T12:02:50.388 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-03-24T12:02:50.547 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2021-03-24T12:02:50.669 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-prettytable (0.7.2-3) ... 2021-03-24T12:02:50.890 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-prettytable (0.7.2-3) ... 2021-03-24T12:02:50.970 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-03-24T12:02:51.105 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2021-03-24T12:02:51.200 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-03-24T12:02:51.334 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2021-03-24T12:02:51.439 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-common (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:51.678 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-ceph-common (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:02:51.765 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-monotonic (1.1-2) ... 2021-03-24T12:02:51.995 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-monotonic (1.1-2) ... 2021-03-24T12:02:52.058 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-03-24T12:02:52.209 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-03-24T12:02:52.288 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-03-24T12:02:52.420 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-03-24T12:02:52.569 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-html5lib (0.999999999-1) ... 2021-03-24T12:02:52.765 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-html5lib (0.999999999-1) ... 2021-03-24T12:02:52.929 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-03-24T12:02:53.018 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-03-24T12:02:53.051 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2021-03-24T12:02:53.125 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-03-24T12:02:53.231 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-03-24T12:02:53.263 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2021-03-24T12:02:53.314 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-repoze.lru (0.7-1) ... 2021-03-24T12:02:53.510 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-repoze.lru (0.7-1) ... 2021-03-24T12:02:53.615 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-03-24T12:02:53.820 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.3) ... 2021-03-24T12:02:53.933 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2021-03-24T12:02:54.104 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2021-03-24T12:02:54.268 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-attr (17.4.0-2) ... 2021-03-24T12:02:54.455 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-attr (17.4.0-2) ... 2021-03-24T12:02:54.585 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-03-24T12:02:54.773 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-03-24T12:02:54.786 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-03-24T12:02:54.967 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-03-24T12:02:55.188 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2021-03-24T12:02:55.278 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-03-24T12:02:55.393 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2021-03-24T12:02:55.490 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-03-24T12:02:55.548 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liboath0 (2.6.1-1) ... 2021-03-24T12:02:55.724 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-03-24T12:02:55.761 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up liboath0 (2.6.1-1) ... 2021-03-24T12:02:55.859 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2021-03-24T12:02:55.937 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-03-24T12:02:56.063 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2021-03-24T12:02:56.118 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-03-24T12:02:56.244 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-setuptools (39.0.1-2) ... 2021-03-24T12:02:56.314 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-03-24T12:02:56.440 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-setuptools (39.0.1-2) ... 2021-03-24T12:02:56.654 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-03-24T12:02:56.780 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-decorator (4.1.2-1) ... 2021-03-24T12:02:56.825 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-03-24T12:02:56.976 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-decorator (4.1.2-1) ... 2021-03-24T12:02:57.081 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tz (2018.3-2) ... 2021-03-24T12:02:57.277 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-tz (2018.3-2) ... 2021-03-24T12:02:57.407 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2021-03-24T12:02:57.613 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2021-03-24T12:02:57.708 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2021-03-24T12:02:57.904 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2021-03-24T12:02:58.018 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-joblib (0.11-1) ... 2021-03-24T12:02:58.217 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-joblib (0.11-1) ... 2021-03-24T12:02:58.436 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-routes (2.4.1-1) ... 2021-03-24T12:02:58.590 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-routes (2.4.1-1) ... 2021-03-24T12:02:58.745 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2021-03-24T12:02:58.907 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2021-03-24T12:02:59.038 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-dateutil (2.6.1-1) ... 2021-03-24T12:02:59.217 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-dateutil (2.6.1-1) ... 2021-03-24T12:02:59.364 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-03-24T12:02:59.560 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-03-24T12:02:59.759 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-fasteners (0.12.0-3) ... 2021-03-24T12:02:59.937 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-fasteners (0.12.0-3) ... 2021-03-24T12:03:00.060 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up jq (1.5+dfsg-2) ... 2021-03-24T12:03:00.185 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2021-03-24T12:03:00.238 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up jq (1.5+dfsg-2) ... 2021-03-24T12:03:00.364 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2021-03-24T12:03:01.357 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-03-24T12:03:01.570 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-03-24T12:03:01.683 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2021-03-24T12:03:01.895 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2021-03-24T12:03:02.012 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2021-03-24T12:03:02.162 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pytest (3.3.2-2) ... 2021-03-24T12:03:02.246 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2021-03-24T12:03:02.372 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pytest (3.3.2-2) ... 2021-03-24T12:03:02.528 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-pytest (3.3.2-2) ... 2021-03-24T12:03:02.757 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python-pytest (3.3.2-2) ... 2021-03-24T12:03:02.791 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-03-24T12:03:02.930 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-03-24T12:03:03.025 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-03-24T12:03:03.057 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librados2 (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:03.167 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-03-24T12:03:03.187 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rsa (3.4.2-1) ... 2021-03-24T12:03:03.302 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up librados2 (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:03.437 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-rsa (3.4.2-1) ... 2021-03-24T12:03:03.545 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs2 (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:03.670 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs-dev (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:03.746 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libcephfs2 (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:03.798 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rados (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:03.871 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libcephfs-dev (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:03.921 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2021-03-24T12:03:03.997 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-rados (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:04.123 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2021-03-24T12:03:04.247 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2021-03-24T12:03:04.441 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2021-03-24T12:03:04.575 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2021-03-24T12:03:04.784 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2021-03-24T12:03:04.893 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2021-03-24T12:03:05.127 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2021-03-24T12:03:05.821 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn (0.19.1-3) ... 2021-03-24T12:03:06.073 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-sklearn (0.19.1-3) ... 2021-03-24T12:03:06.650 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2021-03-24T12:03:06.945 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2021-03-24T12:03:06.960 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libradosstriper1 (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:07.102 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cephfs (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:07.237 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libradosstriper1 (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:07.363 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cephfs (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:07.403 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librgw2 (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:07.531 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-fuse (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:07.664 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up librgw2 (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:07.781 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-03-24T12:03:07.781 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-03-24T12:03:07.793 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-fuse (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:08.017 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-03-24T12:03:08.018 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-03-24T12:03:08.080 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librbd1 (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:08.206 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pecan (1.2.1-2) ... 2021-03-24T12:03:08.296 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-03-24T12:03:08.299 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up librbd1 (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:08.328 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-03-24T12:03:08.434 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pecan (1.2.1-2) ... 2021-03-24T12:03:08.541 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-03-24T12:03:08.581 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-03-24T12:03:08.651 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2021-03-24T12:03:08.896 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2021-03-24T12:03:09.337 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-modules-core (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:09.463 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastescript (2.0.2-2) ... 2021-03-24T12:03:09.573 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-modules-core (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:09.699 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pastescript (2.0.2-2) ... 2021-03-24T12:03:09.797 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rgw (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:09.923 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up rbd-fuse (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:10.025 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-rgw (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:10.049 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rbd (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:10.175 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-common (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:10.191 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up rbd-fuse (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:10.302 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-rbd (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:10.428 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-common (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:10.742 INFO:teuthology.orchestra.run.smithi161.stdout:Adding group ceph....done 2021-03-24T12:03:10.963 INFO:teuthology.orchestra.run.smithi043.stdout:Adding group ceph....done 2021-03-24T12:03:11.053 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user ceph....done 2021-03-24T12:03:11.237 INFO:teuthology.orchestra.run.smithi161.stdout:Setting system user ceph properties....done 2021-03-24T12:03:11.365 INFO:teuthology.orchestra.run.smithi043.stdout:Adding system user ceph....done 2021-03-24T12:03:11.394 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-03-24T12:03:11.566 INFO:teuthology.orchestra.run.smithi043.stdout:Setting system user ceph properties....done 2021-03-24T12:03:11.622 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-03-24T12:03:11.724 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-03-24T12:03:11.918 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up radosgw (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:11.957 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-03-24T12:03:12.176 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-03-24T12:03:12.176 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-03-24T12:03:12.247 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up radosgw (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:12.515 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-03-24T12:03:12.516 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-03-24T12:03:12.569 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-test (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:12.696 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-base (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:12.882 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-test (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:13.008 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-base (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:13.040 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-03-24T12:03:13.330 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:13.407 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-03-24T12:03:13.537 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-03-24T12:03:13.537 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-03-24T12:03:13.626 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:13.807 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-diskprediction-local (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:13.873 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-03-24T12:03:13.873 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-03-24T12:03:13.932 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-osd (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:14.137 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-diskprediction-local (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:14.280 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-osd (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:14.403 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-03-24T12:03:14.404 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-03-24T12:03:14.729 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-03-24T12:03:14.729 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-03-24T12:03:14.986 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-cephadm (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:14.998 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-cephadm (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:15.128 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:15.141 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:15.262 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-rook (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:15.283 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-rook (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:15.405 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mds (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:15.443 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mds (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:15.610 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-03-24T12:03:15.611 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-03-24T12:03:15.672 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-03-24T12:03:15.673 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-03-24T12:03:15.898 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mon (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:15.928 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mon (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:16.101 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-03-24T12:03:16.102 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-03-24T12:03:16.163 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-03-24T12:03:16.164 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-03-24T12:03:16.366 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-k8sevents (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:16.429 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-k8sevents (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:16.483 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-dashboard (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:16.555 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-dashboard (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:16.626 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:16.698 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph (15.2.10-72-g13f4488c-1bionic) ... 2021-03-24T12:03:16.753 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for systemd (237-3ubuntu10.44) ... 2021-03-24T12:03:16.824 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for systemd (237-3ubuntu10.44) ... 2021-03-24T12:03:16.945 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-03-24T12:03:17.033 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-03-24T12:03:19.006 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-03-24T12:03:19.040 INFO:teuthology.orchestra.run.smithi161.stdout:ureadahead will be reprofiled on next reboot 2021-03-24T12:03:19.106 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-03-24T12:03:19.244 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-03-24T12:03:19.278 INFO:teuthology.orchestra.run.smithi043.stdout:ureadahead will be reprofiled on next reboot 2021-03-24T12:03:19.336 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-03-24T12:03:19.546 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-03-24T12:03:19.549 DEBUG:teuthology.parallel:result is None 2021-03-24T12:03:19.769 INFO:teuthology.orchestra.run.smithi043.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-03-24T12:03:19.772 DEBUG:teuthology.parallel:result is None 2021-03-24T12:03:19.773 DEBUG:teuthology.orchestra.run.smithi043:> sudo lsb_release -is 2021-03-24T12:03:19.826 INFO:teuthology.orchestra.run.smithi043.stdout:Ubuntu 2021-03-24T12:03:19.831 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-03-24T12:03:19.832 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-03-24T12:03:19.833 INFO:teuthology.packaging:ref: None 2021-03-24T12:03:19.834 INFO:teuthology.packaging:tag: None 2021-03-24T12:03:19.834 INFO:teuthology.packaging:branch: octopus 2021-03-24T12:03:19.835 INFO:teuthology.packaging:sha1: 666a545dfbb7fc4fe7736e3c0e891b149a8ef286 2021-03-24T12:03:19.842 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=octopus 2021-03-24T12:03:20.061 DEBUG:teuthology.orchestra.run.smithi043:> dpkg-query -W -f '${Version}' ceph 2021-03-24T12:03:20.269 INFO:teuthology.orchestra.run.smithi043.stdout:15.2.10-72-g13f4488c-1bionic 2021-03-24T12:03:20.270 INFO:teuthology.packaging:The installed version of ceph is 15.2.10-72-g13f4488c-1bionic 2021-03-24T12:03:20.271 INFO:teuthology.task.install:The correct ceph version 15.2.10-72-g13f4488c-1bionic is installed. 2021-03-24T12:03:20.272 DEBUG:teuthology.orchestra.run.smithi161:> sudo lsb_release -is 2021-03-24T12:03:20.331 INFO:teuthology.orchestra.run.smithi161.stdout:Ubuntu 2021-03-24T12:03:20.337 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-03-24T12:03:20.338 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-03-24T12:03:20.338 INFO:teuthology.packaging:ref: None 2021-03-24T12:03:20.339 INFO:teuthology.packaging:tag: None 2021-03-24T12:03:20.340 INFO:teuthology.packaging:branch: octopus 2021-03-24T12:03:20.342 INFO:teuthology.packaging:sha1: 666a545dfbb7fc4fe7736e3c0e891b149a8ef286 2021-03-24T12:03:20.343 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=octopus 2021-03-24T12:03:20.550 DEBUG:teuthology.orchestra.run.smithi161:> dpkg-query -W -f '${Version}' ceph 2021-03-24T12:03:20.577 INFO:teuthology.orchestra.run.smithi161.stdout:15.2.10-72-g13f4488c-1bionic 2021-03-24T12:03:20.577 INFO:teuthology.packaging:The installed version of ceph is 15.2.10-72-g13f4488c-1bionic 2021-03-24T12:03:20.578 INFO:teuthology.task.install:The correct ceph version 15.2.10-72-g13f4488c-1bionic is installed. 2021-03-24T12:03:20.578 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-03-24T12:03:20.588 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:20.589 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-03-24T12:03:20.606 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:20.607 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-03-24T12:03:20.633 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-03-24T12:03:20.635 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:20.636 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2021-03-24T12:03:20.661 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-03-24T12:03:20.718 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:20.719 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2021-03-24T12:03:20.743 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-03-24T12:03:20.801 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-03-24T12:03:20.802 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:20.803 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2021-03-24T12:03:20.826 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-03-24T12:03:20.880 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:20.881 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2021-03-24T12:03:20.897 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-03-24T12:03:20.953 INFO:teuthology.run_tasks:Running task ceph... 2021-03-24T12:03:21.070 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-03-24T12:03:21.072 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /var/log/ceph 2021-03-24T12:03:21.076 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /var/log/ceph 2021-03-24T12:03:21.091 INFO:tasks.ceph:Disabling ceph logrotate... 2021-03-24T12:03:21.092 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/logrotate.d/ceph 2021-03-24T12:03:21.133 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/logrotate.d/ceph 2021-03-24T12:03:21.149 INFO:tasks.ceph:Creating extra log directories... 2021-03-24T12:03:21.150 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-03-24T12:03:21.189 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-03-24T12:03:21.278 INFO:tasks.ceph:Creating ceph cluster c1... 2021-03-24T12:03:21.343 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'cpu_profile': set(), 'cluster': 'c1', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-03-24T12:03:21.344 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/sage-2021-03-24_06:13:24-upgrade:octopus-x-wip-sage-testing-2021-03-23-2309-distro-basic-smithi/5993444', 'branch': 'wip-sage-testing-2021-03-23-2309', 'description': 'upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary}', 'email': None, 'first_in_suite': False, 'job_id': '5993444', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'sage-2021-03-24_06:13:24-upgrade:octopus-x-wip-sage-testing-2021-03-23-2309-distro-basic-smithi', 'nuke-on-error': True, 'overrides': {'admin_socket': {'branch': 'wip-sage-testing-2021-03-23-2309'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '666a545dfbb7fc4fe7736e3c0e891b149a8ef286', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'branch': 'octopus', 'sha1': '666a545dfbb7fc4fe7736e3c0e891b149a8ef286'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}, {'endpoints': ['c2.client.1'], 'is_pubsub': True, 'name': 'test-zone3'}]}]}, 'rgw-multisite-tests': {'args': ['tests.py', 'tests_ps.py'], 'branch': 'octopus', 'repo': 'https://github.com/ceph/ceph.git'}, 'workunit': {'branch': 'wip-sage-testing-2021-03-23-2309', 'sha1': '666a545dfbb7fc4fe7736e3c0e891b149a8ef286'}}, 'owner': 'scheduled_sage@teuthology', 'priority': 80, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'], ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']], 'sha1': '666a545dfbb7fc4fe7736e3c0e891b149a8ef286', 'sleep_before_teardown': 0, 'suite': 'upgrade:octopus-x', 'suite_branch': 'wip-sage-testing-2021-03-23-2309', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_666a545dfbb7fc4fe7736e3c0e891b149a8ef286/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': '666a545dfbb7fc4fe7736e3c0e891b149a8ef286', 'targets': {'smithi043.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPhwa3ibD1YBedhMFWy21AHn5O5CkJVIxaAk1movRw/4oSozYwafJi7eXneOBVXVbNhh7vzPlBz0MOSGeHrnB2EJ8Kcr4pX1eow9pYcfIHANjeNCsu691x5o/cFPiU082fvdvUeW3RMzsynsWATcTDPbjTFmx00+67Hl/pdH7QIsdv+SYbYDehzSu/5911Cb7GkyXrXbiVgnch/5puAGqbBWuOHxMctOA90xWHYr7JcVIJuzaD6pbCoBbVCCdVablXMXZQZc9/KUz+ztnh8r8Q9ATlTN97FyxFVI/zRKxHtNECfXooY+wLX7bo9I13pT2PFd4tyfkd63qdwXL+IgPL', 'smithi161.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCaY1KZyL/Eub6ciQOfZ957YbBBCLIP6mYl/DzoNr02jwI6CUBSQdhU639DAVa0JXfjU4NmIQ53icIphzcgIZWp8HkCHbcGAeQpwsKjxSFWU2U3KkrVKypBqJxyF68bdH8Ul6PE6x91xOInzrdV6N3VYfrXLvox4njkEGgNhqGd/oPCtSJJqBc2NWqKolUTcVB/ltzFQPVB0jrjJhVzMMl34PuOPBwCw4pfs0+7Pf4K7Jq+uoZ1RM4rDYojkKB6q50EleDFOA+RZDSHComHd3t/ReRikRCZnb9TXfz4QFLb9q/HqahJcVVdEbH7Dvtq6m1LlC1ZqzFfrtl2ho+yvTbz'}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '666a545dfbb7fc4fe7736e3c0e891b149a8ef286', 'wait-for-scrub': False}}, {'ceph': {'cluster': 'c2'}}, {'parallel': ['upgrade-task']}, {'rgw': {'c1.client.0': {'port': 8000}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 60}}}], 'teuthology_branch': 'master', 'teuthology_sha1': '6b3150e9e0aa7ca432e26f31d87920ebd77f3708', 'timestamp': '2021-03-24_06:13:24', 'tube': 'smithi', 'upgrade-task': [{'install.upgrade': {'c1.client.0': None, 'c1.mgr.x': None, 'c1.mon.a': None, 'c1.osd.0': None, 'c1.osd.1': None, 'c1.osd.2': None}}], 'user': 'sage', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.9855'} 2021-03-24T12:03:21.345 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2021-03-24T12:03:21.347 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2021-03-24T12:03:21.354 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/run/ceph 2021-03-24T12:03:21.397 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2021-03-24T12:03:21.412 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:21.413 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/scratch_devs of=/dev/stdout 2021-03-24T12:03:21.457 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-03-24T12:03:21.458 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-03-24T12:03:21.506 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-03-24T12:03:21.507 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-24T12:03:21.507 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 340 Links: 1 2021-03-24T12:03:21.508 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-24T12:03:21.508 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2021-03-24 12:00:45.056776231 +0000 2021-03-24T12:03:21.508 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2021-03-24 12:00:44.924776232 +0000 2021-03-24T12:03:21.509 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2021-03-24 12:00:44.924776232 +0000 2021-03-24T12:03:21.509 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2021-03-24T12:03:21.515 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2021-03-24T12:03:21.515 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2021-03-24T12:03:21.515 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000270638 s, 1.9 MB/s 2021-03-24T12:03:21.520 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-03-24T12:03:21.570 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-03-24T12:03:21.571 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-24T12:03:21.572 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 347 Links: 1 2021-03-24T12:03:21.572 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-24T12:03:21.572 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2021-03-24 12:00:45.332776228 +0000 2021-03-24T12:03:21.573 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2021-03-24 12:00:45.188776230 +0000 2021-03-24T12:03:21.573 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2021-03-24 12:00:45.188776230 +0000 2021-03-24T12:03:21.574 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2021-03-24T12:03:21.581 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2021-03-24T12:03:21.582 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2021-03-24T12:03:21.583 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000281013 s, 1.8 MB/s 2021-03-24T12:03:21.585 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-03-24T12:03:21.639 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-03-24T12:03:21.640 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-24T12:03:21.640 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 353 Links: 1 2021-03-24T12:03:21.640 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-24T12:03:21.641 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2021-03-24 12:00:45.592776225 +0000 2021-03-24T12:03:21.641 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2021-03-24 12:00:45.464776227 +0000 2021-03-24T12:03:21.641 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2021-03-24 12:00:45.464776227 +0000 2021-03-24T12:03:21.641 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2021-03-24T12:03:21.644 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2021-03-24T12:03:21.644 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2021-03-24T12:03:21.644 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000280334 s, 1.8 MB/s 2021-03-24T12:03:21.649 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-03-24T12:03:21.697 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-03-24T12:03:21.698 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-24T12:03:21.698 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 359 Links: 1 2021-03-24T12:03:21.698 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-24T12:03:21.699 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2021-03-24 12:00:45.888776222 +0000 2021-03-24T12:03:21.699 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2021-03-24 12:00:45.732776224 +0000 2021-03-24T12:03:21.699 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2021-03-24 12:00:45.732776224 +0000 2021-03-24T12:03:21.699 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2021-03-24T12:03:21.707 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2021-03-24T12:03:21.708 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2021-03-24T12:03:21.708 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000260057 s, 2.0 MB/s 2021-03-24T12:03:21.712 INFO:tasks.ceph:osd dev map: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-03-24T12:03:21.713 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-03-24T12:03:21.713 INFO:tasks.ceph:Generating config... 2021-03-24T12:03:21.715 INFO:tasks.ceph:[client] debug rgw = 20 2021-03-24T12:03:21.716 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2021-03-24T12:03:21.716 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2021-03-24T12:03:21.717 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-03-24T12:03:21.718 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2021-03-24T12:03:21.718 INFO:tasks.ceph:[client] rgw data log num shards = 4 2021-03-24T12:03:21.718 INFO:tasks.ceph:[client] rgw md log max shards = 4 2021-03-24T12:03:21.719 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2021-03-24T12:03:21.719 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2021-03-24T12:03:21.720 INFO:tasks.ceph:[client] setgroup = ceph 2021-03-24T12:03:21.720 INFO:tasks.ceph:[client] setuser = ceph 2021-03-24T12:03:21.720 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-03-24T12:03:21.721 INFO:tasks.ceph:[mgr] debug ms = 1 2021-03-24T12:03:21.722 INFO:tasks.ceph:[mon] debug mon = 20 2021-03-24T12:03:21.722 INFO:tasks.ceph:[mon] debug ms = 1 2021-03-24T12:03:21.725 INFO:tasks.ceph:[mon] debug paxos = 20 2021-03-24T12:03:21.727 INFO:tasks.ceph:[osd] debug ms = 1 2021-03-24T12:03:21.727 INFO:tasks.ceph:[osd] debug osd = 20 2021-03-24T12:03:21.728 INFO:tasks.ceph:Setting up c1.mon.a... 2021-03-24T12:03:21.728 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c1.keyring 2021-03-24T12:03:21.789 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/c1.keyring 2021-03-24T12:03:21.792 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c1.keyring 2021-03-24T12:03:21.880 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-03-24T12:03:21.937 DEBUG:tasks.ceph:Ceph mon addresses: [('c1.mon.a', '172.21.15.43')] 2021-03-24T12:03:21.938 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.43'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2021-03-24T12:03:21.939 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:21.939 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-03-24T12:03:21.985 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.43 --print /home/ubuntu/cephtest/c1.monmap 2021-03-24T12:03:22.057 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:03:22.058 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:03:22.059 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c1.monmap 2021-03-24T12:03:22.060 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: generated fsid 3062b607-a1e8-4f4b-a177-1faaa107d417 2021-03-24T12:03:22.060 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 0 2021-03-24T12:03:22.060 INFO:teuthology.orchestra.run.smithi043.stdout:fsid 3062b607-a1e8-4f4b-a177-1faaa107d417 2021-03-24T12:03:22.061 INFO:teuthology.orchestra.run.smithi043.stdout:last_changed 2021-03-24T12:03:22.062008+0000 2021-03-24T12:03:22.061 INFO:teuthology.orchestra.run.smithi043.stdout:created 2021-03-24T12:03:22.062008+0000 2021-03-24T12:03:22.062 INFO:teuthology.orchestra.run.smithi043.stdout:min_mon_release 0 (unknown) 2021-03-24T12:03:22.062 INFO:teuthology.orchestra.run.smithi043.stdout:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2021-03-24T12:03:22.062 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c1.monmap (1 monitors) 2021-03-24T12:03:22.063 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-03-24T12:03:22.109 INFO:tasks.ceph:Writing /etc/ceph/c1.conf for FSID 3062b607-a1e8-4f4b-a177-1faaa107d417... 2021-03-24T12:03:22.111 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2021-03-24T12:03:22.154 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2021-03-24T12:03:22.187 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2021-03-24T12:03:22.187 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2021-03-24T12:03:22.187 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-03-24T12:03:22.188 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2021-03-24T12:03:22.188 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.188 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2021-03-24T12:03:22.188 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.188 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2021-03-24T12:03:22.189 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.189 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2021-03-24T12:03:22.189 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2021-03-24T12:03:22.189 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.190 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2021-03-24T12:03:22.190 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2021-03-24T12:03:22.190 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.190 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2021-03-24T12:03:22.191 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2021-03-24T12:03:22.191 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.191 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2021-03-24T12:03:22.192 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2021-03-24T12:03:22.192 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.192 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2021-03-24T12:03:22.192 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.192 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2021-03-24T12:03:22.193 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2021-03-24T12:03:22.193 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2021-03-24T12:03:22.193 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2021-03-24T12:03:22.193 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2021-03-24T12:03:22.194 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2021-03-24T12:03:22.194 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2021-03-24T12:03:22.195 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-03-24T12:03:22.195 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2021-03-24T12:03:22.195 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2021-03-24T12:03:22.197 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.197 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-03-24T12:03:22.197 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.198 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2021-03-24T12:03:22.198 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.198 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2021-03-24T12:03:22.198 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.198 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2021-03-24T12:03:22.199 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2021-03-24T12:03:22.199 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2021-03-24T12:03:22.199 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = 172.21.15.43 2021-03-24T12:03:22.199 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = 3062b607-a1e8-4f4b-a177-1faaa107d417 2021-03-24T12:03:22.200 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.200 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2021-03-24T12:03:22.200 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2021-03-24T12:03:22.200 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.200 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2021-03-24T12:03:22.201 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2021-03-24T12:03:22.201 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.201 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2021-03-24T12:03:22.201 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2021-03-24T12:03:22.202 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.202 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2021-03-24T12:03:22.202 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2021-03-24T12:03:22.202 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2021-03-24T12:03:22.202 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.203 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2021-03-24T12:03:22.203 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2021-03-24T12:03:22.203 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.204 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2021-03-24T12:03:22.204 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.204 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2021-03-24T12:03:22.204 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.204 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2021-03-24T12:03:22.205 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.206 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2021-03-24T12:03:22.207 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2021-03-24T12:03:22.207 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.207 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2021-03-24T12:03:22.208 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2021-03-24T12:03:22.208 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2021-03-24T12:03:22.208 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2021-03-24T12:03:22.208 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.208 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2021-03-24T12:03:22.209 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2021-03-24T12:03:22.209 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2021-03-24T12:03:22.209 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2021-03-24T12:03:22.209 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2021-03-24T12:03:22.209 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2021-03-24T12:03:22.210 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2021-03-24T12:03:22.210 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2021-03-24T12:03:22.210 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.210 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2021-03-24T12:03:22.211 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2021-03-24T12:03:22.211 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2021-03-24T12:03:22.211 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2021-03-24T12:03:22.211 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2021-03-24T12:03:22.211 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2021-03-24T12:03:22.212 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2021-03-24T12:03:22.212 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2021-03-24T12:03:22.212 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2021-03-24T12:03:22.212 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2021-03-24T12:03:22.212 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2021-03-24T12:03:22.213 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:22.213 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2021-03-24T12:03:22.213 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2021-03-24T12:03:22.213 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2021-03-24T12:03:22.214 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2021-03-24T12:03:22.214 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-03-24T12:03:22.214 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-03-24T12:03:22.215 INFO:teuthology.orchestra.run.smithi043.stdout: debug rgw = 20 2021-03-24T12:03:22.215 INFO:teuthology.orchestra.run.smithi043.stdout: rgw crypt require ssl = False 2021-03-24T12:03:22.215 INFO:teuthology.orchestra.run.smithi043.stdout: rgw crypt s3 kms backend = testing 2021-03-24T12:03:22.215 INFO:teuthology.orchestra.run.smithi043.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-03-24T12:03:22.215 INFO:teuthology.orchestra.run.smithi043.stdout: rgw curl low speed time = 300 2021-03-24T12:03:22.216 INFO:teuthology.orchestra.run.smithi043.stdout: rgw data log num shards = 4 2021-03-24T12:03:22.217 INFO:teuthology.orchestra.run.smithi043.stdout: rgw md log max shards = 4 2021-03-24T12:03:22.217 INFO:teuthology.orchestra.run.smithi043.stdout: rgw sync log trim interval = 0 2021-03-24T12:03:22.218 INFO:teuthology.orchestra.run.smithi043.stdout: rgw sync obj etag verify = True 2021-03-24T12:03:22.218 INFO:teuthology.orchestra.run.smithi043.stdout: setgroup = ceph 2021-03-24T12:03:22.218 INFO:teuthology.orchestra.run.smithi043.stdout: setuser = ceph 2021-03-24T12:03:22.218 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2021-03-24T12:03:22.220 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2021-03-24T12:03:22.221 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2021-03-24T12:03:22.221 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-03-24T12:03:22.221 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2021-03-24T12:03:22.221 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.222 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2021-03-24T12:03:22.222 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.222 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2021-03-24T12:03:22.222 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.224 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2021-03-24T12:03:22.224 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2021-03-24T12:03:22.224 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.224 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2021-03-24T12:03:22.225 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2021-03-24T12:03:22.225 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.225 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2021-03-24T12:03:22.225 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2021-03-24T12:03:22.225 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.226 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2021-03-24T12:03:22.226 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2021-03-24T12:03:22.226 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.226 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2021-03-24T12:03:22.227 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.230 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2021-03-24T12:03:22.230 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2021-03-24T12:03:22.231 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2021-03-24T12:03:22.231 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2021-03-24T12:03:22.232 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2021-03-24T12:03:22.232 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2021-03-24T12:03:22.233 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2021-03-24T12:03:22.233 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-03-24T12:03:22.233 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2021-03-24T12:03:22.234 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2021-03-24T12:03:22.235 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.235 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-03-24T12:03:22.236 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.236 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2021-03-24T12:03:22.237 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.238 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2021-03-24T12:03:22.239 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.239 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2021-03-24T12:03:22.257 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2021-03-24T12:03:22.260 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2021-03-24T12:03:22.260 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = 172.21.15.43 2021-03-24T12:03:22.261 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = 3062b607-a1e8-4f4b-a177-1faaa107d417 2021-03-24T12:03:22.261 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.261 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2021-03-24T12:03:22.262 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2021-03-24T12:03:22.262 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.263 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2021-03-24T12:03:22.271 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2021-03-24T12:03:22.271 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.271 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2021-03-24T12:03:22.272 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2021-03-24T12:03:22.272 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.273 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2021-03-24T12:03:22.273 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2021-03-24T12:03:22.273 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2021-03-24T12:03:22.274 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.274 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2021-03-24T12:03:22.274 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2021-03-24T12:03:22.275 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.275 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2021-03-24T12:03:22.275 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.276 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2021-03-24T12:03:22.276 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.276 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2021-03-24T12:03:22.276 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.277 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2021-03-24T12:03:22.277 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2021-03-24T12:03:22.277 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.278 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2021-03-24T12:03:22.293 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2021-03-24T12:03:22.293 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-03-24T12:03:22.294 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2021-03-24T12:03:22.294 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.295 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2021-03-24T12:03:22.295 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-03-24T12:03:22.296 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2021-03-24T12:03:22.296 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2021-03-24T12:03:22.296 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2021-03-24T12:03:22.297 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2021-03-24T12:03:22.298 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2021-03-24T12:03:22.298 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2021-03-24T12:03:22.299 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.299 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2021-03-24T12:03:22.299 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-03-24T12:03:22.300 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2021-03-24T12:03:22.300 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2021-03-24T12:03:22.301 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2021-03-24T12:03:22.301 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2021-03-24T12:03:22.302 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2021-03-24T12:03:22.303 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2021-03-24T12:03:22.303 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2021-03-24T12:03:22.307 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2021-03-24T12:03:22.308 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2021-03-24T12:03:22.308 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:22.308 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2021-03-24T12:03:22.309 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2021-03-24T12:03:22.309 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2021-03-24T12:03:22.310 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2021-03-24T12:03:22.310 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-03-24T12:03:22.311 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-03-24T12:03:22.311 INFO:teuthology.orchestra.run.smithi161.stdout: debug rgw = 20 2021-03-24T12:03:22.311 INFO:teuthology.orchestra.run.smithi161.stdout: rgw crypt require ssl = False 2021-03-24T12:03:22.312 INFO:teuthology.orchestra.run.smithi161.stdout: rgw crypt s3 kms backend = testing 2021-03-24T12:03:22.312 INFO:teuthology.orchestra.run.smithi161.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-03-24T12:03:22.316 INFO:teuthology.orchestra.run.smithi161.stdout: rgw curl low speed time = 300 2021-03-24T12:03:22.318 INFO:teuthology.orchestra.run.smithi161.stdout: rgw data log num shards = 4 2021-03-24T12:03:22.319 INFO:teuthology.orchestra.run.smithi161.stdout: rgw md log max shards = 4 2021-03-24T12:03:22.319 INFO:teuthology.orchestra.run.smithi161.stdout: rgw sync log trim interval = 0 2021-03-24T12:03:22.319 INFO:teuthology.orchestra.run.smithi161.stdout: rgw sync obj etag verify = True 2021-03-24T12:03:22.320 INFO:teuthology.orchestra.run.smithi161.stdout: setgroup = ceph 2021-03-24T12:03:22.320 INFO:teuthology.orchestra.run.smithi161.stdout: setuser = ceph 2021-03-24T12:03:22.320 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2021-03-24T12:03:22.321 INFO:tasks.ceph:Creating admin key on c1.mon.a... 2021-03-24T12:03:22.322 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c1.keyring 2021-03-24T12:03:22.378 INFO:tasks.ceph:Copying monmap to all nodes... 2021-03-24T12:03:22.570 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:22.570 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/c1.keyring of=/dev/stdout 2021-03-24T12:03:22.579 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:22.579 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/c1.monmap of=/dev/stdout 2021-03-24T12:03:22.631 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi043.front.sepia.ceph.com 2021-03-24T12:03:22.631 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:22.632 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/c1.keyring 2021-03-24T12:03:22.632 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-03-24T12:03:22.700 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:22.701 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/c1.monmap 2021-03-24T12:03:22.757 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2021-03-24T12:03:22.758 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:22.758 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/c1.keyring 2021-03-24T12:03:22.759 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-03-24T12:03:22.784 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:22.784 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/c1.monmap 2021-03-24T12:03:22.837 INFO:tasks.ceph:Setting up mon nodes... 2021-03-24T12:03:22.837 INFO:tasks.ceph:Setting up mgr nodes... 2021-03-24T12:03:22.838 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mgr/c1-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c1-x/keyring 2021-03-24T12:03:22.883 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mgr/c1-x/keyring 2021-03-24T12:03:22.884 INFO:tasks.ceph:Setting up mds nodes... 2021-03-24T12:03:22.885 INFO:tasks.ceph_client:Setting up client nodes... 2021-03-24T12:03:22.886 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c1.client.0.keyring && sudo chmod 0644 /etc/ceph/c1.client.0.keyring 2021-03-24T12:03:22.959 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/c1.client.0.keyring 2021-03-24T12:03:22.971 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-03-24T12:03:22.972 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-03-24T12:03:22.972 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/c1-0 2021-03-24T12:03:23.029 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-03-24T12:03:23.030 INFO:tasks.ceph:role: c1.osd.0 2021-03-24T12:03:23.030 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com 2021-03-24T12:03:23.031 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-03-24T12:03:23.117 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-03-24T12:03:23.117 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-24T12:03:23.117 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-03-24T12:03:23.117 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-24T12:03:23.118 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2021-03-24T12:03:23.118 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-03-24T12:03:23.118 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-24T12:03:23.118 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-24T12:03:23.119 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-24T12:03:23.119 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2021-03-24T12:03:23.120 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c1-0 2021-03-24T12:03:23.180 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-0 2021-03-24T12:03:23.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-24T12:03:23.356 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: /sbin/restorecon: command not found 2021-03-24T12:03:23.357 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/c1-1 2021-03-24T12:03:23.416 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-03-24T12:03:23.417 INFO:tasks.ceph:role: c1.osd.1 2021-03-24T12:03:23.417 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com 2021-03-24T12:03:23.418 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-03-24T12:03:23.508 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-03-24T12:03:23.508 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-24T12:03:23.509 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-03-24T12:03:23.509 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-24T12:03:23.509 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2021-03-24T12:03:23.510 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-03-24T12:03:23.510 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-24T12:03:23.510 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-24T12:03:23.510 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-24T12:03:23.512 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2021-03-24T12:03:23.512 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c1-1 2021-03-24T12:03:23.576 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-1 2021-03-24T12:03:23.630 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: /sbin/restorecon: command not found 2021-03-24T12:03:23.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-24T12:03:23.632 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/c1-2 2021-03-24T12:03:23.696 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-03-24T12:03:23.696 INFO:tasks.ceph:role: c1.osd.2 2021-03-24T12:03:23.697 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com 2021-03-24T12:03:23.697 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-03-24T12:03:23.780 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-03-24T12:03:23.780 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-24T12:03:23.781 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-03-24T12:03:23.781 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-24T12:03:23.781 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2021-03-24T12:03:23.781 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-03-24T12:03:23.782 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-24T12:03:23.782 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-24T12:03:23.782 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-24T12:03:23.783 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2021-03-24T12:03:23.784 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c1-2 2021-03-24T12:03:23.849 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-2 2021-03-24T12:03:23.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-24T12:03:23.904 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: /sbin/restorecon: command not found 2021-03-24T12:03:23.904 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c1.monmap 2021-03-24T12:03:24.019 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:24.013+0000 7fbe61d06d80 -1 auth: error reading file: /var/lib/ceph/osd/c1-0/keyring: can't open /var/lib/ceph/osd/c1-0/keyring: (2) No such file or directory 2021-03-24T12:03:24.031 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:24.013+0000 7fbe61d06d80 -1 created new key in keyring /var/lib/ceph/osd/c1-0/keyring 2021-03-24T12:03:24.031 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:24.013+0000 7fbe61d06d80 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-03-24T12:03:24.031 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:24.013+0000 7fbe61d06d80 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-03-24T12:03:24.032 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:24.013+0000 7fbe61d06d80 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-03-24T12:03:24.032 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:24.017+0000 7fbe61d06d80 -1 bluestore(/var/lib/ceph/osd/c1-0) _read_fsid unparsable uuid 2021-03-24T12:03:24.033 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:24.029+0000 7fbe61d06d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-24T12:03:25.923 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-0 2021-03-24T12:03:25.941 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c1.monmap 2021-03-24T12:03:26.021 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:26.021+0000 7fa87694cd80 -1 auth: error reading file: /var/lib/ceph/osd/c1-1/keyring: can't open /var/lib/ceph/osd/c1-1/keyring: (2) No such file or directory 2021-03-24T12:03:26.022 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:26.021+0000 7fa87694cd80 -1 created new key in keyring /var/lib/ceph/osd/c1-1/keyring 2021-03-24T12:03:26.022 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:26.021+0000 7fa87694cd80 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-03-24T12:03:26.022 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:26.021+0000 7fa87694cd80 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-03-24T12:03:26.022 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:26.021+0000 7fa87694cd80 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-03-24T12:03:26.023 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:26.021+0000 7fa87694cd80 -1 bluestore(/var/lib/ceph/osd/c1-1) _read_fsid unparsable uuid 2021-03-24T12:03:26.032 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:26.033+0000 7fa87694cd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-24T12:03:27.930 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-1 2021-03-24T12:03:27.992 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c1.monmap 2021-03-24T12:03:28.075 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:28.073+0000 7f497ccc6d80 -1 auth: error reading file: /var/lib/ceph/osd/c1-2/keyring: can't open /var/lib/ceph/osd/c1-2/keyring: (2) No such file or directory 2021-03-24T12:03:28.075 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:28.073+0000 7f497ccc6d80 -1 created new key in keyring /var/lib/ceph/osd/c1-2/keyring 2021-03-24T12:03:28.076 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:28.073+0000 7f497ccc6d80 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-03-24T12:03:28.076 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:28.073+0000 7f497ccc6d80 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-03-24T12:03:28.077 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:28.073+0000 7f497ccc6d80 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-03-24T12:03:28.077 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:28.073+0000 7f497ccc6d80 -1 bluestore(/var/lib/ceph/osd/c1-2) _read_fsid unparsable uuid 2021-03-24T12:03:28.085 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:03:28.085+0000 7f497ccc6d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-24T12:03:29.974 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-2 2021-03-24T12:03:30.031 INFO:tasks.ceph:Reading keys from all nodes... 2021-03-24T12:03:30.031 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:30.032 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mgr/c1-x/keyring of=/dev/stdout 2021-03-24T12:03:30.091 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:30.091 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/c1-0/keyring of=/dev/stdout 2021-03-24T12:03:30.146 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:30.147 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/c1-1/keyring of=/dev/stdout 2021-03-24T12:03:30.200 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:30.200 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/c1-2/keyring of=/dev/stdout 2021-03-24T12:03:30.259 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:30.260 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/c1.client.0.keyring of=/dev/stdout 2021-03-24T12:03:30.318 INFO:tasks.ceph:Adding keys to all mons... 2021-03-24T12:03:30.319 DEBUG:teuthology.orchestra.run.smithi043:> sudo tee -a /etc/ceph/c1.keyring 2021-03-24T12:03:30.376 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.x] 2021-03-24T12:03:30.376 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCKKltgbF3VNBAAQeTLRaVtk037G8ygjMLLYw== 2021-03-24T12:03:30.377 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.0] 2021-03-24T12:03:30.377 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCMKltg1WAmARAAzWIyb9w+x44C9eHS2/d+XQ== 2021-03-24T12:03:30.377 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.1] 2021-03-24T12:03:30.377 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCOKltgIe5+ARAArRm/IhIyZ9LDhOW3WxK0hQ== 2021-03-24T12:03:30.378 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.2] 2021-03-24T12:03:30.378 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCQKltgMoaiBBAAY3z31QifrbYq3DJc3+xyxw== 2021-03-24T12:03:30.378 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2021-03-24T12:03:30.378 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCKKltgxyJkORAAHGAowQkbxfpsliv1ImJo4w== 2021-03-24T12:03:30.380 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-03-24T12:03:30.468 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-24T12:03:30.553 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-24T12:03:30.637 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-24T12:03:30.721 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-03-24T12:03:30.808 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-03-24T12:03:31.036 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/c1-a 2021-03-24T12:03:31.053 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c1 --mkfs -i a --monmap /home/ubuntu/cephtest/c1.monmap --keyring /etc/ceph/c1.keyring 2021-03-24T12:03:31.171 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c1-a 2021-03-24T12:03:31.187 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/c1.monmap 2021-03-24T12:03:31.237 INFO:tasks.ceph:Starting mon daemons in cluster c1... 2021-03-24T12:03:31.238 INFO:tasks.ceph.c1.mon.a:Restarting daemon 2021-03-24T12:03:31.240 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c1 -i a 2021-03-24T12:03:31.280 INFO:tasks.ceph.c1.mon.a:Started 2021-03-24T12:03:31.281 INFO:tasks.ceph:Starting mgr daemons in cluster c1... 2021-03-24T12:03:31.281 INFO:tasks.ceph.c1.mgr.x:Restarting daemon 2021-03-24T12:03:31.282 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c1 -i x 2021-03-24T12:03:31.285 INFO:tasks.ceph.c1.mgr.x:Started 2021-03-24T12:03:31.285 INFO:tasks.ceph:Setting crush tunables to default 2021-03-24T12:03:31.286 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster c1 osd crush tunables default 2021-03-24T12:03:31.612 INFO:teuthology.orchestra.run.smithi043.stderr:adjusted tunables profile to default 2021-03-24T12:03:31.624 INFO:tasks.ceph:Starting osd daemons in cluster c1... 2021-03-24T12:03:31.624 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:31.625 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/c1-0/fsid of=/dev/stdout 2021-03-24T12:03:31.634 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:31.634 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/c1-1/fsid of=/dev/stdout 2021-03-24T12:03:31.693 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:31.694 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/c1-2/fsid of=/dev/stdout 2021-03-24T12:03:31.756 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster c1 osd new abb01019-3bf7-406c-a774-96e790c18122 0 2021-03-24T12:03:32.008 INFO:teuthology.orchestra.run.smithi043.stdout:0 2021-03-24T12:03:32.020 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster c1 osd new e788290b-159f-48cc-b46b-5d0abc86fa76 1 2021-03-24T12:03:32.415 INFO:teuthology.orchestra.run.smithi043.stdout:1 2021-03-24T12:03:32.427 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster c1 osd new e83e73c9-b6c4-489e-b522-c91942ee5823 2 2021-03-24T12:03:32.642 INFO:teuthology.orchestra.run.smithi043.stdout:2 2021-03-24T12:03:32.655 INFO:tasks.ceph.c1.osd.0:Restarting daemon 2021-03-24T12:03:32.656 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 0 2021-03-24T12:03:32.659 INFO:tasks.ceph.c1.osd.0:Started 2021-03-24T12:03:32.660 INFO:tasks.ceph.c1.osd.1:Restarting daemon 2021-03-24T12:03:32.661 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 1 2021-03-24T12:03:32.663 INFO:tasks.ceph.c1.osd.1:Started 2021-03-24T12:03:32.664 INFO:tasks.ceph.c1.osd.2:Restarting daemon 2021-03-24T12:03:32.664 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 2 2021-03-24T12:03:32.671 INFO:tasks.ceph.c1.osd.2:Started 2021-03-24T12:03:32.672 INFO:tasks.ceph:Waiting for OSDs to come up 2021-03-24T12:03:32.977 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2021-03-24T12:03:33.033 INFO:tasks.ceph.c1.osd.1.smithi043.stderr:2021-03-24T12:03:33.033+0000 7f65ed222d80 -1 Falling back to public interface 2021-03-24T12:03:33.151 INFO:teuthology.misc.health.smithi043.stdout: 2021-03-24T12:03:33.151 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":5,"fsid":"3062b607-a1e8-4f4b-a177-1faaa107d417","created":"2021-03-24T12:03:31.403950+0000","modified":"2021-03-24T12:03:32.642971+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"abb01019-3bf7-406c-a774-96e790c18122","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e788290b-159f-48cc-b46b-5d0abc86fa76","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e83e73c9-b6c4-489e-b522-c91942ee5823","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-24T12:03:33.162 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-03-24T12:03:33.256 INFO:tasks.ceph.c1.osd.0.smithi043.stderr:2021-03-24T12:03:33.257+0000 7fade771ad80 -1 Falling back to public interface 2021-03-24T12:03:33.281 INFO:tasks.ceph.c1.osd.2.smithi043.stderr:2021-03-24T12:03:33.281+0000 7f6d48693d80 -1 Falling back to public interface 2021-03-24T12:03:33.634 INFO:tasks.ceph.c1.osd.1.smithi043.stderr:2021-03-24T12:03:33.633+0000 7f65ed222d80 -1 osd.1 0 log_to_monitors {default=true} 2021-03-24T12:03:33.874 INFO:tasks.ceph.c1.osd.0.smithi043.stderr:2021-03-24T12:03:33.873+0000 7fade771ad80 -1 osd.0 0 log_to_monitors {default=true} 2021-03-24T12:03:33.904 INFO:tasks.ceph.c1.osd.2.smithi043.stderr:2021-03-24T12:03:33.905+0000 7f6d48693d80 -1 osd.2 0 log_to_monitors {default=true} 2021-03-24T12:03:35.430 INFO:tasks.ceph.c1.osd.0.smithi043.stderr:2021-03-24T12:03:35.429+0000 7fadd1166700 -1 osd.0 0 waiting for initial osdmap 2021-03-24T12:03:35.430 INFO:tasks.ceph.c1.osd.1.smithi043.stderr:2021-03-24T12:03:35.429+0000 7f65d6c6e700 -1 osd.1 0 waiting for initial osdmap 2021-03-24T12:03:35.431 INFO:tasks.ceph.c1.osd.2.smithi043.stderr:2021-03-24T12:03:35.429+0000 7f6d320df700 -1 osd.2 0 waiting for initial osdmap 2021-03-24T12:03:39.467 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2021-03-24T12:03:39.738 INFO:teuthology.misc.health.smithi043.stdout: 2021-03-24T12:03:39.738 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":10,"fsid":"3062b607-a1e8-4f4b-a177-1faaa107d417","created":"2021-03-24T12:03:31.403950+0000","modified":"2021-03-24T12:03:38.441324+0000","last_up_change":"2021-03-24T12:03:36.429383+0000","last_in_change":"2021-03-24T12:03:36.429383+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-24T12:03:35.392275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"abb01019-3bf7-406c-a774-96e790c18122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":12885},{"type":"v1","addr":"172.21.15.43:6809","nonce":12885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":12885},{"type":"v1","addr":"172.21.15.43:6811","nonce":12885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":12885},{"type":"v1","addr":"172.21.15.43:6815","nonce":12885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":12885},{"type":"v1","addr":"172.21.15.43:6813","nonce":12885}]},"public_addr":"172.21.15.43:6809/12885","cluster_addr":"172.21.15.43:6811/12885","heartbeat_back_addr":"172.21.15.43:6815/12885","heartbeat_front_addr":"172.21.15.43:6813/12885","state":["exists","up"]},{"osd":1,"uuid":"e788290b-159f-48cc-b46b-5d0abc86fa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":8,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":12886},{"type":"v1","addr":"172.21.15.43:6801","nonce":12886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":12886},{"type":"v1","addr":"172.21.15.43:6803","nonce":12886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":12886},{"type":"v1","addr":"172.21.15.43:6807","nonce":12886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":12886},{"type":"v1","addr":"172.21.15.43:6805","nonce":12886}]},"public_addr":"172.21.15.43:6801/12886","cluster_addr":"172.21.15.43:6803/12886","heartbeat_back_addr":"172.21.15.43:6807/12886","heartbeat_front_addr":"172.21.15.43:6805/12886","state":["exists","up"]},{"osd":2,"uuid":"e83e73c9-b6c4-489e-b522-c91942ee5823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":12887},{"type":"v1","addr":"172.21.15.43:6817","nonce":12887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":12887},{"type":"v1","addr":"172.21.15.43:6819","nonce":12887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":12887},{"type":"v1","addr":"172.21.15.43:6823","nonce":12887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":12887},{"type":"v1","addr":"172.21.15.43:6821","nonce":12887}]},"public_addr":"172.21.15.43:6817/12887","cluster_addr":"172.21.15.43:6819/12887","heartbeat_back_addr":"172.21.15.43:6823/12887","heartbeat_front_addr":"172.21.15.43:6821/12887","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:03:34.895653+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:03:34.602648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:03:34.871834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-24T12:03:39.751 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-03-24T12:03:39.752 INFO:tasks.ceph:Creating RBD pool 2021-03-24T12:03:39.752 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster c1 osd pool create rbd 8 2021-03-24T12:03:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'rbd' created 2021-03-24T12:03:40.482 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster c1 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-03-24T12:03:41.478 INFO:teuthology.orchestra.run.smithi043.stderr:enabled application 'rbd' on pool 'rbd' 2021-03-24T12:03:41.490 INFO:tasks.ceph:Starting mds daemons in cluster c1... 2021-03-24T12:03:41.491 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2021-03-24T12:03:41.492 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-03-24T12:03:41.777 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:41.837 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":12,"fsid":"3062b607-a1e8-4f4b-a177-1faaa107d417","created":"2021-03-24T12:03:31.403950+0000","modified":"2021-03-24T12:03:41.461348+0000","last_up_change":"2021-03-24T12:03:36.429383+0000","last_in_change":"2021-03-24T12:03:36.429383+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-24T12:03:35.392275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-24T12:03:40.077199+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"abb01019-3bf7-406c-a774-96e790c18122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":12885},{"type":"v1","addr":"172.21.15.43:6809","nonce":12885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":12885},{"type":"v1","addr":"172.21.15.43:6811","nonce":12885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":12885},{"type":"v1","addr":"172.21.15.43:6815","nonce":12885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":12885},{"type":"v1","addr":"172.21.15.43:6813","nonce":12885}]},"public_addr":"172.21.15.43:6809/12885","cluster_addr":"172.21.15.43:6811/12885","heartbeat_back_addr":"172.21.15.43:6815/12885","heartbeat_front_addr":"172.21.15.43:6813/12885","state":["exists","up"]},{"osd":1,"uuid":"e788290b-159f-48cc-b46b-5d0abc86fa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":12886},{"type":"v1","addr":"172.21.15.43:6801","nonce":12886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":12886},{"type":"v1","addr":"172.21.15.43:6803","nonce":12886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":12886},{"type":"v1","addr":"172.21.15.43:6807","nonce":12886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":12886},{"type":"v1","addr":"172.21.15.43:6805","nonce":12886}]},"public_addr":"172.21.15.43:6801/12886","cluster_addr":"172.21.15.43:6803/12886","heartbeat_back_addr":"172.21.15.43:6807/12886","heartbeat_front_addr":"172.21.15.43:6805/12886","state":["exists","up"]},{"osd":2,"uuid":"e83e73c9-b6c4-489e-b522-c91942ee5823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":12887},{"type":"v1","addr":"172.21.15.43:6817","nonce":12887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":12887},{"type":"v1","addr":"172.21.15.43:6819","nonce":12887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":12887},{"type":"v1","addr":"172.21.15.43:6823","nonce":12887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":12887},{"type":"v1","addr":"172.21.15.43:6821","nonce":12887}]},"public_addr":"172.21.15.43:6817/12887","cluster_addr":"172.21.15.43:6819/12887","heartbeat_back_addr":"172.21.15.43:6823/12887","heartbeat_front_addr":"172.21.15.43:6821/12887","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:03:34.895653+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:03:34.602648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:03:34.871834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-24T12:03:41.839 INFO:tasks.ceph.ceph_manager.c1:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-24T12:03:35.392275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-24T12:03:40.077199+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-03-24T12:03:41.840 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd pool get device_health_metrics pg_num 2021-03-24T12:03:42.119 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2021-03-24T12:03:42.139 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd pool get rbd pg_num 2021-03-24T12:03:42.416 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2021-03-24T12:03:42.431 INFO:tasks.ceph:Waiting until c1 daemons up and pgs clean... 2021-03-24T12:03:42.431 INFO:tasks.ceph.ceph_manager.c1:waiting for mgr available 2021-03-24T12:03:42.432 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 mgr dump --format=json 2021-03-24T12:03:42.746 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:42.760 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":4,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":12694},{"type":"v1","addr":"172.21.15.43:6825","nonce":12694}]},"active_addr":"172.21.15.43:6825/12694","active_change":"2021-03-24T12:03:35.273493+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":3787188205}]},{"addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":3371566738}]},{"addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":3280280883}]}]}} 2021-03-24T12:03:42.769 INFO:tasks.ceph.ceph_manager.c1:mgr available! 2021-03-24T12:03:42.769 INFO:tasks.ceph.ceph_manager.c1:waiting for all up 2021-03-24T12:03:42.770 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2021-03-24T12:03:43.045 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:43.046 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":13,"fsid":"3062b607-a1e8-4f4b-a177-1faaa107d417","created":"2021-03-24T12:03:31.403950+0000","modified":"2021-03-24T12:03:42.465827+0000","last_up_change":"2021-03-24T12:03:36.429383+0000","last_in_change":"2021-03-24T12:03:36.429383+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-24T12:03:35.392275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-24T12:03:40.077199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"abb01019-3bf7-406c-a774-96e790c18122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":12885},{"type":"v1","addr":"172.21.15.43:6809","nonce":12885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":12885},{"type":"v1","addr":"172.21.15.43:6811","nonce":12885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":12885},{"type":"v1","addr":"172.21.15.43:6815","nonce":12885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":12885},{"type":"v1","addr":"172.21.15.43:6813","nonce":12885}]},"public_addr":"172.21.15.43:6809/12885","cluster_addr":"172.21.15.43:6811/12885","heartbeat_back_addr":"172.21.15.43:6815/12885","heartbeat_front_addr":"172.21.15.43:6813/12885","state":["exists","up"]},{"osd":1,"uuid":"e788290b-159f-48cc-b46b-5d0abc86fa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":12886},{"type":"v1","addr":"172.21.15.43:6801","nonce":12886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":12886},{"type":"v1","addr":"172.21.15.43:6803","nonce":12886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":12886},{"type":"v1","addr":"172.21.15.43:6807","nonce":12886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":12886},{"type":"v1","addr":"172.21.15.43:6805","nonce":12886}]},"public_addr":"172.21.15.43:6801/12886","cluster_addr":"172.21.15.43:6803/12886","heartbeat_back_addr":"172.21.15.43:6807/12886","heartbeat_front_addr":"172.21.15.43:6805/12886","state":["exists","up"]},{"osd":2,"uuid":"e83e73c9-b6c4-489e-b522-c91942ee5823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":12887},{"type":"v1","addr":"172.21.15.43:6817","nonce":12887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":12887},{"type":"v1","addr":"172.21.15.43:6819","nonce":12887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":12887},{"type":"v1","addr":"172.21.15.43:6823","nonce":12887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":12887},{"type":"v1","addr":"172.21.15.43:6821","nonce":12887}]},"public_addr":"172.21.15.43:6817/12887","cluster_addr":"172.21.15.43:6819/12887","heartbeat_back_addr":"172.21.15.43:6823/12887","heartbeat_front_addr":"172.21.15.43:6821/12887","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:03:34.895653+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:03:34.602648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:03:34.871834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-24T12:03:43.060 INFO:tasks.ceph.ceph_manager.c1:all up! 2021-03-24T12:03:43.061 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2021-03-24T12:03:43.331 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:43.470 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":13,"fsid":"3062b607-a1e8-4f4b-a177-1faaa107d417","created":"2021-03-24T12:03:31.403950+0000","modified":"2021-03-24T12:03:42.465827+0000","last_up_change":"2021-03-24T12:03:36.429383+0000","last_in_change":"2021-03-24T12:03:36.429383+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-24T12:03:35.392275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-24T12:03:40.077199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"abb01019-3bf7-406c-a774-96e790c18122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":12885},{"type":"v1","addr":"172.21.15.43:6809","nonce":12885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":12885},{"type":"v1","addr":"172.21.15.43:6811","nonce":12885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":12885},{"type":"v1","addr":"172.21.15.43:6815","nonce":12885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":12885},{"type":"v1","addr":"172.21.15.43:6813","nonce":12885}]},"public_addr":"172.21.15.43:6809/12885","cluster_addr":"172.21.15.43:6811/12885","heartbeat_back_addr":"172.21.15.43:6815/12885","heartbeat_front_addr":"172.21.15.43:6813/12885","state":["exists","up"]},{"osd":1,"uuid":"e788290b-159f-48cc-b46b-5d0abc86fa76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":12886},{"type":"v1","addr":"172.21.15.43:6801","nonce":12886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":12886},{"type":"v1","addr":"172.21.15.43:6803","nonce":12886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":12886},{"type":"v1","addr":"172.21.15.43:6807","nonce":12886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":12886},{"type":"v1","addr":"172.21.15.43:6805","nonce":12886}]},"public_addr":"172.21.15.43:6801/12886","cluster_addr":"172.21.15.43:6803/12886","heartbeat_back_addr":"172.21.15.43:6807/12886","heartbeat_front_addr":"172.21.15.43:6805/12886","state":["exists","up"]},{"osd":2,"uuid":"e83e73c9-b6c4-489e-b522-c91942ee5823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":12887},{"type":"v1","addr":"172.21.15.43:6817","nonce":12887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":12887},{"type":"v1","addr":"172.21.15.43:6819","nonce":12887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":12887},{"type":"v1","addr":"172.21.15.43:6823","nonce":12887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":12887},{"type":"v1","addr":"172.21.15.43:6821","nonce":12887}]},"public_addr":"172.21.15.43:6817/12887","cluster_addr":"172.21.15.43:6819/12887","heartbeat_back_addr":"172.21.15.43:6823/12887","heartbeat_front_addr":"172.21.15.43:6821/12887","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:03:34.895653+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:03:34.602648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:03:34.871834+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-24T12:03:43.472 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.0 flush_pg_stats 2021-03-24T12:03:43.637 INFO:teuthology.orchestra.run.smithi043.stdout:34359738371 2021-03-24T12:03:43.638 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.1 flush_pg_stats 2021-03-24T12:03:43.802 INFO:teuthology.orchestra.run.smithi043.stdout:34359738371 2021-03-24T12:03:43.803 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.2 flush_pg_stats 2021-03-24T12:03:43.968 INFO:teuthology.orchestra.run.smithi043.stdout:34359738372 2021-03-24T12:03:43.969 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2021-03-24T12:03:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:34359738370 2021-03-24T12:03:44.265 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738371 got 34359738370 for osd.0 2021-03-24T12:03:45.269 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2021-03-24T12:03:45.560 INFO:teuthology.orchestra.run.smithi043.stdout:34359738371 2021-03-24T12:03:45.575 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738371 got 34359738371 for osd.0 2021-03-24T12:03:45.577 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.1 2021-03-24T12:03:45.852 INFO:teuthology.orchestra.run.smithi043.stdout:34359738371 2021-03-24T12:03:45.866 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738371 got 34359738371 for osd.1 2021-03-24T12:03:45.866 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.2 2021-03-24T12:03:46.136 INFO:teuthology.orchestra.run.smithi043.stdout:34359738372 2021-03-24T12:03:46.196 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738372 got 34359738372 for osd.2 2021-03-24T12:03:46.197 INFO:tasks.ceph.ceph_manager.c1:waiting for clean 2021-03-24T12:03:46.197 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2021-03-24T12:03:46.477 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:46.479 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2021-03-24T12:03:46.491 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2021-03-24T12:03:45.285074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146080,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426720,"statfs":{"total":322122547200,"available":318900961280,"internally_reserved":3221225472,"allocated":335872,"data_stored":95895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.816889"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.483676+0000","last_change":"2021-03-24T12:03:41.482733+0000","last_active":"2021-03-24T12:03:41.483676+0000","last_peered":"2021-03-24T12:03:41.483676+0000","last_clean":"2021-03-24T12:03:41.483676+0000","last_became_active":"2021-03-24T12:03:41.482304+0000","last_became_peered":"2021-03-24T12:03:41.482304+0000","last_unstale":"2021-03-24T12:03:41.483676+0000","last_undegraded":"2021-03-24T12:03:41.483676+0000","last_fullsized":"2021-03-24T12:03:41.483676+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_clean_scrub_stamp":"2021-03-24T12:03:40.454127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.483943+0000","last_change":"2021-03-24T12:03:41.483114+0000","last_active":"2021-03-24T12:03:41.483943+0000","last_peered":"2021-03-24T12:03:41.483943+0000","last_clean":"2021-03-24T12:03:41.483943+0000","last_became_active":"2021-03-24T12:03:41.482703+0000","last_became_peered":"2021-03-24T12:03:41.482703+0000","last_unstale":"2021-03-24T12:03:41.483943+0000","last_undegraded":"2021-03-24T12:03:41.483943+0000","last_fullsized":"2021-03-24T12:03:41.483943+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_clean_scrub_stamp":"2021-03-24T12:03:40.454127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.483651+0000","last_change":"2021-03-24T12:03:41.482444+0000","last_active":"2021-03-24T12:03:41.483651+0000","last_peered":"2021-03-24T12:03:41.483651+0000","last_clean":"2021-03-24T12:03:41.483651+0000","last_became_active":"2021-03-24T12:03:41.481989+0000","last_became_peered":"2021-03-24T12:03:41.481989+0000","last_unstale":"2021-03-24T12:03:41.483651+0000","last_undegraded":"2021-03-24T12:03:41.483651+0000","last_fullsized":"2021-03-24T12:03:41.483651+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_clean_scrub_stamp":"2021-03-24T12:03:40.454127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.477970+0000","last_change":"2021-03-24T12:03:41.476888+0000","last_active":"2021-03-24T12:03:41.477970+0000","last_peered":"2021-03-24T12:03:41.477970+0000","last_clean":"2021-03-24T12:03:41.477970+0000","last_became_active":"2021-03-24T12:03:41.476340+0000","last_became_peered":"2021-03-24T12:03:41.476340+0000","last_unstale":"2021-03-24T12:03:41.477970+0000","last_undegraded":"2021-03-24T12:03:41.477970+0000","last_fullsized":"2021-03-24T12:03:41.477970+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_clean_scrub_stamp":"2021-03-24T12:03:40.454127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"9'1","reported_seq":"13","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.475695+0000","last_change":"2021-03-24T12:03:37.885270+0000","last_active":"2021-03-24T12:03:41.475695+0000","last_peered":"2021-03-24T12:03:41.475695+0000","last_clean":"2021-03-24T12:03:41.475695+0000","last_became_active":"2021-03-24T12:03:37.883760+0000","last_became_peered":"2021-03-24T12:03:37.883760+0000","last_unstale":"2021-03-24T12:03:41.475695+0000","last_undegraded":"2021-03-24T12:03:41.475695+0000","last_fullsized":"2021-03-24T12:03:41.475695+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:35.423489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:35.423489+0000","last_clean_scrub_stamp":"2021-03-24T12:03:35.423489+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.481422+0000","last_change":"2021-03-24T12:03:41.480482+0000","last_active":"2021-03-24T12:03:41.481422+0000","last_peered":"2021-03-24T12:03:41.481422+0000","last_clean":"2021-03-24T12:03:41.481422+0000","last_became_active":"2021-03-24T12:03:41.479937+0000","last_became_peered":"2021-03-24T12:03:41.479937+0000","last_unstale":"2021-03-24T12:03:41.481422+0000","last_undegraded":"2021-03-24T12:03:41.481422+0000","last_fullsized":"2021-03-24T12:03:41.481422+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_clean_scrub_stamp":"2021-03-24T12:03:40.454127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.479365+0000","last_change":"2021-03-24T12:03:41.478594+0000","last_active":"2021-03-24T12:03:41.479365+0000","last_peered":"2021-03-24T12:03:41.479365+0000","last_clean":"2021-03-24T12:03:41.479365+0000","last_became_active":"2021-03-24T12:03:41.478160+0000","last_became_peered":"2021-03-24T12:03:41.478160+0000","last_unstale":"2021-03-24T12:03:41.479365+0000","last_undegraded":"2021-03-24T12:03:41.479365+0000","last_fullsized":"2021-03-24T12:03:41.479365+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_clean_scrub_stamp":"2021-03-24T12:03:40.454127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.482088+0000","last_change":"2021-03-24T12:03:41.480005+0000","last_active":"2021-03-24T12:03:41.482088+0000","last_peered":"2021-03-24T12:03:41.482088+0000","last_clean":"2021-03-24T12:03:41.482088+0000","last_became_active":"2021-03-24T12:03:41.479466+0000","last_became_peered":"2021-03-24T12:03:41.479466+0000","last_unstale":"2021-03-24T12:03:41.482088+0000","last_undegraded":"2021-03-24T12:03:41.482088+0000","last_fullsized":"2021-03-24T12:03:41.482088+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_clean_scrub_stamp":"2021-03-24T12:03:40.454127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.481431+0000","last_change":"2021-03-24T12:03:41.480455+0000","last_active":"2021-03-24T12:03:41.481431+0000","last_peered":"2021-03-24T12:03:41.481431+0000","last_clean":"2021-03-24T12:03:41.481431+0000","last_became_active":"2021-03-24T12:03:41.479909+0000","last_became_peered":"2021-03-24T12:03:41.479909+0000","last_unstale":"2021-03-24T12:03:41.481431+0000","last_undegraded":"2021-03-24T12:03:41.481431+0000","last_fullsized":"2021-03-24T12:03:41.481431+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_clean_scrub_stamp":"2021-03-24T12:03:40.454127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":33136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808912,"statfs":{"total":107374182400,"available":106300325888,"internally_reserved":1073741824,"allocated":106496,"data_stored":29623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":33136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]}]}} 2021-03-24T12:03:46.492 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2021-03-24T12:03:46.764 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:46.766 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2021-03-24T12:03:46.781 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2021-03-24T12:03:45.285074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146080,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426720,"statfs":{"total":322122547200,"available":318900961280,"internally_reserved":3221225472,"allocated":335872,"data_stored":95895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.816889"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.483676+0000","last_change":"2021-03-24T12:03:41.482733+0000","last_active":"2021-03-24T12:03:41.483676+0000","last_peered":"2021-03-24T12:03:41.483676+0000","last_clean":"2021-03-24T12:03:41.483676+0000","last_became_active":"2021-03-24T12:03:41.482304+0000","last_became_peered":"2021-03-24T12:03:41.482304+0000","last_unstale":"2021-03-24T12:03:41.483676+0000","last_undegraded":"2021-03-24T12:03:41.483676+0000","last_fullsized":"2021-03-24T12:03:41.483676+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_clean_scrub_stamp":"2021-03-24T12:03:40.454127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.483943+0000","last_change":"2021-03-24T12:03:41.483114+0000","last_active":"2021-03-24T12:03:41.483943+0000","last_peered":"2021-03-24T12:03:41.483943+0000","last_clean":"2021-03-24T12:03:41.483943+0000","last_became_active":"2021-03-24T12:03:41.482703+0000","last_became_peered":"2021-03-24T12:03:41.482703+0000","last_unstale":"2021-03-24T12:03:41.483943+0000","last_undegraded":"2021-03-24T12:03:41.483943+0000","last_fullsized":"2021-03-24T12:03:41.483943+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_clean_scrub_stamp":"2021-03-24T12:03:40.454127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.483651+0000","last_change":"2021-03-24T12:03:41.482444+0000","last_active":"2021-03-24T12:03:41.483651+0000","last_peered":"2021-03-24T12:03:41.483651+0000","last_clean":"2021-03-24T12:03:41.483651+0000","last_became_active":"2021-03-24T12:03:41.481989+0000","last_became_peered":"2021-03-24T12:03:41.481989+0000","last_unstale":"2021-03-24T12:03:41.483651+0000","last_undegraded":"2021-03-24T12:03:41.483651+0000","last_fullsized":"2021-03-24T12:03:41.483651+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_clean_scrub_stamp":"2021-03-24T12:03:40.454127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.477970+0000","last_change":"2021-03-24T12:03:41.476888+0000","last_active":"2021-03-24T12:03:41.477970+0000","last_peered":"2021-03-24T12:03:41.477970+0000","last_clean":"2021-03-24T12:03:41.477970+0000","last_became_active":"2021-03-24T12:03:41.476340+0000","last_became_peered":"2021-03-24T12:03:41.476340+0000","last_unstale":"2021-03-24T12:03:41.477970+0000","last_undegraded":"2021-03-24T12:03:41.477970+0000","last_fullsized":"2021-03-24T12:03:41.477970+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_clean_scrub_stamp":"2021-03-24T12:03:40.454127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"9'1","reported_seq":"13","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.475695+0000","last_change":"2021-03-24T12:03:37.885270+0000","last_active":"2021-03-24T12:03:41.475695+0000","last_peered":"2021-03-24T12:03:41.475695+0000","last_clean":"2021-03-24T12:03:41.475695+0000","last_became_active":"2021-03-24T12:03:37.883760+0000","last_became_peered":"2021-03-24T12:03:37.883760+0000","last_unstale":"2021-03-24T12:03:41.475695+0000","last_undegraded":"2021-03-24T12:03:41.475695+0000","last_fullsized":"2021-03-24T12:03:41.475695+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:35.423489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:35.423489+0000","last_clean_scrub_stamp":"2021-03-24T12:03:35.423489+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.481422+0000","last_change":"2021-03-24T12:03:41.480482+0000","last_active":"2021-03-24T12:03:41.481422+0000","last_peered":"2021-03-24T12:03:41.481422+0000","last_clean":"2021-03-24T12:03:41.481422+0000","last_became_active":"2021-03-24T12:03:41.479937+0000","last_became_peered":"2021-03-24T12:03:41.479937+0000","last_unstale":"2021-03-24T12:03:41.481422+0000","last_undegraded":"2021-03-24T12:03:41.481422+0000","last_fullsized":"2021-03-24T12:03:41.481422+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_clean_scrub_stamp":"2021-03-24T12:03:40.454127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.479365+0000","last_change":"2021-03-24T12:03:41.478594+0000","last_active":"2021-03-24T12:03:41.479365+0000","last_peered":"2021-03-24T12:03:41.479365+0000","last_clean":"2021-03-24T12:03:41.479365+0000","last_became_active":"2021-03-24T12:03:41.478160+0000","last_became_peered":"2021-03-24T12:03:41.478160+0000","last_unstale":"2021-03-24T12:03:41.479365+0000","last_undegraded":"2021-03-24T12:03:41.479365+0000","last_fullsized":"2021-03-24T12:03:41.479365+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_clean_scrub_stamp":"2021-03-24T12:03:40.454127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.482088+0000","last_change":"2021-03-24T12:03:41.480005+0000","last_active":"2021-03-24T12:03:41.482088+0000","last_peered":"2021-03-24T12:03:41.482088+0000","last_clean":"2021-03-24T12:03:41.482088+0000","last_became_active":"2021-03-24T12:03:41.479466+0000","last_became_peered":"2021-03-24T12:03:41.479466+0000","last_unstale":"2021-03-24T12:03:41.482088+0000","last_undegraded":"2021-03-24T12:03:41.482088+0000","last_fullsized":"2021-03-24T12:03:41.482088+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_clean_scrub_stamp":"2021-03-24T12:03:40.454127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:03:41.481431+0000","last_change":"2021-03-24T12:03:41.480455+0000","last_active":"2021-03-24T12:03:41.481431+0000","last_peered":"2021-03-24T12:03:41.481431+0000","last_clean":"2021-03-24T12:03:41.481431+0000","last_became_active":"2021-03-24T12:03:41.479909+0000","last_became_peered":"2021-03-24T12:03:41.479909+0000","last_unstale":"2021-03-24T12:03:41.481431+0000","last_undegraded":"2021-03-24T12:03:41.481431+0000","last_fullsized":"2021-03-24T12:03:41.481431+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:03:40.454127+0000","last_clean_scrub_stamp":"2021-03-24T12:03:40.454127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":33136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808912,"statfs":{"total":107374182400,"available":106300325888,"internally_reserved":1073741824,"allocated":106496,"data_stored":29623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":33136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]}]}} 2021-03-24T12:03:46.782 INFO:tasks.ceph.ceph_manager.c1:clean! 2021-03-24T12:03:46.783 INFO:tasks.ceph:Waiting until ceph cluster c1 is healthy... 2021-03-24T12:03:46.783 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy 2021-03-24T12:03:46.783 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 health --format=json 2021-03-24T12:03:47.110 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:47.125 INFO:teuthology.orchestra.run.smithi043.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-03-24T12:03:47.125 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy done 2021-03-24T12:03:47.126 INFO:teuthology.run_tasks:Running task ceph... 2021-03-24T12:03:47.150 INFO:tasks.ceph:Creating ceph cluster c2... 2021-03-24T12:03:47.153 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'cpu_profile': set(), 'cluster': 'c2', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-03-24T12:03:47.153 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/sage-2021-03-24_06:13:24-upgrade:octopus-x-wip-sage-testing-2021-03-23-2309-distro-basic-smithi/5993444', 'branch': 'wip-sage-testing-2021-03-23-2309', 'description': 'upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary}', 'email': None, 'first_in_suite': False, 'job_id': '5993444', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'sage-2021-03-24_06:13:24-upgrade:octopus-x-wip-sage-testing-2021-03-23-2309-distro-basic-smithi', 'nuke-on-error': True, 'overrides': {'admin_socket': {'branch': 'wip-sage-testing-2021-03-23-2309'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '666a545dfbb7fc4fe7736e3c0e891b149a8ef286', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'branch': 'octopus', 'sha1': '666a545dfbb7fc4fe7736e3c0e891b149a8ef286'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}, {'endpoints': ['c2.client.1'], 'is_pubsub': True, 'name': 'test-zone3'}]}]}, 'rgw-multisite-tests': {'args': ['tests.py', 'tests_ps.py'], 'branch': 'octopus', 'repo': 'https://github.com/ceph/ceph.git'}, 'workunit': {'branch': 'wip-sage-testing-2021-03-23-2309', 'sha1': '666a545dfbb7fc4fe7736e3c0e891b149a8ef286'}}, 'owner': 'scheduled_sage@teuthology', 'priority': 80, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'], ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']], 'sha1': '666a545dfbb7fc4fe7736e3c0e891b149a8ef286', 'sleep_before_teardown': 0, 'suite': 'upgrade:octopus-x', 'suite_branch': 'wip-sage-testing-2021-03-23-2309', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_666a545dfbb7fc4fe7736e3c0e891b149a8ef286/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': '666a545dfbb7fc4fe7736e3c0e891b149a8ef286', 'targets': {'smithi043.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPhwa3ibD1YBedhMFWy21AHn5O5CkJVIxaAk1movRw/4oSozYwafJi7eXneOBVXVbNhh7vzPlBz0MOSGeHrnB2EJ8Kcr4pX1eow9pYcfIHANjeNCsu691x5o/cFPiU082fvdvUeW3RMzsynsWATcTDPbjTFmx00+67Hl/pdH7QIsdv+SYbYDehzSu/5911Cb7GkyXrXbiVgnch/5puAGqbBWuOHxMctOA90xWHYr7JcVIJuzaD6pbCoBbVCCdVablXMXZQZc9/KUz+ztnh8r8Q9ATlTN97FyxFVI/zRKxHtNECfXooY+wLX7bo9I13pT2PFd4tyfkd63qdwXL+IgPL', 'smithi161.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCaY1KZyL/Eub6ciQOfZ957YbBBCLIP6mYl/DzoNr02jwI6CUBSQdhU639DAVa0JXfjU4NmIQ53icIphzcgIZWp8HkCHbcGAeQpwsKjxSFWU2U3KkrVKypBqJxyF68bdH8Ul6PE6x91xOInzrdV6N3VYfrXLvox4njkEGgNhqGd/oPCtSJJqBc2NWqKolUTcVB/ltzFQPVB0jrjJhVzMMl34PuOPBwCw4pfs0+7Pf4K7Jq+uoZ1RM4rDYojkKB6q50EleDFOA+RZDSHComHd3t/ReRikRCZnb9TXfz4QFLb9q/HqahJcVVdEbH7Dvtq6m1LlC1ZqzFfrtl2ho+yvTbz'}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '666a545dfbb7fc4fe7736e3c0e891b149a8ef286', 'wait-for-scrub': False}}, {'ceph': {'cluster': 'c2', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '666a545dfbb7fc4fe7736e3c0e891b149a8ef286', 'wait-for-scrub': False}}, {'parallel': ['upgrade-task']}, {'rgw': {'c1.client.0': {'port': 8000}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 60}}}], 'teuthology_branch': 'master', 'teuthology_sha1': '6b3150e9e0aa7ca432e26f31d87920ebd77f3708', 'timestamp': '2021-03-24_06:13:24', 'tube': 'smithi', 'upgrade-task': [{'install.upgrade': {'c1.client.0': None, 'c1.mgr.x': None, 'c1.mon.a': None, 'c1.osd.0': None, 'c1.osd.1': None, 'c1.osd.2': None}}], 'user': 'sage', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.9855'} 2021-03-24T12:03:47.154 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2021-03-24T12:03:47.161 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2021-03-24T12:03:47.177 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/run/ceph 2021-03-24T12:03:47.222 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2021-03-24T12:03:47.241 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:47.242 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2021-03-24T12:03:47.290 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-03-24T12:03:47.291 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-03-24T12:03:47.344 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-03-24T12:03:47.345 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-24T12:03:47.345 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 341 Links: 1 2021-03-24T12:03:47.345 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-24T12:03:47.345 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2021-03-24 12:00:45.312575047 +0000 2021-03-24T12:03:47.346 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2021-03-24 12:00:45.176507071 +0000 2021-03-24T12:03:47.346 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2021-03-24 12:00:45.176507071 +0000 2021-03-24T12:03:47.346 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2021-03-24T12:03:47.351 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2021-03-24T12:03:47.352 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2021-03-24T12:03:47.352 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000381444 s, 1.3 MB/s 2021-03-24T12:03:47.357 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-03-24T12:03:47.417 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-03-24T12:03:47.417 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-24T12:03:47.418 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 348 Links: 1 2021-03-24T12:03:47.418 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-24T12:03:47.419 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2021-03-24 12:00:45.600718995 +0000 2021-03-24T12:03:47.419 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2021-03-24 12:00:45.456647021 +0000 2021-03-24T12:03:47.420 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2021-03-24 12:00:45.456647021 +0000 2021-03-24T12:03:47.420 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2021-03-24T12:03:47.432 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2021-03-24T12:03:47.432 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2021-03-24T12:03:47.433 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000328874 s, 1.6 MB/s 2021-03-24T12:03:47.434 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-03-24T12:03:47.482 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-03-24T12:03:47.483 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-24T12:03:47.483 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 354 Links: 1 2021-03-24T12:03:47.484 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-24T12:03:47.484 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2021-03-24 12:00:45.856846950 +0000 2021-03-24T12:03:47.484 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2021-03-24 12:00:45.724780973 +0000 2021-03-24T12:03:47.485 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2021-03-24 12:00:45.724780973 +0000 2021-03-24T12:03:47.485 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2021-03-24T12:03:47.492 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2021-03-24T12:03:47.492 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2021-03-24T12:03:47.493 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000383235 s, 1.3 MB/s 2021-03-24T12:03:47.497 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-03-24T12:03:47.548 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-03-24T12:03:47.549 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-24T12:03:47.550 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-03-24T12:03:47.550 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-24T12:03:47.550 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2021-03-24 12:00:46.136986900 +0000 2021-03-24T12:03:47.551 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2021-03-24 12:00:46.012924922 +0000 2021-03-24T12:03:47.551 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2021-03-24 12:00:46.012924922 +0000 2021-03-24T12:03:47.552 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2021-03-24T12:03:47.558 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2021-03-24T12:03:47.559 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2021-03-24T12:03:47.559 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.00038067 s, 1.3 MB/s 2021-03-24T12:03:47.564 INFO:tasks.ceph:osd dev map: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-03-24T12:03:47.564 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-03-24T12:03:47.565 INFO:tasks.ceph:Generating config... 2021-03-24T12:03:47.579 INFO:tasks.ceph:[client] debug rgw = 20 2021-03-24T12:03:47.579 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2021-03-24T12:03:47.580 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2021-03-24T12:03:47.582 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-03-24T12:03:47.583 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2021-03-24T12:03:47.583 INFO:tasks.ceph:[client] rgw data log num shards = 4 2021-03-24T12:03:47.584 INFO:tasks.ceph:[client] rgw md log max shards = 4 2021-03-24T12:03:47.585 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2021-03-24T12:03:47.585 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2021-03-24T12:03:47.586 INFO:tasks.ceph:[client] setgroup = ceph 2021-03-24T12:03:47.587 INFO:tasks.ceph:[client] setuser = ceph 2021-03-24T12:03:47.587 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-03-24T12:03:47.588 INFO:tasks.ceph:[mgr] debug ms = 1 2021-03-24T12:03:47.589 INFO:tasks.ceph:[mon] debug mon = 20 2021-03-24T12:03:47.589 INFO:tasks.ceph:[mon] debug ms = 1 2021-03-24T12:03:47.590 INFO:tasks.ceph:[mon] debug paxos = 20 2021-03-24T12:03:47.590 INFO:tasks.ceph:[osd] debug ms = 1 2021-03-24T12:03:47.591 INFO:tasks.ceph:[osd] debug osd = 20 2021-03-24T12:03:47.592 INFO:tasks.ceph:Setting up c2.mon.a... 2021-03-24T12:03:47.593 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c2.keyring 2021-03-24T12:03:47.655 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/c2.keyring 2021-03-24T12:03:47.656 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c2.keyring 2021-03-24T12:03:47.734 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-03-24T12:03:47.800 DEBUG:tasks.ceph:Ceph mon addresses: [('c2.mon.a', '172.21.15.161')] 2021-03-24T12:03:47.801 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.161'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2021-03-24T12:03:47.802 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:47.802 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-03-24T12:03:47.853 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.161 --print /home/ubuntu/cephtest/c2.monmap 2021-03-24T12:03:47.932 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:03:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:03:47.934 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c2.monmap 2021-03-24T12:03:47.934 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: generated fsid 8d28c960-ef5d-422b-b511-3f5fa3a0509e 2021-03-24T12:03:47.935 INFO:teuthology.orchestra.run.smithi161.stdout:epoch 0 2021-03-24T12:03:47.935 INFO:teuthology.orchestra.run.smithi161.stdout:fsid 8d28c960-ef5d-422b-b511-3f5fa3a0509e 2021-03-24T12:03:47.935 INFO:teuthology.orchestra.run.smithi161.stdout:last_changed 2021-03-24T12:03:47.930314+0000 2021-03-24T12:03:47.935 INFO:teuthology.orchestra.run.smithi161.stdout:created 2021-03-24T12:03:47.930314+0000 2021-03-24T12:03:47.936 INFO:teuthology.orchestra.run.smithi161.stdout:min_mon_release 0 (unknown) 2021-03-24T12:03:47.936 INFO:teuthology.orchestra.run.smithi161.stdout:0: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.a 2021-03-24T12:03:47.936 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c2.monmap (1 monitors) 2021-03-24T12:03:47.936 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-03-24T12:03:47.983 INFO:tasks.ceph:Writing /etc/ceph/c2.conf for FSID 8d28c960-ef5d-422b-b511-3f5fa3a0509e... 2021-03-24T12:03:47.985 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2021-03-24T12:03:47.987 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2021-03-24T12:03:48.032 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2021-03-24T12:03:48.033 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2021-03-24T12:03:48.033 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-03-24T12:03:48.033 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2021-03-24T12:03:48.033 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.033 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2021-03-24T12:03:48.034 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.034 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2021-03-24T12:03:48.034 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.034 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2021-03-24T12:03:48.035 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2021-03-24T12:03:48.035 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.035 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2021-03-24T12:03:48.035 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2021-03-24T12:03:48.036 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.036 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2021-03-24T12:03:48.036 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2021-03-24T12:03:48.036 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.037 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2021-03-24T12:03:48.037 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2021-03-24T12:03:48.037 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.038 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2021-03-24T12:03:48.039 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.039 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2021-03-24T12:03:48.039 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2021-03-24T12:03:48.040 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2021-03-24T12:03:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2021-03-24T12:03:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2021-03-24T12:03:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2021-03-24T12:03:48.041 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2021-03-24T12:03:48.042 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-03-24T12:03:48.042 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2021-03-24T12:03:48.042 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2021-03-24T12:03:48.042 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.043 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-03-24T12:03:48.043 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.043 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2021-03-24T12:03:48.044 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.045 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2021-03-24T12:03:48.045 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.045 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2021-03-24T12:03:48.046 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2021-03-24T12:03:48.046 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2021-03-24T12:03:48.046 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = 172.21.15.161 2021-03-24T12:03:48.046 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = 8d28c960-ef5d-422b-b511-3f5fa3a0509e 2021-03-24T12:03:48.047 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.047 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2021-03-24T12:03:48.047 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2021-03-24T12:03:48.047 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.048 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2021-03-24T12:03:48.048 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2021-03-24T12:03:48.048 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.048 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2021-03-24T12:03:48.048 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2021-03-24T12:03:48.049 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.049 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2021-03-24T12:03:48.049 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2021-03-24T12:03:48.049 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2021-03-24T12:03:48.050 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.050 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2021-03-24T12:03:48.050 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2021-03-24T12:03:48.050 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.050 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2021-03-24T12:03:48.051 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.051 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2021-03-24T12:03:48.051 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.051 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2021-03-24T12:03:48.052 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.052 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2021-03-24T12:03:48.052 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2021-03-24T12:03:48.052 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.052 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2021-03-24T12:03:48.053 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2021-03-24T12:03:48.053 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2021-03-24T12:03:48.053 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2021-03-24T12:03:48.053 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.054 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2021-03-24T12:03:48.054 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2021-03-24T12:03:48.054 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2021-03-24T12:03:48.055 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2021-03-24T12:03:48.055 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2021-03-24T12:03:48.056 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2021-03-24T12:03:48.056 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2021-03-24T12:03:48.056 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2021-03-24T12:03:48.057 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.057 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2021-03-24T12:03:48.057 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2021-03-24T12:03:48.057 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2021-03-24T12:03:48.058 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2021-03-24T12:03:48.058 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2021-03-24T12:03:48.058 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2021-03-24T12:03:48.058 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2021-03-24T12:03:48.059 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2021-03-24T12:03:48.059 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2021-03-24T12:03:48.059 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2021-03-24T12:03:48.059 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2021-03-24T12:03:48.059 INFO:teuthology.orchestra.run.smithi043.stdout: 2021-03-24T12:03:48.060 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2021-03-24T12:03:48.060 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2021-03-24T12:03:48.060 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2021-03-24T12:03:48.060 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2021-03-24T12:03:48.061 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-03-24T12:03:48.061 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-03-24T12:03:48.061 INFO:teuthology.orchestra.run.smithi043.stdout: debug rgw = 20 2021-03-24T12:03:48.061 INFO:teuthology.orchestra.run.smithi043.stdout: rgw crypt require ssl = False 2021-03-24T12:03:48.078 INFO:teuthology.orchestra.run.smithi043.stdout: rgw crypt s3 kms backend = testing 2021-03-24T12:03:48.078 INFO:teuthology.orchestra.run.smithi043.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-03-24T12:03:48.079 INFO:teuthology.orchestra.run.smithi043.stdout: rgw curl low speed time = 300 2021-03-24T12:03:48.080 INFO:teuthology.orchestra.run.smithi043.stdout: rgw data log num shards = 4 2021-03-24T12:03:48.080 INFO:teuthology.orchestra.run.smithi043.stdout: rgw md log max shards = 4 2021-03-24T12:03:48.081 INFO:teuthology.orchestra.run.smithi043.stdout: rgw sync log trim interval = 0 2021-03-24T12:03:48.081 INFO:teuthology.orchestra.run.smithi043.stdout: rgw sync obj etag verify = True 2021-03-24T12:03:48.081 INFO:teuthology.orchestra.run.smithi043.stdout: setgroup = ceph 2021-03-24T12:03:48.082 INFO:teuthology.orchestra.run.smithi043.stdout: setuser = ceph 2021-03-24T12:03:48.082 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2021-03-24T12:03:48.086 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2021-03-24T12:03:48.086 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2021-03-24T12:03:48.087 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-03-24T12:03:48.087 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2021-03-24T12:03:48.088 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.088 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2021-03-24T12:03:48.089 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.089 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2021-03-24T12:03:48.090 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.090 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2021-03-24T12:03:48.090 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2021-03-24T12:03:48.091 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.091 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2021-03-24T12:03:48.092 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2021-03-24T12:03:48.092 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.092 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2021-03-24T12:03:48.093 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2021-03-24T12:03:48.093 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.093 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2021-03-24T12:03:48.093 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2021-03-24T12:03:48.094 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.094 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2021-03-24T12:03:48.095 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.095 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2021-03-24T12:03:48.095 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2021-03-24T12:03:48.095 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2021-03-24T12:03:48.096 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2021-03-24T12:03:48.096 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2021-03-24T12:03:48.096 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2021-03-24T12:03:48.096 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2021-03-24T12:03:48.096 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-03-24T12:03:48.097 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2021-03-24T12:03:48.097 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2021-03-24T12:03:48.097 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.097 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-03-24T12:03:48.097 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.098 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2021-03-24T12:03:48.098 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.098 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2021-03-24T12:03:48.098 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.099 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2021-03-24T12:03:48.099 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2021-03-24T12:03:48.099 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2021-03-24T12:03:48.099 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = 172.21.15.161 2021-03-24T12:03:48.099 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = 8d28c960-ef5d-422b-b511-3f5fa3a0509e 2021-03-24T12:03:48.100 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.100 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2021-03-24T12:03:48.100 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2021-03-24T12:03:48.100 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.100 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2021-03-24T12:03:48.101 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2021-03-24T12:03:48.101 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.101 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2021-03-24T12:03:48.101 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2021-03-24T12:03:48.102 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.102 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2021-03-24T12:03:48.102 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2021-03-24T12:03:48.102 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2021-03-24T12:03:48.102 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.103 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2021-03-24T12:03:48.103 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2021-03-24T12:03:48.103 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.103 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2021-03-24T12:03:48.103 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.104 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2021-03-24T12:03:48.104 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.104 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2021-03-24T12:03:48.104 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.104 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2021-03-24T12:03:48.105 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2021-03-24T12:03:48.105 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.105 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2021-03-24T12:03:48.105 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2021-03-24T12:03:48.106 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-03-24T12:03:48.106 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2021-03-24T12:03:48.106 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.106 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2021-03-24T12:03:48.106 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-03-24T12:03:48.107 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2021-03-24T12:03:48.107 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2021-03-24T12:03:48.107 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2021-03-24T12:03:48.107 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2021-03-24T12:03:48.107 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2021-03-24T12:03:48.108 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2021-03-24T12:03:48.108 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.108 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2021-03-24T12:03:48.108 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2021-03-24T12:03:48.108 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2021-03-24T12:03:48.109 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2021-03-24T12:03:48.109 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2021-03-24T12:03:48.109 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2021-03-24T12:03:48.109 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2021-03-24T12:03:48.109 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2021-03-24T12:03:48.110 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2021-03-24T12:03:48.110 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2021-03-24T12:03:48.110 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2021-03-24T12:03:48.110 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:03:48.111 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2021-03-24T12:03:48.111 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2021-03-24T12:03:48.111 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2021-03-24T12:03:48.111 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2021-03-24T12:03:48.111 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-03-24T12:03:48.112 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-03-24T12:03:48.112 INFO:teuthology.orchestra.run.smithi161.stdout: debug rgw = 20 2021-03-24T12:03:48.112 INFO:teuthology.orchestra.run.smithi161.stdout: rgw crypt require ssl = False 2021-03-24T12:03:48.112 INFO:teuthology.orchestra.run.smithi161.stdout: rgw crypt s3 kms backend = testing 2021-03-24T12:03:48.112 INFO:teuthology.orchestra.run.smithi161.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-03-24T12:03:48.113 INFO:teuthology.orchestra.run.smithi161.stdout: rgw curl low speed time = 300 2021-03-24T12:03:48.113 INFO:teuthology.orchestra.run.smithi161.stdout: rgw data log num shards = 4 2021-03-24T12:03:48.113 INFO:teuthology.orchestra.run.smithi161.stdout: rgw md log max shards = 4 2021-03-24T12:03:48.113 INFO:teuthology.orchestra.run.smithi161.stdout: rgw sync log trim interval = 0 2021-03-24T12:03:48.113 INFO:teuthology.orchestra.run.smithi161.stdout: rgw sync obj etag verify = True 2021-03-24T12:03:48.114 INFO:teuthology.orchestra.run.smithi161.stdout: setgroup = ceph 2021-03-24T12:03:48.114 INFO:teuthology.orchestra.run.smithi161.stdout: setuser = ceph 2021-03-24T12:03:48.114 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2021-03-24T12:03:48.115 INFO:tasks.ceph:Creating admin key on c2.mon.a... 2021-03-24T12:03:48.115 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c2.keyring 2021-03-24T12:03:48.175 INFO:tasks.ceph:Copying monmap to all nodes... 2021-03-24T12:03:48.175 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:48.176 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/c2.keyring of=/dev/stdout 2021-03-24T12:03:48.182 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:48.182 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/home/ubuntu/cephtest/c2.monmap of=/dev/stdout 2021-03-24T12:03:48.235 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi043.front.sepia.ceph.com 2021-03-24T12:03:48.236 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:48.236 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/c2.keyring 2021-03-24T12:03:48.237 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-03-24T12:03:48.265 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:03:48.265 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/c2.monmap 2021-03-24T12:03:48.357 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2021-03-24T12:03:48.357 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:48.358 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/c2.keyring 2021-03-24T12:03:48.359 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-03-24T12:03:48.385 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:48.385 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/c2.monmap 2021-03-24T12:03:48.437 INFO:tasks.ceph:Setting up mon nodes... 2021-03-24T12:03:48.437 INFO:tasks.ceph:Setting up mgr nodes... 2021-03-24T12:03:48.438 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mgr/c2-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c2-x/keyring 2021-03-24T12:03:48.519 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mgr/c2-x/keyring 2021-03-24T12:03:48.522 INFO:tasks.ceph:Setting up mds nodes... 2021-03-24T12:03:48.522 INFO:tasks.ceph_client:Setting up client nodes... 2021-03-24T12:03:48.523 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c2.client.0.keyring && sudo chmod 0644 /etc/ceph/c2.client.0.keyring 2021-03-24T12:03:48.601 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/c2.client.0.keyring 2021-03-24T12:03:48.615 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/c2.client.1.keyring && sudo chmod 0644 /etc/ceph/c2.client.1.keyring 2021-03-24T12:03:48.696 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/c2.client.1.keyring 2021-03-24T12:03:48.706 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-03-24T12:03:48.707 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-03-24T12:03:48.707 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/c2-0 2021-03-24T12:03:48.763 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-03-24T12:03:48.763 INFO:tasks.ceph:role: c2.osd.0 2021-03-24T12:03:48.764 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com 2021-03-24T12:03:48.764 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-03-24T12:03:49.294 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-03-24T12:03:49.294 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-24T12:03:49.295 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-03-24T12:03:49.295 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-24T12:03:49.295 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2021-03-24T12:03:49.295 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-03-24T12:03:49.296 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-24T12:03:49.296 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-24T12:03:49.296 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-24T12:03:49.298 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2021-03-24T12:03:49.298 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c2-0 2021-03-24T12:03:49.378 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-0 2021-03-24T12:03:49.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-24T12:03:49.394 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2021-03-24T12:03:49.394 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/c2-1 2021-03-24T12:03:49.454 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-03-24T12:03:49.455 INFO:tasks.ceph:role: c2.osd.1 2021-03-24T12:03:49.456 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com 2021-03-24T12:03:49.457 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-03-24T12:03:49.967 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-03-24T12:03:49.968 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-24T12:03:49.968 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-03-24T12:03:49.968 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-24T12:03:49.968 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2021-03-24T12:03:49.969 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-03-24T12:03:49.969 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-24T12:03:49.969 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-24T12:03:49.969 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-24T12:03:49.970 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2021-03-24T12:03:49.971 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c2-1 2021-03-24T12:03:50.018 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-1 2021-03-24T12:03:50.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-24T12:03:50.073 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2021-03-24T12:03:50.074 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/c2-2 2021-03-24T12:03:50.134 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-03-24T12:03:50.135 INFO:tasks.ceph:role: c2.osd.2 2021-03-24T12:03:50.136 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com 2021-03-24T12:03:50.137 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-03-24T12:03:50.653 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-03-24T12:03:50.653 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2021-03-24T12:03:50.653 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-03-24T12:03:50.654 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-03-24T12:03:50.654 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2021-03-24T12:03:50.654 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-03-24T12:03:50.654 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-03-24T12:03:50.655 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-03-24T12:03:50.655 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-03-24T12:03:50.656 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2021-03-24T12:03:50.657 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c2-2 2021-03-24T12:03:50.704 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-2 2021-03-24T12:03:50.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-24T12:03:50.717 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2021-03-24T12:03:50.718 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c2.monmap 2021-03-24T12:03:50.869 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:50.868+0000 7f44ae089d80 -1 auth: error reading file: /var/lib/ceph/osd/c2-0/keyring: can't open /var/lib/ceph/osd/c2-0/keyring: (2) No such file or directory 2021-03-24T12:03:50.870 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:50.868+0000 7f44ae089d80 -1 created new key in keyring /var/lib/ceph/osd/c2-0/keyring 2021-03-24T12:03:50.870 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:50.868+0000 7f44ae089d80 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-03-24T12:03:50.871 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:50.868+0000 7f44ae089d80 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-03-24T12:03:50.871 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:50.868+0000 7f44ae089d80 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-03-24T12:03:50.871 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:50.872+0000 7f44ae089d80 -1 bluestore(/var/lib/ceph/osd/c2-0) _read_fsid unparsable uuid 2021-03-24T12:03:50.898 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:50.900+0000 7f44ae089d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-24T12:03:52.789 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-0 2021-03-24T12:03:52.907 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c2.monmap 2021-03-24T12:03:52.986 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:52.984+0000 7f21b38fdd80 -1 auth: error reading file: /var/lib/ceph/osd/c2-1/keyring: can't open /var/lib/ceph/osd/c2-1/keyring: (2) No such file or directory 2021-03-24T12:03:52.986 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:52.988+0000 7f21b38fdd80 -1 created new key in keyring /var/lib/ceph/osd/c2-1/keyring 2021-03-24T12:03:52.987 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:52.988+0000 7f21b38fdd80 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-03-24T12:03:52.987 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:52.988+0000 7f21b38fdd80 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-03-24T12:03:52.987 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:52.988+0000 7f21b38fdd80 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-03-24T12:03:52.988 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:52.988+0000 7f21b38fdd80 -1 bluestore(/var/lib/ceph/osd/c2-1) _read_fsid unparsable uuid 2021-03-24T12:03:53.002 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:53.004+0000 7f21b38fdd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-24T12:03:54.896 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-1 2021-03-24T12:03:54.957 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c2.monmap 2021-03-24T12:03:55.036 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:55.036+0000 7f42936d1d80 -1 auth: error reading file: /var/lib/ceph/osd/c2-2/keyring: can't open /var/lib/ceph/osd/c2-2/keyring: (2) No such file or directory 2021-03-24T12:03:55.037 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:55.036+0000 7f42936d1d80 -1 created new key in keyring /var/lib/ceph/osd/c2-2/keyring 2021-03-24T12:03:55.037 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:55.036+0000 7f42936d1d80 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-03-24T12:03:55.037 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:55.036+0000 7f42936d1d80 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-03-24T12:03:55.037 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:55.036+0000 7f42936d1d80 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-03-24T12:03:55.038 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:55.036+0000 7f42936d1d80 -1 bluestore(/var/lib/ceph/osd/c2-2) _read_fsid unparsable uuid 2021-03-24T12:03:55.052 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:03:55.052+0000 7f42936d1d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-24T12:03:56.956 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-2 2021-03-24T12:03:57.013 INFO:tasks.ceph:Reading keys from all nodes... 2021-03-24T12:03:57.013 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:57.014 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mgr/c2-x/keyring of=/dev/stdout 2021-03-24T12:03:57.070 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:57.071 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/c2-0/keyring of=/dev/stdout 2021-03-24T12:03:57.130 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:57.244 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/c2-1/keyring of=/dev/stdout 2021-03-24T12:03:57.259 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:57.260 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/c2-2/keyring of=/dev/stdout 2021-03-24T12:03:57.316 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:57.317 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/c2.client.0.keyring of=/dev/stdout 2021-03-24T12:03:57.363 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:57.364 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/c2.client.1.keyring of=/dev/stdout 2021-03-24T12:03:57.411 INFO:tasks.ceph:Adding keys to all mons... 2021-03-24T12:03:57.412 DEBUG:teuthology.orchestra.run.smithi161:> sudo tee -a /etc/ceph/c2.keyring 2021-03-24T12:03:57.466 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.x] 2021-03-24T12:03:57.466 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCkKltgUoQhHxAAx4GpGuYYlY2JC7CTBkNwjA== 2021-03-24T12:03:57.467 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.0] 2021-03-24T12:03:57.467 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCmKltgpzj4MxAA+nltZeGS7HouIXj18/qthQ== 2021-03-24T12:03:57.467 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.1] 2021-03-24T12:03:57.467 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCoKltg9kzqOhAAwCBN0Vh8WN9GuK7pYqSsIQ== 2021-03-24T12:03:57.468 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.2] 2021-03-24T12:03:57.468 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCrKltghTxDAhAA/WUnVdvAKAcWrDWFF45Ekg== 2021-03-24T12:03:57.468 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2021-03-24T12:03:57.468 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCkKltgMZoEJBAAxWoWULlY7AYURufTo9H9Aw== 2021-03-24T12:03:57.468 INFO:teuthology.orchestra.run.smithi161.stdout:[client.1] 2021-03-24T12:03:57.469 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCkKltgCjGOKRAA4a6uNlXzU9qWOjAdkAYrzw== 2021-03-24T12:03:57.470 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-03-24T12:03:57.555 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-24T12:03:57.639 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-24T12:03:57.723 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-03-24T12:03:57.807 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-03-24T12:03:57.908 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-03-24T12:03:58.005 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-03-24T12:03:58.005 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/c2-a 2021-03-24T12:03:58.068 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c2 --mkfs -i a --monmap /home/ubuntu/cephtest/c2.monmap --keyring /etc/ceph/c2.keyring 2021-03-24T12:03:58.170 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c2-a 2021-03-24T12:03:58.188 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/c2.monmap 2021-03-24T12:03:58.240 INFO:tasks.ceph:Starting mon daemons in cluster c2... 2021-03-24T12:03:58.241 INFO:tasks.ceph.c2.mon.a:Restarting daemon 2021-03-24T12:03:58.241 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c2 -i a 2021-03-24T12:03:58.288 INFO:tasks.ceph.c2.mon.a:Started 2021-03-24T12:03:58.289 INFO:tasks.ceph:Starting mgr daemons in cluster c2... 2021-03-24T12:03:58.289 INFO:tasks.ceph.c2.mgr.x:Restarting daemon 2021-03-24T12:03:58.289 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c2 -i x 2021-03-24T12:03:58.293 INFO:tasks.ceph.c2.mgr.x:Started 2021-03-24T12:03:58.294 INFO:tasks.ceph:Setting crush tunables to default 2021-03-24T12:03:58.294 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster c2 osd crush tunables default 2021-03-24T12:03:58.629 INFO:teuthology.orchestra.run.smithi161.stderr:adjusted tunables profile to default 2021-03-24T12:03:58.642 INFO:tasks.ceph:Starting osd daemons in cluster c2... 2021-03-24T12:03:58.643 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:58.643 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/c2-0/fsid of=/dev/stdout 2021-03-24T12:03:58.652 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:58.653 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/c2-1/fsid of=/dev/stdout 2021-03-24T12:03:58.707 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2021-03-24T12:03:58.708 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/c2-2/fsid of=/dev/stdout 2021-03-24T12:03:58.763 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster c2 osd new 023017c3-b78c-440d-81b7-62243083dcdd 0 2021-03-24T12:03:59.004 INFO:teuthology.orchestra.run.smithi161.stdout:0 2021-03-24T12:03:59.016 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster c2 osd new ece66133-59ac-4952-9999-b683aa01c27e 1 2021-03-24T12:03:59.207 INFO:teuthology.orchestra.run.smithi161.stdout:1 2021-03-24T12:03:59.218 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster c2 osd new b6e34aa9-c770-4d31-b9ac-ebb13c59072d 2 2021-03-24T12:03:59.407 INFO:teuthology.orchestra.run.smithi161.stdout:2 2021-03-24T12:03:59.419 INFO:tasks.ceph.c2.osd.0:Restarting daemon 2021-03-24T12:03:59.420 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 0 2021-03-24T12:03:59.423 INFO:tasks.ceph.c2.osd.0:Started 2021-03-24T12:03:59.423 INFO:tasks.ceph.c2.osd.1:Restarting daemon 2021-03-24T12:03:59.424 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 1 2021-03-24T12:03:59.427 INFO:tasks.ceph.c2.osd.1:Started 2021-03-24T12:03:59.427 INFO:tasks.ceph.c2.osd.2:Restarting daemon 2021-03-24T12:03:59.428 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 2 2021-03-24T12:03:59.431 INFO:tasks.ceph.c2.osd.2:Started 2021-03-24T12:03:59.432 INFO:tasks.ceph:Waiting for OSDs to come up 2021-03-24T12:03:59.735 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2021-03-24T12:03:59.907 INFO:teuthology.misc.health.smithi161.stdout: 2021-03-24T12:03:59.908 INFO:teuthology.misc.health.smithi161.stdout:{"epoch":5,"fsid":"8d28c960-ef5d-422b-b511-3f5fa3a0509e","created":"2021-03-24T12:03:58.439351+0000","modified":"2021-03-24T12:03:59.406942+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"023017c3-b78c-440d-81b7-62243083dcdd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ece66133-59ac-4952-9999-b683aa01c27e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b6e34aa9-c770-4d31-b9ac-ebb13c59072d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-24T12:03:59.918 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-03-24T12:04:00.047 INFO:tasks.ceph.c2.osd.0.smithi161.stderr:2021-03-24T12:04:00.048+0000 7fe094b2cd80 -1 Falling back to public interface 2021-03-24T12:04:00.048 INFO:tasks.ceph.c2.osd.1.smithi161.stderr:2021-03-24T12:04:00.048+0000 7fa099ecbd80 -1 Falling back to public interface 2021-03-24T12:04:00.055 INFO:tasks.ceph.c2.osd.2.smithi161.stderr:2021-03-24T12:04:00.056+0000 7fb3164cad80 -1 Falling back to public interface 2021-03-24T12:04:00.640 INFO:tasks.ceph.c2.osd.0.smithi161.stderr:2021-03-24T12:04:00.640+0000 7fe094b2cd80 -1 osd.0 0 log_to_monitors {default=true} 2021-03-24T12:04:00.665 INFO:tasks.ceph.c2.osd.1.smithi161.stderr:2021-03-24T12:04:00.664+0000 7fa099ecbd80 -1 osd.1 0 log_to_monitors {default=true} 2021-03-24T12:04:00.672 INFO:tasks.ceph.c2.osd.2.smithi161.stderr:2021-03-24T12:04:00.672+0000 7fb3164cad80 -1 osd.2 0 log_to_monitors {default=true} 2021-03-24T12:04:02.476 INFO:tasks.ceph.c2.osd.0.smithi161.stderr:2021-03-24T12:04:02.476+0000 7fe07e578700 -1 osd.0 0 waiting for initial osdmap 2021-03-24T12:04:02.477 INFO:tasks.ceph.c2.osd.1.smithi161.stderr:2021-03-24T12:04:02.476+0000 7fa083917700 -1 osd.1 0 waiting for initial osdmap 2021-03-24T12:04:02.478 INFO:tasks.ceph.c2.osd.2.smithi161.stderr:2021-03-24T12:04:02.476+0000 7fb2fff16700 -1 osd.2 0 waiting for initial osdmap 2021-03-24T12:04:06.222 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2021-03-24T12:04:06.493 INFO:teuthology.misc.health.smithi161.stdout: 2021-03-24T12:04:06.493 INFO:teuthology.misc.health.smithi161.stdout:{"epoch":10,"fsid":"8d28c960-ef5d-422b-b511-3f5fa3a0509e","created":"2021-03-24T12:03:58.439351+0000","modified":"2021-03-24T12:04:05.489451+0000","last_up_change":"2021-03-24T12:04:03.473705+0000","last_in_change":"2021-03-24T12:04:03.473705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-24T12:04:02.318444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"023017c3-b78c-440d-81b7-62243083dcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":12827},{"type":"v1","addr":"172.21.15.161:6801","nonce":12827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":12827},{"type":"v1","addr":"172.21.15.161:6803","nonce":12827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":12827},{"type":"v1","addr":"172.21.15.161:6811","nonce":12827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6805","nonce":12827},{"type":"v1","addr":"172.21.15.161:6807","nonce":12827}]},"public_addr":"172.21.15.161:6801/12827","cluster_addr":"172.21.15.161:6803/12827","heartbeat_back_addr":"172.21.15.161:6811/12827","heartbeat_front_addr":"172.21.15.161:6807/12827","state":["exists","up"]},{"osd":1,"uuid":"ece66133-59ac-4952-9999-b683aa01c27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":8,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":12826},{"type":"v1","addr":"172.21.15.161:6806","nonce":12826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":12826},{"type":"v1","addr":"172.21.15.161:6810","nonce":12826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":12826},{"type":"v1","addr":"172.21.15.161:6815","nonce":12826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":12826},{"type":"v1","addr":"172.21.15.161:6813","nonce":12826}]},"public_addr":"172.21.15.161:6806/12826","cluster_addr":"172.21.15.161:6810/12826","heartbeat_back_addr":"172.21.15.161:6815/12826","heartbeat_front_addr":"172.21.15.161:6813/12826","state":["exists","up"]},{"osd":2,"uuid":"b6e34aa9-c770-4d31-b9ac-ebb13c59072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":12828},{"type":"v1","addr":"172.21.15.161:6817","nonce":12828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":12828},{"type":"v1","addr":"172.21.15.161:6819","nonce":12828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":12828},{"type":"v1","addr":"172.21.15.161:6823","nonce":12828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":12828},{"type":"v1","addr":"172.21.15.161:6821","nonce":12828}]},"public_addr":"172.21.15.161:6817/12828","cluster_addr":"172.21.15.161:6819/12828","heartbeat_back_addr":"172.21.15.161:6823/12828","heartbeat_front_addr":"172.21.15.161:6821/12828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:04:01.687840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:04:01.669256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:04:01.702962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-24T12:04:06.505 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-03-24T12:04:06.506 INFO:tasks.ceph:Creating RBD pool 2021-03-24T12:04:06.507 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster c2 osd pool create rbd 8 2021-03-24T12:04:07.513 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'rbd' created 2021-03-24T12:04:07.526 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster c2 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-03-24T12:04:08.527 INFO:teuthology.orchestra.run.smithi161.stderr:enabled application 'rbd' on pool 'rbd' 2021-03-24T12:04:08.540 INFO:tasks.ceph:Starting mds daemons in cluster c2... 2021-03-24T12:04:08.541 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2021-03-24T12:04:08.541 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-03-24T12:04:08.805 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:04:08.806 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":12,"fsid":"8d28c960-ef5d-422b-b511-3f5fa3a0509e","created":"2021-03-24T12:03:58.439351+0000","modified":"2021-03-24T12:04:08.509378+0000","last_up_change":"2021-03-24T12:04:03.473705+0000","last_in_change":"2021-03-24T12:04:03.473705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-24T12:04:02.318444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-24T12:04:06.833987+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"023017c3-b78c-440d-81b7-62243083dcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":12827},{"type":"v1","addr":"172.21.15.161:6801","nonce":12827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":12827},{"type":"v1","addr":"172.21.15.161:6803","nonce":12827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":12827},{"type":"v1","addr":"172.21.15.161:6811","nonce":12827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6805","nonce":12827},{"type":"v1","addr":"172.21.15.161:6807","nonce":12827}]},"public_addr":"172.21.15.161:6801/12827","cluster_addr":"172.21.15.161:6803/12827","heartbeat_back_addr":"172.21.15.161:6811/12827","heartbeat_front_addr":"172.21.15.161:6807/12827","state":["exists","up"]},{"osd":1,"uuid":"ece66133-59ac-4952-9999-b683aa01c27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":12826},{"type":"v1","addr":"172.21.15.161:6806","nonce":12826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":12826},{"type":"v1","addr":"172.21.15.161:6810","nonce":12826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":12826},{"type":"v1","addr":"172.21.15.161:6815","nonce":12826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":12826},{"type":"v1","addr":"172.21.15.161:6813","nonce":12826}]},"public_addr":"172.21.15.161:6806/12826","cluster_addr":"172.21.15.161:6810/12826","heartbeat_back_addr":"172.21.15.161:6815/12826","heartbeat_front_addr":"172.21.15.161:6813/12826","state":["exists","up"]},{"osd":2,"uuid":"b6e34aa9-c770-4d31-b9ac-ebb13c59072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":12828},{"type":"v1","addr":"172.21.15.161:6817","nonce":12828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":12828},{"type":"v1","addr":"172.21.15.161:6819","nonce":12828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":12828},{"type":"v1","addr":"172.21.15.161:6823","nonce":12828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":12828},{"type":"v1","addr":"172.21.15.161:6821","nonce":12828}]},"public_addr":"172.21.15.161:6817/12828","cluster_addr":"172.21.15.161:6819/12828","heartbeat_back_addr":"172.21.15.161:6823/12828","heartbeat_front_addr":"172.21.15.161:6821/12828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:04:01.687840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:04:01.669256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:04:01.702962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-24T12:04:08.819 INFO:tasks.ceph.ceph_manager.c2:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-24T12:04:02.318444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-03-24T12:04:06.833987+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-03-24T12:04:08.820 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd pool get device_health_metrics pg_num 2021-03-24T12:04:09.087 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2021-03-24T12:04:09.101 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd pool get rbd pg_num 2021-03-24T12:04:09.377 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2021-03-24T12:04:09.390 INFO:tasks.ceph:Waiting until c2 daemons up and pgs clean... 2021-03-24T12:04:09.390 INFO:tasks.ceph.ceph_manager.c2:waiting for mgr available 2021-03-24T12:04:09.391 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 mgr dump --format=json 2021-03-24T12:04:09.698 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:04:09.711 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":4,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":12639},{"type":"v1","addr":"172.21.15.161:6825","nonce":12639}]},"active_addr":"172.21.15.161:6825/12639","active_change":"2021-03-24T12:04:02.221892+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":2463848620}]},{"addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":3062325135}]},{"addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":3559074710}]}]}} 2021-03-24T12:04:09.717 INFO:tasks.ceph.ceph_manager.c2:mgr available! 2021-03-24T12:04:09.718 INFO:tasks.ceph.ceph_manager.c2:waiting for all up 2021-03-24T12:04:09.718 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2021-03-24T12:04:09.992 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:04:09.992 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":13,"fsid":"8d28c960-ef5d-422b-b511-3f5fa3a0509e","created":"2021-03-24T12:03:58.439351+0000","modified":"2021-03-24T12:04:09.523734+0000","last_up_change":"2021-03-24T12:04:03.473705+0000","last_in_change":"2021-03-24T12:04:03.473705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-24T12:04:02.318444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-24T12:04:06.833987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"023017c3-b78c-440d-81b7-62243083dcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":12827},{"type":"v1","addr":"172.21.15.161:6801","nonce":12827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":12827},{"type":"v1","addr":"172.21.15.161:6803","nonce":12827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":12827},{"type":"v1","addr":"172.21.15.161:6811","nonce":12827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6805","nonce":12827},{"type":"v1","addr":"172.21.15.161:6807","nonce":12827}]},"public_addr":"172.21.15.161:6801/12827","cluster_addr":"172.21.15.161:6803/12827","heartbeat_back_addr":"172.21.15.161:6811/12827","heartbeat_front_addr":"172.21.15.161:6807/12827","state":["exists","up"]},{"osd":1,"uuid":"ece66133-59ac-4952-9999-b683aa01c27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":12826},{"type":"v1","addr":"172.21.15.161:6806","nonce":12826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":12826},{"type":"v1","addr":"172.21.15.161:6810","nonce":12826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":12826},{"type":"v1","addr":"172.21.15.161:6815","nonce":12826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":12826},{"type":"v1","addr":"172.21.15.161:6813","nonce":12826}]},"public_addr":"172.21.15.161:6806/12826","cluster_addr":"172.21.15.161:6810/12826","heartbeat_back_addr":"172.21.15.161:6815/12826","heartbeat_front_addr":"172.21.15.161:6813/12826","state":["exists","up"]},{"osd":2,"uuid":"b6e34aa9-c770-4d31-b9ac-ebb13c59072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":12828},{"type":"v1","addr":"172.21.15.161:6817","nonce":12828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":12828},{"type":"v1","addr":"172.21.15.161:6819","nonce":12828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":12828},{"type":"v1","addr":"172.21.15.161:6823","nonce":12828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":12828},{"type":"v1","addr":"172.21.15.161:6821","nonce":12828}]},"public_addr":"172.21.15.161:6817/12828","cluster_addr":"172.21.15.161:6819/12828","heartbeat_back_addr":"172.21.15.161:6823/12828","heartbeat_front_addr":"172.21.15.161:6821/12828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:04:01.687840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:04:01.669256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:04:01.702962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-24T12:04:10.005 INFO:tasks.ceph.ceph_manager.c2:all up! 2021-03-24T12:04:10.005 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2021-03-24T12:04:10.268 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:04:10.269 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":13,"fsid":"8d28c960-ef5d-422b-b511-3f5fa3a0509e","created":"2021-03-24T12:03:58.439351+0000","modified":"2021-03-24T12:04:09.523734+0000","last_up_change":"2021-03-24T12:04:03.473705+0000","last_in_change":"2021-03-24T12:04:03.473705+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-24T12:04:02.318444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-03-24T12:04:06.833987+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"023017c3-b78c-440d-81b7-62243083dcdd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":12827},{"type":"v1","addr":"172.21.15.161:6801","nonce":12827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":12827},{"type":"v1","addr":"172.21.15.161:6803","nonce":12827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":12827},{"type":"v1","addr":"172.21.15.161:6811","nonce":12827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6805","nonce":12827},{"type":"v1","addr":"172.21.15.161:6807","nonce":12827}]},"public_addr":"172.21.15.161:6801/12827","cluster_addr":"172.21.15.161:6803/12827","heartbeat_back_addr":"172.21.15.161:6811/12827","heartbeat_front_addr":"172.21.15.161:6807/12827","state":["exists","up"]},{"osd":1,"uuid":"ece66133-59ac-4952-9999-b683aa01c27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":12826},{"type":"v1","addr":"172.21.15.161:6806","nonce":12826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":12826},{"type":"v1","addr":"172.21.15.161:6810","nonce":12826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":12826},{"type":"v1","addr":"172.21.15.161:6815","nonce":12826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":12826},{"type":"v1","addr":"172.21.15.161:6813","nonce":12826}]},"public_addr":"172.21.15.161:6806/12826","cluster_addr":"172.21.15.161:6810/12826","heartbeat_back_addr":"172.21.15.161:6815/12826","heartbeat_front_addr":"172.21.15.161:6813/12826","state":["exists","up"]},{"osd":2,"uuid":"b6e34aa9-c770-4d31-b9ac-ebb13c59072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":12828},{"type":"v1","addr":"172.21.15.161:6817","nonce":12828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":12828},{"type":"v1","addr":"172.21.15.161:6819","nonce":12828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":12828},{"type":"v1","addr":"172.21.15.161:6823","nonce":12828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":12828},{"type":"v1","addr":"172.21.15.161:6821","nonce":12828}]},"public_addr":"172.21.15.161:6817/12828","cluster_addr":"172.21.15.161:6819/12828","heartbeat_back_addr":"172.21.15.161:6823/12828","heartbeat_front_addr":"172.21.15.161:6821/12828","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:04:01.687840+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:04:01.669256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-03-24T12:04:01.702962+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-24T12:04:10.286 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.0 flush_pg_stats 2021-03-24T12:04:10.443 INFO:teuthology.orchestra.run.smithi161.stdout:34359738371 2021-03-24T12:04:10.443 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.1 flush_pg_stats 2021-03-24T12:04:10.602 INFO:teuthology.orchestra.run.smithi161.stdout:34359738372 2021-03-24T12:04:10.603 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.2 flush_pg_stats 2021-03-24T12:04:10.762 INFO:teuthology.orchestra.run.smithi161.stdout:34359738372 2021-03-24T12:04:10.763 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2021-03-24T12:04:11.036 INFO:teuthology.orchestra.run.smithi161.stdout:34359738370 2021-03-24T12:04:11.049 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738371 got 34359738370 for osd.0 2021-03-24T12:04:12.051 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2021-03-24T12:04:12.326 INFO:teuthology.orchestra.run.smithi161.stdout:34359738370 2021-03-24T12:04:12.340 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738371 got 34359738370 for osd.0 2021-03-24T12:04:13.341 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2021-03-24T12:04:13.618 INFO:teuthology.orchestra.run.smithi161.stdout:34359738371 2021-03-24T12:04:13.632 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738371 got 34359738371 for osd.0 2021-03-24T12:04:13.633 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.1 2021-03-24T12:04:13.907 INFO:teuthology.orchestra.run.smithi161.stdout:34359738372 2021-03-24T12:04:13.920 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738372 for osd.1 2021-03-24T12:04:13.921 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.2 2021-03-24T12:04:14.187 INFO:teuthology.orchestra.run.smithi161.stdout:34359738372 2021-03-24T12:04:14.200 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738372 for osd.2 2021-03-24T12:04:14.201 INFO:tasks.ceph.ceph_manager.c2:waiting for clean 2021-03-24T12:04:14.201 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2021-03-24T12:04:14.473 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:04:14.473 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2021-03-24T12:04:14.483 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2021-03-24T12:04:14.232224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146080,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426720,"statfs":{"total":322122547200,"available":318900961280,"internally_reserved":3221225472,"allocated":335872,"data_stored":95895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.706496"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.541173+0000","last_change":"2021-03-24T12:04:08.536660+0000","last_active":"2021-03-24T12:04:08.541173+0000","last_peered":"2021-03-24T12:04:08.541173+0000","last_clean":"2021-03-24T12:04:08.541173+0000","last_became_active":"2021-03-24T12:04:08.536187+0000","last_became_peered":"2021-03-24T12:04:08.536187+0000","last_unstale":"2021-03-24T12:04:08.541173+0000","last_undegraded":"2021-03-24T12:04:08.541173+0000","last_fullsized":"2021-03-24T12:04:08.541173+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_clean_scrub_stamp":"2021-03-24T12:04:07.501310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.535939+0000","last_change":"2021-03-24T12:04:08.529641+0000","last_active":"2021-03-24T12:04:08.535939+0000","last_peered":"2021-03-24T12:04:08.535939+0000","last_clean":"2021-03-24T12:04:08.535939+0000","last_became_active":"2021-03-24T12:04:08.529290+0000","last_became_peered":"2021-03-24T12:04:08.529290+0000","last_unstale":"2021-03-24T12:04:08.535939+0000","last_undegraded":"2021-03-24T12:04:08.535939+0000","last_fullsized":"2021-03-24T12:04:08.535939+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_clean_scrub_stamp":"2021-03-24T12:04:07.501310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.541198+0000","last_change":"2021-03-24T12:04:08.536669+0000","last_active":"2021-03-24T12:04:08.541198+0000","last_peered":"2021-03-24T12:04:08.541198+0000","last_clean":"2021-03-24T12:04:08.541198+0000","last_became_active":"2021-03-24T12:04:08.536288+0000","last_became_peered":"2021-03-24T12:04:08.536288+0000","last_unstale":"2021-03-24T12:04:08.541198+0000","last_undegraded":"2021-03-24T12:04:08.541198+0000","last_fullsized":"2021-03-24T12:04:08.541198+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_clean_scrub_stamp":"2021-03-24T12:04:07.501310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.538526+0000","last_change":"2021-03-24T12:04:08.531355+0000","last_active":"2021-03-24T12:04:08.538526+0000","last_peered":"2021-03-24T12:04:08.538526+0000","last_clean":"2021-03-24T12:04:08.538526+0000","last_became_active":"2021-03-24T12:04:08.530919+0000","last_became_peered":"2021-03-24T12:04:08.530919+0000","last_unstale":"2021-03-24T12:04:08.538526+0000","last_undegraded":"2021-03-24T12:04:08.538526+0000","last_fullsized":"2021-03-24T12:04:08.538526+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_clean_scrub_stamp":"2021-03-24T12:04:07.501310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"9'1","reported_seq":"12","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.528136+0000","last_change":"2021-03-24T12:04:04.676075+0000","last_active":"2021-03-24T12:04:08.528136+0000","last_peered":"2021-03-24T12:04:08.528136+0000","last_clean":"2021-03-24T12:04:08.528136+0000","last_became_active":"2021-03-24T12:04:04.674693+0000","last_became_peered":"2021-03-24T12:04:04.674693+0000","last_unstale":"2021-03-24T12:04:08.528136+0000","last_undegraded":"2021-03-24T12:04:08.528136+0000","last_fullsized":"2021-03-24T12:04:08.528136+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:02.463205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:02.463205+0000","last_clean_scrub_stamp":"2021-03-24T12:04:02.463205+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.541142+0000","last_change":"2021-03-24T12:04:08.536131+0000","last_active":"2021-03-24T12:04:08.541142+0000","last_peered":"2021-03-24T12:04:08.541142+0000","last_clean":"2021-03-24T12:04:08.541142+0000","last_became_active":"2021-03-24T12:04:08.535681+0000","last_became_peered":"2021-03-24T12:04:08.535681+0000","last_unstale":"2021-03-24T12:04:08.541142+0000","last_undegraded":"2021-03-24T12:04:08.541142+0000","last_fullsized":"2021-03-24T12:04:08.541142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_clean_scrub_stamp":"2021-03-24T12:04:07.501310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.538406+0000","last_change":"2021-03-24T12:04:08.531227+0000","last_active":"2021-03-24T12:04:08.538406+0000","last_peered":"2021-03-24T12:04:08.538406+0000","last_clean":"2021-03-24T12:04:08.538406+0000","last_became_active":"2021-03-24T12:04:08.530975+0000","last_became_peered":"2021-03-24T12:04:08.530975+0000","last_unstale":"2021-03-24T12:04:08.538406+0000","last_undegraded":"2021-03-24T12:04:08.538406+0000","last_fullsized":"2021-03-24T12:04:08.538406+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_clean_scrub_stamp":"2021-03-24T12:04:07.501310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.538283+0000","last_change":"2021-03-24T12:04:08.531894+0000","last_active":"2021-03-24T12:04:08.538283+0000","last_peered":"2021-03-24T12:04:08.538283+0000","last_clean":"2021-03-24T12:04:08.538283+0000","last_became_active":"2021-03-24T12:04:08.531455+0000","last_became_peered":"2021-03-24T12:04:08.531455+0000","last_unstale":"2021-03-24T12:04:08.538283+0000","last_undegraded":"2021-03-24T12:04:08.538283+0000","last_fullsized":"2021-03-24T12:04:08.538283+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_clean_scrub_stamp":"2021-03-24T12:04:07.501310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.538417+0000","last_change":"2021-03-24T12:04:08.531384+0000","last_active":"2021-03-24T12:04:08.538417+0000","last_peered":"2021-03-24T12:04:08.538417+0000","last_clean":"2021-03-24T12:04:08.538417+0000","last_became_active":"2021-03-24T12:04:08.530727+0000","last_became_peered":"2021-03-24T12:04:08.530727+0000","last_unstale":"2021-03-24T12:04:08.538417+0000","last_undegraded":"2021-03-24T12:04:08.538417+0000","last_fullsized":"2021-03-24T12:04:08.538417+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_clean_scrub_stamp":"2021-03-24T12:04:07.501310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":33136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808912,"statfs":{"total":107374182400,"available":106300325888,"internally_reserved":1073741824,"allocated":106496,"data_stored":29623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":33136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]}]}} 2021-03-24T12:04:14.485 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2021-03-24T12:04:14.752 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:04:15.236 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2021-03-24T12:04:15.237 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2021-03-24T12:04:14.232224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146080,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426720,"statfs":{"total":322122547200,"available":318900961280,"internally_reserved":3221225472,"allocated":335872,"data_stored":95895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.706496"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.541173+0000","last_change":"2021-03-24T12:04:08.536660+0000","last_active":"2021-03-24T12:04:08.541173+0000","last_peered":"2021-03-24T12:04:08.541173+0000","last_clean":"2021-03-24T12:04:08.541173+0000","last_became_active":"2021-03-24T12:04:08.536187+0000","last_became_peered":"2021-03-24T12:04:08.536187+0000","last_unstale":"2021-03-24T12:04:08.541173+0000","last_undegraded":"2021-03-24T12:04:08.541173+0000","last_fullsized":"2021-03-24T12:04:08.541173+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_clean_scrub_stamp":"2021-03-24T12:04:07.501310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.535939+0000","last_change":"2021-03-24T12:04:08.529641+0000","last_active":"2021-03-24T12:04:08.535939+0000","last_peered":"2021-03-24T12:04:08.535939+0000","last_clean":"2021-03-24T12:04:08.535939+0000","last_became_active":"2021-03-24T12:04:08.529290+0000","last_became_peered":"2021-03-24T12:04:08.529290+0000","last_unstale":"2021-03-24T12:04:08.535939+0000","last_undegraded":"2021-03-24T12:04:08.535939+0000","last_fullsized":"2021-03-24T12:04:08.535939+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_clean_scrub_stamp":"2021-03-24T12:04:07.501310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.541198+0000","last_change":"2021-03-24T12:04:08.536669+0000","last_active":"2021-03-24T12:04:08.541198+0000","last_peered":"2021-03-24T12:04:08.541198+0000","last_clean":"2021-03-24T12:04:08.541198+0000","last_became_active":"2021-03-24T12:04:08.536288+0000","last_became_peered":"2021-03-24T12:04:08.536288+0000","last_unstale":"2021-03-24T12:04:08.541198+0000","last_undegraded":"2021-03-24T12:04:08.541198+0000","last_fullsized":"2021-03-24T12:04:08.541198+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_clean_scrub_stamp":"2021-03-24T12:04:07.501310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.538526+0000","last_change":"2021-03-24T12:04:08.531355+0000","last_active":"2021-03-24T12:04:08.538526+0000","last_peered":"2021-03-24T12:04:08.538526+0000","last_clean":"2021-03-24T12:04:08.538526+0000","last_became_active":"2021-03-24T12:04:08.530919+0000","last_became_peered":"2021-03-24T12:04:08.530919+0000","last_unstale":"2021-03-24T12:04:08.538526+0000","last_undegraded":"2021-03-24T12:04:08.538526+0000","last_fullsized":"2021-03-24T12:04:08.538526+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_clean_scrub_stamp":"2021-03-24T12:04:07.501310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"9'1","reported_seq":"12","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.528136+0000","last_change":"2021-03-24T12:04:04.676075+0000","last_active":"2021-03-24T12:04:08.528136+0000","last_peered":"2021-03-24T12:04:08.528136+0000","last_clean":"2021-03-24T12:04:08.528136+0000","last_became_active":"2021-03-24T12:04:04.674693+0000","last_became_peered":"2021-03-24T12:04:04.674693+0000","last_unstale":"2021-03-24T12:04:08.528136+0000","last_undegraded":"2021-03-24T12:04:08.528136+0000","last_fullsized":"2021-03-24T12:04:08.528136+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:02.463205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:02.463205+0000","last_clean_scrub_stamp":"2021-03-24T12:04:02.463205+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.541142+0000","last_change":"2021-03-24T12:04:08.536131+0000","last_active":"2021-03-24T12:04:08.541142+0000","last_peered":"2021-03-24T12:04:08.541142+0000","last_clean":"2021-03-24T12:04:08.541142+0000","last_became_active":"2021-03-24T12:04:08.535681+0000","last_became_peered":"2021-03-24T12:04:08.535681+0000","last_unstale":"2021-03-24T12:04:08.541142+0000","last_undegraded":"2021-03-24T12:04:08.541142+0000","last_fullsized":"2021-03-24T12:04:08.541142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_clean_scrub_stamp":"2021-03-24T12:04:07.501310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.538406+0000","last_change":"2021-03-24T12:04:08.531227+0000","last_active":"2021-03-24T12:04:08.538406+0000","last_peered":"2021-03-24T12:04:08.538406+0000","last_clean":"2021-03-24T12:04:08.538406+0000","last_became_active":"2021-03-24T12:04:08.530975+0000","last_became_peered":"2021-03-24T12:04:08.530975+0000","last_unstale":"2021-03-24T12:04:08.538406+0000","last_undegraded":"2021-03-24T12:04:08.538406+0000","last_fullsized":"2021-03-24T12:04:08.538406+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_clean_scrub_stamp":"2021-03-24T12:04:07.501310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.538283+0000","last_change":"2021-03-24T12:04:08.531894+0000","last_active":"2021-03-24T12:04:08.538283+0000","last_peered":"2021-03-24T12:04:08.538283+0000","last_clean":"2021-03-24T12:04:08.538283+0000","last_became_active":"2021-03-24T12:04:08.531455+0000","last_became_peered":"2021-03-24T12:04:08.531455+0000","last_unstale":"2021-03-24T12:04:08.538283+0000","last_undegraded":"2021-03-24T12:04:08.538283+0000","last_fullsized":"2021-03-24T12:04:08.538283+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_clean_scrub_stamp":"2021-03-24T12:04:07.501310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"12","state":"active+clean","last_fresh":"2021-03-24T12:04:08.538417+0000","last_change":"2021-03-24T12:04:08.531384+0000","last_active":"2021-03-24T12:04:08.538417+0000","last_peered":"2021-03-24T12:04:08.538417+0000","last_clean":"2021-03-24T12:04:08.538417+0000","last_became_active":"2021-03-24T12:04:08.530727+0000","last_became_peered":"2021-03-24T12:04:08.530727+0000","last_unstale":"2021-03-24T12:04:08.538417+0000","last_undegraded":"2021-03-24T12:04:08.538417+0000","last_fullsized":"2021-03-24T12:04:08.538417+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-24T12:04:07.501310+0000","last_clean_scrub_stamp":"2021-03-24T12:04:07.501310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":33136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808912,"statfs":{"total":107374182400,"available":106300325888,"internally_reserved":1073741824,"allocated":106496,"data_stored":29623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":33136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]}]}} 2021-03-24T12:04:15.238 INFO:tasks.ceph.ceph_manager.c2:clean! 2021-03-24T12:04:15.238 INFO:tasks.ceph:Waiting until ceph cluster c2 is healthy... 2021-03-24T12:04:15.238 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy 2021-03-24T12:04:15.239 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 health --format=json 2021-03-24T12:04:15.566 INFO:teuthology.orchestra.run.smithi161.stdout: 2021-03-24T12:04:15.579 INFO:teuthology.orchestra.run.smithi161.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-03-24T12:04:15.579 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy done 2021-03-24T12:04:15.580 INFO:teuthology.run_tasks:Running task parallel... 2021-03-24T12:04:15.590 INFO:teuthology.task.parallel:starting parallel... 2021-03-24T12:04:15.591 INFO:teuthology.task.parallel:In parallel, running task sequential... 2021-03-24T12:04:15.595 INFO:teuthology.task.sequential:In sequential, running task install.upgrade... 2021-03-24T12:04:15.596 INFO:teuthology.task.install:project ceph config {'c1.client.0': None, 'c1.mgr.x': None, 'c1.mon.a': None, 'c1.osd.0': None, 'c1.osd.1': None, 'c1.osd.2': None} overrides {'branch': 'octopus', 'sha1': '666a545dfbb7fc4fe7736e3c0e891b149a8ef286'} 2021-03-24T12:04:15.596 WARNING:teuthology.task.install:remote ubuntu@smithi043.front.sepia.ceph.com came up twice (role c1.mgr.x) 2021-03-24T12:04:15.597 WARNING:teuthology.task.install:remote ubuntu@smithi043.front.sepia.ceph.com came up twice (role c1.mon.a) 2021-03-24T12:04:15.597 WARNING:teuthology.task.install:remote ubuntu@smithi043.front.sepia.ceph.com came up twice (role c1.osd.0) 2021-03-24T12:04:15.597 WARNING:teuthology.task.install:remote ubuntu@smithi043.front.sepia.ceph.com came up twice (role c1.osd.1) 2021-03-24T12:04:15.598 WARNING:teuthology.task.install:remote ubuntu@smithi043.front.sepia.ceph.com came up twice (role c1.osd.2) 2021-03-24T12:04:15.598 INFO:teuthology.task.install:remote ubuntu@smithi043.front.sepia.ceph.com config {'branch': 'octopus', 'sha1': '666a545dfbb7fc4fe7736e3c0e891b149a8ef286'} 2021-03-24T12:04:15.598 INFO:teuthology.task.install:extra packages: [] 2021-03-24T12:04:15.599 DEBUG:teuthology.orchestra.run.smithi043:> sudo lsb_release -is 2021-03-24T12:04:15.656 INFO:teuthology.orchestra.run.smithi043.stdout:Ubuntu 2021-03-24T12:04:15.661 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-03-24T12:04:15.667 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-03-24T12:04:15.668 INFO:teuthology.task.install:Upgrading ceph deb packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse 2021-03-24T12:04:15.668 DEBUG:teuthology.orchestra.run.smithi043:> dpkg-query -W -f '${Version}' ceph-common 2021-03-24T12:04:15.696 INFO:teuthology.orchestra.run.smithi043.stdout:15.2.10-72-g13f4488c-1bionic 2021-03-24T12:04:15.696 INFO:teuthology.packaging:The installed version of ceph-common is 15.2.10-72-g13f4488c-1bionic 2021-03-24T12:04:15.697 DEBUG:teuthology.orchestra.run.smithi043:> sudo lsb_release -is 2021-03-24T12:04:15.793 INFO:teuthology.orchestra.run.smithi043.stdout:Ubuntu 2021-03-24T12:04:15.798 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-03-24T12:04:15.799 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-03-24T12:04:15.799 INFO:teuthology.packaging:ref: None 2021-03-24T12:04:15.799 INFO:teuthology.packaging:tag: None 2021-03-24T12:04:15.800 INFO:teuthology.packaging:branch: octopus 2021-03-24T12:04:15.800 INFO:teuthology.packaging:sha1: 666a545dfbb7fc4fe7736e3c0e891b149a8ef286 2021-03-24T12:04:15.801 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=octopus 2021-03-24T12:04:16.019 INFO:teuthology.task.install:Ceph deb upgrade from 15.2.10-72-g13f4488c-1bionic to 15.2.10-72-g13f4488c-1bionic 2021-03-24T12:04:16.052 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-key list | grep Ceph 2021-03-24T12:04:16.157 INFO:teuthology.orchestra.run.smithi043.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-03-24T12:04:16.217 INFO:teuthology.orchestra.run.smithi043.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-03-24T12:04:16.217 INFO:teuthology.orchestra.run.smithi043.stdout:uid [ unknown] Ceph.com (release key) 2021-03-24T12:04:16.217 DEBUG:teuthology.orchestra.run.smithi043:> sudo lsb_release -is 2021-03-24T12:04:16.272 INFO:teuthology.orchestra.run.smithi043.stdout:Ubuntu 2021-03-24T12:04:16.278 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-03-24T12:04:16.279 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-03-24T12:04:16.280 INFO:teuthology.packaging:ref: None 2021-03-24T12:04:16.281 INFO:teuthology.packaging:tag: None 2021-03-24T12:04:16.281 INFO:teuthology.packaging:branch: octopus 2021-03-24T12:04:16.282 INFO:teuthology.packaging:sha1: 666a545dfbb7fc4fe7736e3c0e891b149a8ef286 2021-03-24T12:04:16.282 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=octopus 2021-03-24T12:04:16.498 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default/ 2021-03-24T12:04:16.500 INFO:teuthology.task.install.deb:Package version is 15.2.10-72-g13f4488c-1bionic 2021-03-24T12:04:16.613 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2021-03-24T12:04:16.614 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-03-24T12:04:16.631 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get update 2021-03-24T12:04:16.816 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-03-24T12:04:16.874 INFO:teuthology.orchestra.run.smithi043.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic InRelease 2021-03-24T12:04:16.895 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:3 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic Release 2021-03-24T12:04:16.916 INFO:teuthology.orchestra.run.smithi043.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/octopus/13f4488c965bc9695a78d13528fefbd589d3015b/ubuntu/bionic/flavors/default bionic Release.gpg 2021-03-24T12:04:16.931 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-03-24T12:04:17.012 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:6 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-03-24T12:04:17.243 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:7 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-03-24T12:04:18.770 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2021-03-24T12:04:18.819 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.10-72-g13f4488c-1bionic cephadm=15.2.10-72-g13f4488c-1bionic ceph-mds=15.2.10-72-g13f4488c-1bionic ceph-mgr=15.2.10-72-g13f4488c-1bionic ceph-common=15.2.10-72-g13f4488c-1bionic ceph-fuse=15.2.10-72-g13f4488c-1bionic ceph-test=15.2.10-72-g13f4488c-1bionic radosgw=15.2.10-72-g13f4488c-1bionic python3-rados=15.2.10-72-g13f4488c-1bionic python3-rgw=15.2.10-72-g13f4488c-1bionic python3-cephfs=15.2.10-72-g13f4488c-1bionic python3-rbd=15.2.10-72-g13f4488c-1bionic libcephfs2=15.2.10-72-g13f4488c-1bionic libcephfs-dev=15.2.10-72-g13f4488c-1bionic librados2=15.2.10-72-g13f4488c-1bionic librbd1=15.2.10-72-g13f4488c-1bionic rbd-fuse=15.2.10-72-g13f4488c-1bionic 2021-03-24T12:04:18.901 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2021-03-24T12:04:19.143 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2021-03-24T12:04:19.144 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2021-03-24T12:04:19.365 INFO:teuthology.orchestra.run.smithi043.stdout:ceph is already the newest version (15.2.10-72-g13f4488c-1bionic). 2021-03-24T12:04:19.365 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-common is already the newest version (15.2.10-72-g13f4488c-1bionic). 2021-03-24T12:04:19.365 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-fuse is already the newest version (15.2.10-72-g13f4488c-1bionic). 2021-03-24T12:04:19.366 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-mds is already the newest version (15.2.10-72-g13f4488c-1bionic). 2021-03-24T12:04:19.366 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-mgr is already the newest version (15.2.10-72-g13f4488c-1bionic). 2021-03-24T12:04:19.366 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-test is already the newest version (15.2.10-72-g13f4488c-1bionic). 2021-03-24T12:04:19.366 INFO:teuthology.orchestra.run.smithi043.stdout:cephadm is already the newest version (15.2.10-72-g13f4488c-1bionic). 2021-03-24T12:04:19.367 INFO:teuthology.orchestra.run.smithi043.stdout:libcephfs-dev is already the newest version (15.2.10-72-g13f4488c-1bionic). 2021-03-24T12:04:19.367 INFO:teuthology.orchestra.run.smithi043.stdout:libcephfs2 is already the newest version (15.2.10-72-g13f4488c-1bionic). 2021-03-24T12:04:19.367 INFO:teuthology.orchestra.run.smithi043.stdout:librados2 is already the newest version (15.2.10-72-g13f4488c-1bionic). 2021-03-24T12:04:19.367 INFO:teuthology.orchestra.run.smithi043.stdout:librados2 set to manually installed. 2021-03-24T12:04:19.367 INFO:teuthology.orchestra.run.smithi043.stdout:librbd1 is already the newest version (15.2.10-72-g13f4488c-1bionic). 2021-03-24T12:04:19.368 INFO:teuthology.orchestra.run.smithi043.stdout:librbd1 set to manually installed. 2021-03-24T12:04:19.368 INFO:teuthology.orchestra.run.smithi043.stdout:python3-cephfs is already the newest version (15.2.10-72-g13f4488c-1bionic). 2021-03-24T12:04:19.368 INFO:teuthology.orchestra.run.smithi043.stdout:python3-rados is already the newest version (15.2.10-72-g13f4488c-1bionic). 2021-03-24T12:04:19.368 INFO:teuthology.orchestra.run.smithi043.stdout:python3-rbd is already the newest version (15.2.10-72-g13f4488c-1bionic). 2021-03-24T12:04:19.368 INFO:teuthology.orchestra.run.smithi043.stdout:python3-rgw is already the newest version (15.2.10-72-g13f4488c-1bionic). 2021-03-24T12:04:19.369 INFO:teuthology.orchestra.run.smithi043.stdout:radosgw is already the newest version (15.2.10-72-g13f4488c-1bionic). 2021-03-24T12:04:19.369 INFO:teuthology.orchestra.run.smithi043.stdout:rbd-fuse is already the newest version (15.2.10-72-g13f4488c-1bionic). 2021-03-24T12:04:19.369 INFO:teuthology.orchestra.run.smithi043.stdout:0 upgraded, 0 newly installed, 0 to remove and 27 not upgraded. 2021-03-24T12:04:19.370 INFO:teuthology.orchestra.run.smithi043.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-03-24T12:04:19.371 DEBUG:teuthology.orchestra.run.smithi043:> sudo lsb_release -is 2021-03-24T12:04:19.420 INFO:teuthology.orchestra.run.smithi043.stdout:Ubuntu 2021-03-24T12:04:19.423 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-03-24T12:04:19.423 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-03-24T12:04:19.424 INFO:teuthology.packaging:ref: None 2021-03-24T12:04:19.424 INFO:teuthology.packaging:tag: None 2021-03-24T12:04:19.425 INFO:teuthology.packaging:branch: octopus 2021-03-24T12:04:19.425 INFO:teuthology.packaging:sha1: 666a545dfbb7fc4fe7736e3c0e891b149a8ef286 2021-03-24T12:04:19.425 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=octopus 2021-03-24T12:04:19.641 DEBUG:teuthology.orchestra.run.smithi043:> dpkg-query -W -f '${Version}' ceph 2021-03-24T12:04:19.667 INFO:teuthology.orchestra.run.smithi043.stdout:15.2.10-72-g13f4488c-1bionic 2021-03-24T12:04:19.668 INFO:teuthology.packaging:The installed version of ceph is 15.2.10-72-g13f4488c-1bionic 2021-03-24T12:04:19.668 INFO:teuthology.task.install:The correct ceph version 15.2.10-72-g13f4488c-1bionic is installed. 2021-03-24T12:04:19.668 DEBUG:teuthology.parallel:result is None 2021-03-24T12:04:19.669 INFO:teuthology.run_tasks:Running task rgw... 2021-03-24T12:04:19.690 DEBUG:tasks.rgw:config is {'c1.client.0': {'port': 8000}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}} 2021-03-24T12:04:19.691 DEBUG:tasks.rgw:client list is dict_keys(['c1.client.0', 'c2.client.0', 'c2.client.1']) 2021-03-24T12:04:19.691 INFO:tasks.rgw:Creating data pools 2021-03-24T12:04:19.692 DEBUG:tasks.rgw:Obtaining remote for client c1.client.0 2021-03-24T12:04:19.692 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c1 2021-03-24T12:04:20.434 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'default.rgw.buckets.data' created 2021-03-24T12:04:20.451 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c1 2021-03-24T12:04:21.475 INFO:teuthology.orchestra.run.smithi043.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-03-24T12:04:21.487 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c1 2021-03-24T12:04:22.459 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'default.rgw.buckets.index' created 2021-03-24T12:04:22.475 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c1 2021-03-24T12:04:23.499 INFO:teuthology.orchestra.run.smithi043.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-03-24T12:04:23.513 DEBUG:tasks.rgw:Obtaining remote for client c2.client.0 2021-03-24T12:04:23.514 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2021-03-24T12:04:24.438 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'default.rgw.buckets.data' created 2021-03-24T12:04:24.456 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2021-03-24T12:04:25.451 INFO:teuthology.orchestra.run.smithi161.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-03-24T12:04:25.468 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2021-03-24T12:04:26.455 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'default.rgw.buckets.index' created 2021-03-24T12:04:26.471 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2021-03-24T12:04:27.486 INFO:teuthology.orchestra.run.smithi161.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-03-24T12:04:27.502 DEBUG:tasks.rgw:Obtaining remote for client c2.client.1 2021-03-24T12:04:27.502 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2021-03-24T12:04:27.768 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'default.rgw.buckets.data' already exists 2021-03-24T12:04:27.929 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2021-03-24T12:04:28.468 INFO:teuthology.orchestra.run.smithi161.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-03-24T12:04:28.481 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2021-03-24T12:04:28.755 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'default.rgw.buckets.index' already exists 2021-03-24T12:04:28.768 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2021-03-24T12:04:29.472 INFO:teuthology.orchestra.run.smithi161.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-03-24T12:04:29.483 DEBUG:tasks.rgw:Pools created 2021-03-24T12:04:29.483 INFO:tasks.rgw:Configuring compression type = random 2021-03-24T12:04:29.483 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'list'] 2021-03-24T12:04:29.485 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'list'] 2021-03-24T12:04:29.485 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user list 2021-03-24T12:04:29.517 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:04:29.518 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:04:29.529 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:29.529+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:31.433 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.433+0000 7f5a5da4e080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:31.433 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.433+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:31.433 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.433+0000 7f5a5da4e080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:31.434 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.433+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:31.435 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.433+0000 7f5a5da4e080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:31.435 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.433+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:31.435 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.433+0000 7f5a5da4e080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:31.448 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.445+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:31.448 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.445+0000 7f5a5da4e080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:31.448 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.445+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:31.448 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.449+0000 7f5a5da4e080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:31.449 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.449+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:31.449 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.449+0000 7f5a5da4e080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:31.449 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.449+0000 7f5a5da4e080 10 cannot find current period zonegroup using local zonegroup 2021-03-24T12:04:31.449 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.449+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:31.450 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.449+0000 7f5a5da4e080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:31.450 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.449+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:31.453 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.449+0000 7f5a5da4e080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:31.453 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.449+0000 7f5a5da4e080 10 Creating default zonegroup 2021-03-24T12:04:31.454 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.449+0000 7f5a5da4e080 20 get_system_obj_state: rctx=0x7ffc55c6dfa0 obj=:.pools.avail state=0x5609b144eec0 s->prefetch_data=0 2021-03-24T12:04:31.454 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.449+0000 7f5a5da4e080 10 couldn't find old data placement pools config, setting up new ones for the zone 2021-03-24T12:04:31.460 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.461+0000 7f5a5da4e080 10 WARNING: store->list_zones() returned r=-2 2021-03-24T12:04:31.460 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.461+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:31.460 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.461+0000 7f5a5da4e080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:31.464 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.465+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:31.465 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.465+0000 7f5a5da4e080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:31.465 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.465+0000 7f5a5da4e080 10 could not read realm id: (2) No such file or directory 2021-03-24T12:04:31.465 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.465+0000 7f5a5da4e080 10 WARNING: failed to set zone as default, r=-22 2021-03-24T12:04:31.465 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.465+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:31.465 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.465+0000 7f5a5da4e080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:31.469 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.469+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:31.469 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.469+0000 7f5a5da4e080 20 rados_obj.operate() r=0 bl.length=839 2021-03-24T12:04:31.470 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.469+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:31.471 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.469+0000 7f5a5da4e080 20 rados_obj.operate() r=0 bl.length=358 2021-03-24T12:04:31.471 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.469+0000 7f5a5da4e080 20 zonegroup default 2021-03-24T12:04:31.471 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.469+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:31.471 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.473+0000 7f5a5da4e080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:31.472 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.473+0000 7f5a5da4e080 10 Cannot find current period zone using local zone 2021-03-24T12:04:31.472 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.473+0000 7f5a5da4e080 10 Using default name default 2021-03-24T12:04:31.472 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.473+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:31.474 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.473+0000 7f5a5da4e080 20 rados_obj.operate() r=0 bl.length=46 2021-03-24T12:04:31.475 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.473+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:31.475 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.473+0000 7f5a5da4e080 20 rados_obj.operate() r=0 bl.length=839 2021-03-24T12:04:31.475 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.473+0000 7f5a5da4e080 20 zone default found 2021-03-24T12:04:31.476 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:31.473+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:33.452 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:33.453+0000 7f5a5da4e080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:33.452 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:33.453+0000 7f5a5da4e080 20 rados->read ofs=0 len=0 2021-03-24T12:04:33.453 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:33.453+0000 7f5a5da4e080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:33.453 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:33.453+0000 7f5a5da4e080 20 started sync module instance, tier type = 2021-03-24T12:04:33.453 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:33.453+0000 7f5a5da4e080 20 started zone id=dbaf91c6-2a10-4f44-9f33-52a21677b981 (name=default) with tier type = 2021-03-24T12:04:35.488 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:35.489+0000 7f5a5da4e080 20 add_watcher() i=0 2021-03-24T12:04:35.489 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:35.489+0000 7f5a5da4e080 20 add_watcher() i=1 2021-03-24T12:04:35.489 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:35.489+0000 7f5a5da4e080 20 add_watcher() i=2 2021-03-24T12:04:35.489 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:35.489+0000 7f5a5da4e080 20 add_watcher() i=3 2021-03-24T12:04:35.489 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:35.489+0000 7f5a5da4e080 20 add_watcher() i=4 2021-03-24T12:04:35.490 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:35.489+0000 7f5a5da4e080 20 add_watcher() i=5 2021-03-24T12:04:35.490 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:35.489+0000 7f5a5da4e080 20 add_watcher() i=6 2021-03-24T12:04:35.491 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:35.489+0000 7f5a5da4e080 20 add_watcher() i=7 2021-03-24T12:04:35.491 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:35.489+0000 7f5a5da4e080 2 all 8 watchers are set, enabling cache 2021-03-24T12:04:35.491 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:35.489+0000 7f5a5da4e080 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-03-24T12:04:35.491 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:35.489+0000 7f5a5da4e080 20 check_secure_mon_conn(): mode 1 is insecure 2021-03-24T12:04:35.492 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:35.489+0000 7f5a1afdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-03-24T12:04:39.486 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.484+0000 7f5a5da4e080 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2021-03-24T12:04:39.582 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.580+0000 7f59897fa700 20 reqs_thread_entry: start 2021-03-24T12:04:39.583 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.580+0000 7f597effd700 20 reqs_thread_entry: start 2021-03-24T12:04:39.583 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.580+0000 7f5a5da4e080 20 init_complete bucket index max shards: 11 2021-03-24T12:04:39.583 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.584+0000 7f597d7fa700 20 reqs_thread_entry: start 2021-03-24T12:04:39.600 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.600+0000 7f5a1afdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-03-24T12:04:39.602 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.600+0000 7f5a5da4e080 20 remove_watcher() i=0 2021-03-24T12:04:39.602 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.600+0000 7f5a5da4e080 2 removed watcher, disabling cache 2021-03-24T12:04:39.603 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.604+0000 7f5a5da4e080 20 remove_watcher() i=1 2021-03-24T12:04:39.606 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.604+0000 7f5a5da4e080 20 remove_watcher() i=2 2021-03-24T12:04:39.608 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.608+0000 7f5a5da4e080 20 remove_watcher() i=3 2021-03-24T12:04:39.610 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.608+0000 7f5a5da4e080 20 remove_watcher() i=4 2021-03-24T12:04:39.611 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.612+0000 7f5a5da4e080 20 remove_watcher() i=5 2021-03-24T12:04:39.614 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.612+0000 7f5a5da4e080 20 remove_watcher() i=6 2021-03-24T12:04:39.616 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.616+0000 7f5a5da4e080 20 remove_watcher() i=7 2021-03-24T12:04:39.625 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2021-03-24T12:04:39.626 DEBUG:tasks.util.rgw: json result: [] 2021-03-24T12:04:39.626 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-03-24T12:04:39.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-03-24T12:04:39.628 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-03-24T12:04:39.707 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:04:39.708 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:04:39.722 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.720+0000 7f167c8ee080 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-03-24T12:04:39.722 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.720+0000 7f167c8ee080 20 check_secure_mon_conn(): mode 1 is insecure 2021-03-24T12:04:39.728 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.728+0000 7f167c8ee080 20 rados->read ofs=0 len=0 2021-03-24T12:04:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.728+0000 7f15b8ff9700 20 reqs_thread_entry: start 2021-03-24T12:04:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.728+0000 7f167c8ee080 20 rados_obj.operate() r=0 bl.length=46 2021-03-24T12:04:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.728+0000 7f167c8ee080 20 rados->read ofs=0 len=0 2021-03-24T12:04:39.730 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.732+0000 7f167c8ee080 20 rados_obj.operate() r=0 bl.length=839 2021-03-24T12:04:39.731 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.732+0000 7f167c8ee080 20 rados->read ofs=0 len=0 2021-03-24T12:04:39.731 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.732+0000 7f167c8ee080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.732+0000 7f167c8ee080 20 rados->read ofs=0 len=0 2021-03-24T12:04:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.732+0000 7f167c8ee080 20 rados_obj.operate() r=0 bl.length=46 2021-03-24T12:04:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.732+0000 7f167c8ee080 20 rados->read ofs=0 len=0 2021-03-24T12:04:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:39.732+0000 7f167c8ee080 20 rados_obj.operate() r=0 bl.length=358 2021-03-24T12:04:39.742 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"dbaf91c6-2a10-4f44-9f33-52a21677b981","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-03-24T12:04:39.743 DEBUG:tasks.util.rgw: json result: {'id': 'dbaf91c6-2a10-4f44-9f33-52a21677b981', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': ''} 2021-03-24T12:04:39.743 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['user', 'list'] 2021-03-24T12:04:39.743 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'user', 'list'] 2021-03-24T12:04:39.744 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 user list 2021-03-24T12:04:39.781 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:04:39.782 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:04:39.792 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:39.792+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:41.437 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.436+0000 7fb478713080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:41.438 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.436+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:41.448 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.448+0000 7fb478713080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:41.448 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.448+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:41.449 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.448+0000 7fb478713080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:41.449 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.448+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:41.450 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.452+0000 7fb478713080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:41.462 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.464+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:41.463 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.464+0000 7fb478713080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:41.464 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.464+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:41.464 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.464+0000 7fb478713080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:41.464 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.464+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:41.464 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.464+0000 7fb478713080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:41.465 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.464+0000 7fb478713080 10 cannot find current period zonegroup using local zonegroup 2021-03-24T12:04:41.465 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.464+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:41.465 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.464+0000 7fb478713080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:41.465 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.464+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:41.466 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.464+0000 7fb478713080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:41.467 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.464+0000 7fb478713080 10 Creating default zonegroup 2021-03-24T12:04:41.467 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.464+0000 7fb478713080 20 get_system_obj_state: rctx=0x7ffc1c8cc380 obj=:.pools.avail state=0x562bbd483ec0 s->prefetch_data=0 2021-03-24T12:04:41.467 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.464+0000 7fb478713080 10 couldn't find old data placement pools config, setting up new ones for the zone 2021-03-24T12:04:41.476 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.480+0000 7fb478713080 10 WARNING: store->list_zones() returned r=-2 2021-03-24T12:04:41.477 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.480+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:41.477 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.480+0000 7fb478713080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:41.484 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.484+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:41.485 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.484+0000 7fb478713080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:41.485 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.484+0000 7fb478713080 10 could not read realm id: (2) No such file or directory 2021-03-24T12:04:41.485 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.484+0000 7fb478713080 10 WARNING: failed to set zone as default, r=-22 2021-03-24T12:04:41.485 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.484+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:41.486 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.488+0000 7fb478713080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:41.489 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.492+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:41.490 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.492+0000 7fb478713080 20 rados_obj.operate() r=0 bl.length=839 2021-03-24T12:04:41.490 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.492+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:41.491 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.492+0000 7fb478713080 20 rados_obj.operate() r=0 bl.length=358 2021-03-24T12:04:41.491 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.492+0000 7fb478713080 20 zonegroup default 2021-03-24T12:04:41.492 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.492+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:41.492 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.492+0000 7fb478713080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:41.492 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.492+0000 7fb478713080 10 Cannot find current period zone using local zone 2021-03-24T12:04:41.492 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.492+0000 7fb478713080 10 Using default name default 2021-03-24T12:04:41.493 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.492+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:41.493 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.492+0000 7fb478713080 20 rados_obj.operate() r=0 bl.length=46 2021-03-24T12:04:41.493 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.492+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:41.494 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.492+0000 7fb478713080 20 rados_obj.operate() r=0 bl.length=839 2021-03-24T12:04:41.494 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.492+0000 7fb478713080 20 zone default found 2021-03-24T12:04:41.494 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:41.492+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:43.471 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:43.472+0000 7fb478713080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:43.471 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:43.472+0000 7fb478713080 20 rados->read ofs=0 len=0 2021-03-24T12:04:43.472 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:43.472+0000 7fb478713080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:43.472 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:43.472+0000 7fb478713080 20 started sync module instance, tier type = 2021-03-24T12:04:43.472 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:43.472+0000 7fb478713080 20 started zone id=36c8c46e-d40b-4efa-b125-e915e99f5722 (name=default) with tier type = 2021-03-24T12:04:45.520 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:45.520+0000 7fb478713080 20 add_watcher() i=0 2021-03-24T12:04:45.520 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:45.520+0000 7fb478713080 20 add_watcher() i=1 2021-03-24T12:04:45.521 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:45.520+0000 7fb478713080 20 add_watcher() i=2 2021-03-24T12:04:45.521 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:45.520+0000 7fb478713080 20 add_watcher() i=3 2021-03-24T12:04:45.521 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:45.520+0000 7fb478713080 20 add_watcher() i=4 2021-03-24T12:04:45.521 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:45.520+0000 7fb478713080 20 add_watcher() i=5 2021-03-24T12:04:45.522 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:45.524+0000 7fb478713080 20 add_watcher() i=6 2021-03-24T12:04:45.523 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:45.524+0000 7fb478713080 20 add_watcher() i=7 2021-03-24T12:04:45.523 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:45.524+0000 7fb478713080 2 all 8 watchers are set, enabling cache 2021-03-24T12:04:45.523 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:45.524+0000 7fb478713080 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-03-24T12:04:45.523 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:45.524+0000 7fb478713080 20 check_secure_mon_conn(): mode 1 is insecure 2021-03-24T12:04:45.524 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:45.524+0000 7fb3affff700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-03-24T12:04:49.488 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.486+0000 7fb478713080 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2021-03-24T12:04:49.585 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.582+0000 7fb39e7fc700 20 reqs_thread_entry: start 2021-03-24T12:04:49.586 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.582+0000 7fb38ffff700 20 reqs_thread_entry: start 2021-03-24T12:04:49.586 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.582+0000 7fb478713080 20 init_complete bucket index max shards: 11 2021-03-24T12:04:49.587 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.582+0000 7fb38e7fc700 20 reqs_thread_entry: start 2021-03-24T12:04:49.606 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.602+0000 7fb3affff700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-03-24T12:04:49.607 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.606+0000 7fb478713080 20 remove_watcher() i=0 2021-03-24T12:04:49.608 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.606+0000 7fb478713080 2 removed watcher, disabling cache 2021-03-24T12:04:49.610 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.610+0000 7fb478713080 20 remove_watcher() i=1 2021-03-24T12:04:49.612 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.610+0000 7fb478713080 20 remove_watcher() i=2 2021-03-24T12:04:49.617 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.614+0000 7fb478713080 20 remove_watcher() i=3 2021-03-24T12:04:49.620 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.618+0000 7fb478713080 20 remove_watcher() i=4 2021-03-24T12:04:49.622 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.622+0000 7fb478713080 20 remove_watcher() i=5 2021-03-24T12:04:49.624 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.622+0000 7fb478713080 20 remove_watcher() i=6 2021-03-24T12:04:49.626 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.626+0000 7fb478713080 20 remove_watcher() i=7 2021-03-24T12:04:49.635 INFO:teuthology.orchestra.run.smithi161.stdout:[] 2021-03-24T12:04:49.636 DEBUG:tasks.util.rgw: json result: [] 2021-03-24T12:04:49.794 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-03-24T12:04:49.795 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-03-24T12:04:49.795 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-03-24T12:04:49.837 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:04:49.838 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:04:49.851 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.850+0000 7fcc30cf8080 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-03-24T12:04:49.851 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.850+0000 7fcc30cf8080 20 check_secure_mon_conn(): mode 1 is insecure 2021-03-24T12:04:49.859 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.858+0000 7fcbad7fa700 20 reqs_thread_entry: start 2021-03-24T12:04:49.860 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.858+0000 7fcc30cf8080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.861 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.858+0000 7fcc30cf8080 20 rados_obj.operate() r=0 bl.length=46 2021-03-24T12:04:49.861 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.858+0000 7fcc30cf8080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.862 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.858+0000 7fcc30cf8080 20 rados_obj.operate() r=0 bl.length=839 2021-03-24T12:04:49.862 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.858+0000 7fcc30cf8080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.862 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.858+0000 7fcc30cf8080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:49.863 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.858+0000 7fcc30cf8080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.863 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.862+0000 7fcc30cf8080 20 rados_obj.operate() r=0 bl.length=46 2021-03-24T12:04:49.863 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.862+0000 7fcc30cf8080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.864 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.862+0000 7fcc30cf8080 20 rados_obj.operate() r=0 bl.length=358 2021-03-24T12:04:49.873 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"36c8c46e-d40b-4efa-b125-e915e99f5722","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-03-24T12:04:49.874 DEBUG:tasks.util.rgw: json result: {'id': '36c8c46e-d40b-4efa-b125-e915e99f5722', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': ''} 2021-03-24T12:04:49.874 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['user', 'list'] 2021-03-24T12:04:49.875 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'user', 'list'] 2021-03-24T12:04:49.875 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 user list 2021-03-24T12:04:49.942 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:04:49.943 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:04:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.950+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.950+0000 7fe5ec7f7080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.950+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.950+0000 7fe5ec7f7080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.950+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.954 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.950+0000 7fe5ec7f7080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:49.954 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.950+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.954 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.950+0000 7fe5ec7f7080 20 rados_obj.operate() r=0 bl.length=46 2021-03-24T12:04:49.967 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.966+0000 7fe5ec7f7080 20 RGWRados::pool_iterate: got zonegroup_info.d914f1fa-db04-4071-9936-23f51307b13c 2021-03-24T12:04:49.968 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.966+0000 7fe5ec7f7080 20 RGWRados::pool_iterate: got zone_info.36c8c46e-d40b-4efa-b125-e915e99f5722 2021-03-24T12:04:49.968 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.966+0000 7fe5ec7f7080 20 RGWRados::pool_iterate: got zone_names.default 2021-03-24T12:04:49.968 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.966+0000 7fe5ec7f7080 20 RGWRados::pool_iterate: got zonegroups_names.default 2021-03-24T12:04:49.968 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.966+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.969 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.966+0000 7fe5ec7f7080 20 rados_obj.operate() r=0 bl.length=46 2021-03-24T12:04:49.969 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.966+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.971 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.970+0000 7fe5ec7f7080 20 rados_obj.operate() r=0 bl.length=855 2021-03-24T12:04:49.971 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.970+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.971 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.970+0000 7fe5ec7f7080 20 rados_obj.operate() r=0 bl.length=46 2021-03-24T12:04:49.972 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.970+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.972 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.970+0000 7fe5ec7f7080 20 rados_obj.operate() r=0 bl.length=358 2021-03-24T12:04:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.970+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.970+0000 7fe5ec7f7080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.970+0000 7fe5ec7f7080 10 cannot find current period zonegroup using local zonegroup 2021-03-24T12:04:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.970+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.975 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.970+0000 7fe5ec7f7080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:49.975 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.970+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.975 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.970+0000 7fe5ec7f7080 20 rados_obj.operate() r=0 bl.length=46 2021-03-24T12:04:49.976 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.970+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.976 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 20 rados_obj.operate() r=0 bl.length=358 2021-03-24T12:04:49.976 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 20 zonegroup default 2021-03-24T12:04:49.976 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.977 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:49.977 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 10 Cannot find current period zone using local zone 2021-03-24T12:04:49.977 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.977 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:49.977 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.978 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 20 rados_obj.operate() r=0 bl.length=46 2021-03-24T12:04:49.978 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.979 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 20 rados_obj.operate() r=0 bl.length=855 2021-03-24T12:04:49.979 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 20 zone default found 2021-03-24T12:04:49.979 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.980 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:49.980 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 20 rados->read ofs=0 len=0 2021-03-24T12:04:49.980 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:49.981 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 20 started sync module instance, tier type = 2021-03-24T12:04:49.981 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:49.974+0000 7fe5ec7f7080 20 started zone id=36c8c46e-d40b-4efa-b125-e915e99f5722 (name=default) with tier type = 2021-03-24T12:04:50.014 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.010+0000 7fe5ec7f7080 20 add_watcher() i=0 2021-03-24T12:04:50.015 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.010+0000 7fe5ec7f7080 20 add_watcher() i=1 2021-03-24T12:04:50.015 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.010+0000 7fe5ec7f7080 20 add_watcher() i=2 2021-03-24T12:04:50.015 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.010+0000 7fe5ec7f7080 20 add_watcher() i=3 2021-03-24T12:04:50.015 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.010+0000 7fe5ec7f7080 20 add_watcher() i=4 2021-03-24T12:04:50.016 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.010+0000 7fe5ec7f7080 20 add_watcher() i=5 2021-03-24T12:04:50.016 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.010+0000 7fe5ec7f7080 20 add_watcher() i=6 2021-03-24T12:04:50.017 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.014+0000 7fe5ec7f7080 20 add_watcher() i=7 2021-03-24T12:04:50.017 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.014+0000 7fe5ec7f7080 2 all 8 watchers are set, enabling cache 2021-03-24T12:04:50.017 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.014+0000 7fe5ec7f7080 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-03-24T12:04:50.017 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.014+0000 7fe5ec7f7080 20 check_secure_mon_conn(): mode 1 is insecure 2021-03-24T12:04:50.018 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.014+0000 7fe5a97e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-03-24T12:04:50.105 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.102+0000 7fe51b7fe700 20 reqs_thread_entry: start 2021-03-24T12:04:50.105 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.102+0000 7fe5197fa700 20 reqs_thread_entry: start 2021-03-24T12:04:50.105 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.102+0000 7fe5ec7f7080 20 init_complete bucket index max shards: 11 2021-03-24T12:04:50.106 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.102+0000 7fe5077fe700 20 reqs_thread_entry: start 2021-03-24T12:04:50.126 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.122+0000 7fe5a97e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-03-24T12:04:50.128 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.126+0000 7fe5ec7f7080 20 remove_watcher() i=0 2021-03-24T12:04:50.128 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.126+0000 7fe5ec7f7080 2 removed watcher, disabling cache 2021-03-24T12:04:50.130 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.130+0000 7fe5ec7f7080 20 remove_watcher() i=1 2021-03-24T12:04:50.132 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.130+0000 7fe5ec7f7080 20 remove_watcher() i=2 2021-03-24T12:04:50.135 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.134+0000 7fe5ec7f7080 20 remove_watcher() i=3 2021-03-24T12:04:50.137 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.134+0000 7fe5ec7f7080 20 remove_watcher() i=4 2021-03-24T12:04:50.140 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.138+0000 7fe5ec7f7080 20 remove_watcher() i=5 2021-03-24T12:04:50.142 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.142+0000 7fe5ec7f7080 20 remove_watcher() i=6 2021-03-24T12:04:50.145 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.142+0000 7fe5ec7f7080 20 remove_watcher() i=7 2021-03-24T12:04:50.152 INFO:teuthology.orchestra.run.smithi161.stdout:[] 2021-03-24T12:04:50.153 DEBUG:tasks.util.rgw: json result: [] 2021-03-24T12:04:50.153 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-03-24T12:04:50.153 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-03-24T12:04:50.154 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-03-24T12:04:50.236 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:04:50.236 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:04:50.249 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.246+0000 7fd6f8456080 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-03-24T12:04:50.249 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.246+0000 7fd6f8456080 20 check_secure_mon_conn(): mode 1 is insecure 2021-03-24T12:04:50.255 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.254+0000 7fd684ff9700 20 reqs_thread_entry: start 2021-03-24T12:04:50.255 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.254+0000 7fd6f8456080 20 rados->read ofs=0 len=0 2021-03-24T12:04:50.256 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.254+0000 7fd6f8456080 20 rados_obj.operate() r=0 bl.length=46 2021-03-24T12:04:50.256 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.254+0000 7fd6f8456080 20 rados->read ofs=0 len=0 2021-03-24T12:04:50.257 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.254+0000 7fd6f8456080 20 rados_obj.operate() r=0 bl.length=855 2021-03-24T12:04:50.257 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.254+0000 7fd6f8456080 20 rados->read ofs=0 len=0 2021-03-24T12:04:50.258 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.254+0000 7fd6f8456080 20 rados_obj.operate() r=-2 bl.length=0 2021-03-24T12:04:50.258 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.254+0000 7fd6f8456080 20 rados->read ofs=0 len=0 2021-03-24T12:04:50.259 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.258+0000 7fd6f8456080 20 rados_obj.operate() r=0 bl.length=46 2021-03-24T12:04:50.259 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.258+0000 7fd6f8456080 20 rados->read ofs=0 len=0 2021-03-24T12:04:50.259 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:04:50.258+0000 7fd6f8456080 20 rados_obj.operate() r=0 bl.length=358 2021-03-24T12:04:50.268 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"36c8c46e-d40b-4efa-b125-e915e99f5722","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-03-24T12:04:50.269 DEBUG:tasks.util.rgw: json result: {'id': '36c8c46e-d40b-4efa-b125-e915e99f5722', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': ''} 2021-03-24T12:04:50.270 INFO:tasks.rgw:Starting rgw... 2021-03-24T12:04:50.270 INFO:tasks.rgw:rgw c1.client.0 config is {'port': 8000} 2021-03-24T12:04:50.271 INFO:tasks.rgw:Using beast as radosgw frontend 2021-03-24T12:04:50.272 INFO:tasks.rgw.c1.client.0:Restarting daemon 2021-03-24T12:04:50.274 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2021-03-24T12:04:50.277 INFO:tasks.rgw.c1.client.0:Started 2021-03-24T12:04:50.277 INFO:tasks.rgw:rgw c2.client.0 config is {'port': 8000} 2021-03-24T12:04:50.278 INFO:tasks.rgw:Using beast as radosgw frontend 2021-03-24T12:04:50.278 INFO:tasks.rgw.c2.client.0:Restarting daemon 2021-03-24T12:04:50.278 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2021-03-24T12:04:50.311 INFO:tasks.rgw.c2.client.0:Started 2021-03-24T12:04:50.312 INFO:tasks.rgw:rgw c2.client.1 config is {'port': 8001} 2021-03-24T12:04:50.312 INFO:tasks.rgw:Using beast as radosgw frontend 2021-03-24T12:04:50.313 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-03-24T12:04:50.313 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-03-24T12:04:50.316 INFO:tasks.rgw.c2.client.1:Started 2021-03-24T12:04:50.316 INFO:tasks.rgw:Polling c1.client.0 until it starts accepting connections on http://smithi043.front.sepia.ceph.com:8000/ 2021-03-24T12:04:50.316 DEBUG:teuthology.orchestra.run.smithi043:> curl http://smithi043.front.sepia.ceph.com:8000/ 2021-03-24T12:04:50.344 INFO:teuthology.orchestra.run.smithi043.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-03-24T12:04:50.345 INFO:teuthology.orchestra.run.smithi043.stderr: Dload Upload Total Spent Left Speed 2021-03-24T12:04:50.349 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-03-24T12:04:50.350 INFO:teuthology.orchestra.run.smithi043.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi043.front.sepia.ceph.com port 8000: Connection refused 2021-03-24T12:04:51.352 DEBUG:teuthology.orchestra.run.smithi043:> curl http://smithi043.front.sepia.ceph.com:8000/ 2021-03-24T12:04:51.369 INFO:teuthology.orchestra.run.smithi043.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-03-24T12:04:51.369 INFO:teuthology.orchestra.run.smithi043.stderr: Dload Upload Total Spent Left Speed 2021-03-24T12:04:51.375 INFO:teuthology.orchestra.run.smithi043.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 35666 0 --:--:-- --:--:-- --:--:-- 35666 2021-03-24T12:04:51.375 INFO:teuthology.orchestra.run.smithi043.stdout:anonymous 2021-03-24T12:04:51.375 INFO:tasks.rgw:Polling c2.client.0 until it starts accepting connections on http://smithi161.front.sepia.ceph.com:8000/ 2021-03-24T12:04:51.376 DEBUG:teuthology.orchestra.run.smithi161:> curl http://smithi161.front.sepia.ceph.com:8000/ 2021-03-24T12:04:51.399 INFO:teuthology.orchestra.run.smithi161.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-03-24T12:04:51.399 INFO:teuthology.orchestra.run.smithi161.stderr: Dload Upload Total Spent Left Speed 2021-03-24T12:04:51.404 INFO:teuthology.orchestra.run.smithi161.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 21400 0 --:--:-- --:--:-- --:--:-- 42800 2021-03-24T12:04:51.405 INFO:teuthology.orchestra.run.smithi161.stdout:anonymous 2021-03-24T12:04:51.405 INFO:tasks.rgw:Polling c2.client.1 until it starts accepting connections on http://smithi161.front.sepia.ceph.com:8001/ 2021-03-24T12:04:51.406 DEBUG:teuthology.orchestra.run.smithi161:> curl http://smithi161.front.sepia.ceph.com:8001/ 2021-03-24T12:04:51.461 INFO:teuthology.orchestra.run.smithi161.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-03-24T12:04:51.461 INFO:teuthology.orchestra.run.smithi161.stderr: Dload Upload Total Spent Left Speed 2021-03-24T12:04:51.466 INFO:teuthology.orchestra.run.smithi161.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2021-03-24T12:04:51.467 INFO:teuthology.orchestra.run.smithi161.stdout:anonymous 2021-03-24T12:04:51.468 INFO:teuthology.run_tasks:Running task rgw-multisite... 2021-03-24T12:04:51.930 INFO:tasks.rgw_multisite:creating realm.. 2021-03-24T12:04:51.931 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:04:51.931 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:04:51.932 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 realm create --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:04:51.971 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:04:51.972 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:04:52.021 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","name":"test-realm","current_period":"32291947-c5fa-4ba1-ac84-1accafc8f8b8","epoch":1} 2021-03-24T12:04:52.021 INFO:tasks.rgw_multisite:creating master zonegroup.. 2021-03-24T12:04:52.022 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:04:52.022 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:04:52.023 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup set --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:04:52.101 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:04:52.101 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:04:52.123 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:04:52.122+0000 7fc200203080 -1 old format 2021-03-24T12:04:52.138 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[],"default_placement":"","realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","sync_policy":{"groups":[]}} 2021-03-24T12:04:52.139 INFO:tasks.rgw_multisite:creating master zone.. 2021-03-24T12:04:52.139 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'SS7NZB400H0K0O9S', '--secret', '74rdtoceN30ZdgFImKNThm7gPyMKZRqM', '--endpoints', 'http://smithi043.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:04:52.139 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'SS7NZB400H0K0O9S', '--secret', '74rdtoceN30ZdgFImKNThm7gPyMKZRqM', '--endpoints', 'http://smithi043.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:04:52.140 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --master --access-key SS7NZB400H0K0O9S --secret 74rdtoceN30ZdgFImKNThm7gPyMKZRqM --endpoints http://smithi043.front.sepia.ceph.com:8000 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:04:52.227 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:04:52.228 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:04:52.293 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"37e7d5ac-1249-4c4d-9b86-81fc80607142","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"SS7NZB400H0K0O9S","secret_key":"74rdtoceN30ZdgFImKNThm7gPyMKZRqM"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1"} 2021-03-24T12:04:52.294 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph osd pool create test-zone1.rgw.buckets.data 64 64 --cluster c1 2021-03-24T12:04:53.444 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'test-zone1.rgw.buckets.data' created 2021-03-24T12:04:53.459 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph osd pool application enable test-zone1.rgw.buckets.data rgw --cluster c1 2021-03-24T12:04:54.460 INFO:teuthology.orchestra.run.smithi043.stderr:enabled application 'rgw' on pool 'test-zone1.rgw.buckets.data' 2021-03-24T12:04:54.476 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:04:54.476 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:04:54.477 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:04:54.512 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:04:54.512 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:04:54.541 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"37e7d5ac-1249-4c4d-9b86-81fc80607142","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"SS7NZB400H0K0O9S","secret_key":"74rdtoceN30ZdgFImKNThm7gPyMKZRqM"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-03-24T12:04:54.542 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:04:54.543 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:04:54.543 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:04:54.622 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:04:54.622 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:05:02.662 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"5d6d539e-fcb5-4061-8385-16fad563da6c","epoch":1,"predecessor_uuid":"32291947-c5fa-4ba1-ac84-1accafc8f8b8","sync_status":[],"period_map":{"id":"5d6d539e-fcb5-4061-8385-16fad563da6c","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","zones":[{"id":"37e7d5ac-1249-4c4d-9b86-81fc80607142","name":"test-zone1","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"false","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"37e7d5ac-1249-4c4d-9b86-81fc80607142","val":3859867623}]},"master_zonegroup":"test-zonegroup","master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","realm_name":"test-realm","realm_epoch":2} 2021-03-24T12:05:02.662 DEBUG:tasks.rgw.c1.client.0:waiting for process to exit 2021-03-24T12:05:02.677 INFO:teuthology.orchestra.run:waiting for 300 2021-03-24T12:05:02.705 INFO:tasks.rgw.c1.client.0.smithi043.stdout:2021-03-24T12:05:02.706+0000 7f69677fe700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground (PID: 14528) UID: 0 2021-03-24T12:05:02.706 INFO:tasks.rgw.c1.client.0.smithi043.stdout:2021-03-24T12:05:02.706+0000 7f6982f580c0 -1 shutting down 2021-03-24T12:05:05.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 is failed for ~0s 2021-03-24T12:05:08.779 INFO:tasks.rgw.c1.client.0:Stopped 2021-03-24T12:05:08.781 INFO:tasks.rgw.c1.client.0:Restarting daemon 2021-03-24T12:05:08.782 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2021-03-24T12:05:08.786 INFO:tasks.rgw.c1.client.0:Started 2021-03-24T12:05:08.787 DEBUG:teuthology.orchestra.run.smithi043:> curl http://smithi043.front.sepia.ceph.com:8000 2021-03-24T12:05:08.805 INFO:teuthology.orchestra.run.smithi043.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-03-24T12:05:08.805 INFO:teuthology.orchestra.run.smithi043.stderr: Dload Upload Total Spent Left Speed 2021-03-24T12:05:08.809 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-03-24T12:05:08.811 INFO:teuthology.orchestra.run.smithi043.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi043.front.sepia.ceph.com port 8000: Connection refused 2021-03-24T12:05:09.812 DEBUG:teuthology.orchestra.run.smithi043:> curl http://smithi043.front.sepia.ceph.com:8000 2021-03-24T12:05:09.828 INFO:teuthology.orchestra.run.smithi043.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-03-24T12:05:09.829 INFO:teuthology.orchestra.run.smithi043.stderr: Dload Upload Total Spent Left Speed 2021-03-24T12:05:09.834 INFO:teuthology.orchestra.run.smithi043.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2021-03-24T12:05:09.835 INFO:teuthology.orchestra.run.smithi043.stdout:anonymous 2021-03-24T12:05:09.835 INFO:tasks.rgw_multisite:creating admin user.. 2021-03-24T12:05:09.835 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'SS7NZB400H0K0O9S', '--secret', '74rdtoceN30ZdgFImKNThm7gPyMKZRqM', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:09.836 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'SS7NZB400H0K0O9S', '--secret', '74rdtoceN30ZdgFImKNThm7gPyMKZRqM', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:09.836 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid realm-admin --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Realm Admin' --system --access-key SS7NZB400H0K0O9S --secret 74rdtoceN30ZdgFImKNThm7gPyMKZRqM --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:05:09.923 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:05:09.924 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:05:10.077 INFO:teuthology.orchestra.run.smithi043.stdout:{"user_id":"realm-admin","display_name":"Realm Admin","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"realm-admin","access_key":"SS7NZB400H0K0O9S","secret_key":"74rdtoceN30ZdgFImKNThm7gPyMKZRqM"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","system":"true","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2021-03-24T12:05:10.100 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2021-03-24T12:05:10.100 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi043.front.sepia.ceph.com:8000', '--access-key', 'SS7NZB400H0K0O9S', '--secret', '74rdtoceN30ZdgFImKNThm7gPyMKZRqM', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:10.101 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi043.front.sepia.ceph.com:8000', '--access-key', 'SS7NZB400H0K0O9S', '--secret', '74rdtoceN30ZdgFImKNThm7gPyMKZRqM', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:10.101 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://smithi043.front.sepia.ceph.com:8000 --access-key SS7NZB400H0K0O9S --secret 74rdtoceN30ZdgFImKNThm7gPyMKZRqM --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:05:10.145 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:05:10.146 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:05:10.260 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","name":"test-realm","current_period":"5d6d539e-fcb5-4061-8385-16fad563da6c","epoch":2} 2021-03-24T12:05:10.261 INFO:tasks.rgw_multisite:creating zone.. 2021-03-24T12:05:10.261 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'SS7NZB400H0K0O9S', '--secret', '74rdtoceN30ZdgFImKNThm7gPyMKZRqM', '--endpoints', 'http://smithi161.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:10.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'SS7NZB400H0K0O9S', '--secret', '74rdtoceN30ZdgFImKNThm7gPyMKZRqM', '--endpoints', 'http://smithi161.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:10.262 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --access-key SS7NZB400H0K0O9S --secret 74rdtoceN30ZdgFImKNThm7gPyMKZRqM --endpoints http://smithi161.front.sepia.ceph.com:8000 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:05:10.306 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:05:10.307 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:05:10.361 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:05:10.354+0000 7f95ec7fa080 0 failed reading obj info from .rgw.root:zone_info.37e7d5ac-1249-4c4d-9b86-81fc80607142: (2) No such file or directory 2021-03-24T12:05:10.361 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:05:10.354+0000 7f95ec7fa080 0 WARNING: could not read zone params for zone id=37e7d5ac-1249-4c4d-9b86-81fc80607142 name=test-zone1 2021-03-24T12:05:10.374 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"SS7NZB400H0K0O9S","secret_key":"74rdtoceN30ZdgFImKNThm7gPyMKZRqM"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1"} 2021-03-24T12:05:10.375 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph osd pool create test-zone2.rgw.buckets.data 64 64 --cluster c2 2021-03-24T12:05:10.889 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 has been restored 2021-03-24T12:05:11.474 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'test-zone2.rgw.buckets.data' created 2021-03-24T12:05:11.489 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph osd pool application enable test-zone2.rgw.buckets.data rgw --cluster c2 2021-03-24T12:05:12.501 INFO:teuthology.orchestra.run.smithi161.stderr:enabled application 'rgw' on pool 'test-zone2.rgw.buckets.data' 2021-03-24T12:05:12.514 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:12.515 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:12.515 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:05:12.550 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:05:12.550 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:05:12.575 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"SS7NZB400H0K0O9S","secret_key":"74rdtoceN30ZdgFImKNThm7gPyMKZRqM"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-03-24T12:05:12.576 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:12.576 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:12.577 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:05:12.657 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:05:12.657 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:05:20.644 INFO:teuthology.orchestra.run.smithi161.stderr:Sending period to new master zone 37e7d5ac-1249-4c4d-9b86-81fc80607142 2021-03-24T12:05:21.725 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"5d6d539e-fcb5-4061-8385-16fad563da6c","epoch":2,"predecessor_uuid":"32291947-c5fa-4ba1-ac84-1accafc8f8b8","sync_status":[],"period_map":{"id":"5d6d539e-fcb5-4061-8385-16fad563da6c","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","zones":[{"id":"37e7d5ac-1249-4c4d-9b86-81fc80607142","name":"test-zone1","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","endpoints":["http://smithi161.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"37e7d5ac-1249-4c4d-9b86-81fc80607142","val":3859867623},{"key":"4ed88107-7c59-4fb2-81d2-61fd98250599","val":3203212006}]},"master_zonegroup":"test-zonegroup","master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","realm_name":"test-realm","realm_epoch":2} 2021-03-24T12:05:21.726 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2021-03-24T12:05:21.731 INFO:teuthology.orchestra.run:waiting for 300 2021-03-24T12:05:21.770 INFO:tasks.rgw.c2.client.0.smithi161.stdout:2021-03-24T12:05:21.766+0000 7f6095ffb700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground (PID: 14417) UID: 0 2021-03-24T12:05:21.770 INFO:tasks.rgw.c2.client.0.smithi161.stdout:2021-03-24T12:05:21.766+0000 7f60b17660c0 -1 shutting down 2021-03-24T12:05:27.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2021-03-24T12:05:27.833 INFO:tasks.rgw.c2.client.0:Stopped 2021-03-24T12:05:27.851 INFO:tasks.rgw.c2.client.0:Restarting daemon 2021-03-24T12:05:27.851 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2021-03-24T12:05:27.854 INFO:tasks.rgw.c2.client.0:Started 2021-03-24T12:05:27.855 DEBUG:teuthology.orchestra.run.smithi161:> curl http://smithi161.front.sepia.ceph.com:8000 2021-03-24T12:05:27.872 INFO:teuthology.orchestra.run.smithi161.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-03-24T12:05:27.873 INFO:teuthology.orchestra.run.smithi161.stderr: Dload Upload Total Spent Left Speed 2021-03-24T12:05:27.876 INFO:teuthology.orchestra.run.smithi161.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi161.front.sepia.ceph.com port 8000: Connection refused 2021-03-24T12:05:27.877 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-03-24T12:05:28.879 DEBUG:teuthology.orchestra.run.smithi161:> curl http://smithi161.front.sepia.ceph.com:8000 2021-03-24T12:05:28.894 INFO:teuthology.orchestra.run.smithi161.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-03-24T12:05:28.895 INFO:teuthology.orchestra.run.smithi161.stderr: Dload Upload Total Spent Left Speed 2021-03-24T12:05:28.899 INFO:teuthology.orchestra.run.smithi161.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2021-03-24T12:05:28.901 INFO:teuthology.orchestra.run.smithi161.stdout:anonymous 2021-03-24T12:05:28.901 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2021-03-24T12:05:28.902 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi043.front.sepia.ceph.com:8000', '--access-key', 'SS7NZB400H0K0O9S', '--secret', '74rdtoceN30ZdgFImKNThm7gPyMKZRqM', '--url', 'http://smithi043.front.sepia.ceph.com:8000', '--access-key', 'SS7NZB400H0K0O9S', '--secret', '74rdtoceN30ZdgFImKNThm7gPyMKZRqM', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:28.902 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi043.front.sepia.ceph.com:8000', '--access-key', 'SS7NZB400H0K0O9S', '--secret', '74rdtoceN30ZdgFImKNThm7gPyMKZRqM', '--url', 'http://smithi043.front.sepia.ceph.com:8000', '--access-key', 'SS7NZB400H0K0O9S', '--secret', '74rdtoceN30ZdgFImKNThm7gPyMKZRqM', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:28.903 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://smithi043.front.sepia.ceph.com:8000 --access-key SS7NZB400H0K0O9S --secret 74rdtoceN30ZdgFImKNThm7gPyMKZRqM --url http://smithi043.front.sepia.ceph.com:8000 --access-key SS7NZB400H0K0O9S --secret 74rdtoceN30ZdgFImKNThm7gPyMKZRqM --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:05:28.993 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:05:28.993 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:05:29.032 INFO:tasks.rgw.c2.client.0.smithi161.stdout:2021-03-24T12:05:29.026+0000 7f7d11dfb700 -1 rgw realm watcher: RGWRealmWatcher::handle_error oid=realms.55c56cc6-aa15-4053-86ae-c780bb8135d1.control err=-107 2021-03-24T12:05:29.053 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","name":"test-realm","current_period":"5d6d539e-fcb5-4061-8385-16fad563da6c","epoch":2} 2021-03-24T12:05:29.053 INFO:tasks.rgw_multisite:creating zone.. 2021-03-24T12:05:29.054 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'SS7NZB400H0K0O9S', '--secret', '74rdtoceN30ZdgFImKNThm7gPyMKZRqM', '--endpoints', 'http://smithi161.front.sepia.ceph.com:8001', '--tier-type', 'pubsub', '--sync-from-all=0', '--sync-from', 'test-zone1', '--tier-config', 'start_with_full_sync=false,event_retention_days=7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:29.057 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'SS7NZB400H0K0O9S', '--secret', '74rdtoceN30ZdgFImKNThm7gPyMKZRqM', '--endpoints', 'http://smithi161.front.sepia.ceph.com:8001', '--tier-type', 'pubsub', '--sync-from-all=0', '--sync-from', 'test-zone1', '--tier-config', 'start_with_full_sync=false,event_retention_days=7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:29.058 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key SS7NZB400H0K0O9S --secret 74rdtoceN30ZdgFImKNThm7gPyMKZRqM --endpoints http://smithi161.front.sepia.ceph.com:8001 --tier-type pubsub --sync-from-all=0 --sync-from test-zone1 --tier-config start_with_full_sync=false,event_retention_days=7 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:05:29.108 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:05:29.108 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:05:29.162 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:05:29.158+0000 7ff2f09c4080 0 failed reading obj info from .rgw.root:zone_info.37e7d5ac-1249-4c4d-9b86-81fc80607142: (2) No such file or directory 2021-03-24T12:05:29.163 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:05:29.158+0000 7ff2f09c4080 0 WARNING: could not read zone params for zone id=37e7d5ac-1249-4c4d-9b86-81fc80607142 name=test-zone1 2021-03-24T12:05:29.174 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"a506567f-5df7-4073-bb4a-f3e68418b9c9","name":"test-zone3","domain_root":"test-zone3.rgw.meta:root","control_pool":"test-zone3.rgw.control","gc_pool":"test-zone3.rgw.log:gc","lc_pool":"test-zone3.rgw.log:lc","log_pool":"test-zone3.rgw.log","intent_log_pool":"test-zone3.rgw.log:intent","usage_log_pool":"test-zone3.rgw.log:usage","roles_pool":"test-zone3.rgw.meta:roles","reshard_pool":"test-zone3.rgw.log:reshard","user_keys_pool":"test-zone3.rgw.meta:users.keys","user_email_pool":"test-zone3.rgw.meta:users.email","user_swift_pool":"test-zone3.rgw.meta:users.swift","user_uid_pool":"test-zone3.rgw.meta:users.uid","otp_pool":"test-zone3.rgw.otp","system_key":{"access_key":"SS7NZB400H0K0O9S","secret_key":"74rdtoceN30ZdgFImKNThm7gPyMKZRqM"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone3.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone3.rgw.buckets.data"}},"data_extra_pool":"test-zone3.rgw.buckets.non-ec","index_type":0}}],"tier_config":{"event_retention_days":7,"start_with_full_sync":false},"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1"} 2021-03-24T12:05:29.175 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph osd pool create test-zone3.rgw.buckets.data 64 64 --cluster c2 2021-03-24T12:05:30.448 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'test-zone3.rgw.buckets.data' created 2021-03-24T12:05:30.467 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph osd pool application enable test-zone3.rgw.buckets.data rgw --cluster c2 2021-03-24T12:05:31.473 INFO:teuthology.orchestra.run.smithi161.stderr:enabled application 'rgw' on pool 'test-zone3.rgw.buckets.data' 2021-03-24T12:05:31.495 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:31.496 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:31.496 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:05:31.535 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:05:31.535 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:05:31.562 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"a506567f-5df7-4073-bb4a-f3e68418b9c9","name":"test-zone3","domain_root":"test-zone3.rgw.meta:root","control_pool":"test-zone3.rgw.control","gc_pool":"test-zone3.rgw.log:gc","lc_pool":"test-zone3.rgw.log:lc","log_pool":"test-zone3.rgw.log","intent_log_pool":"test-zone3.rgw.log:intent","usage_log_pool":"test-zone3.rgw.log:usage","roles_pool":"test-zone3.rgw.meta:roles","reshard_pool":"test-zone3.rgw.log:reshard","user_keys_pool":"test-zone3.rgw.meta:users.keys","user_email_pool":"test-zone3.rgw.meta:users.email","user_swift_pool":"test-zone3.rgw.meta:users.swift","user_uid_pool":"test-zone3.rgw.meta:users.uid","otp_pool":"test-zone3.rgw.otp","system_key":{"access_key":"SS7NZB400H0K0O9S","secret_key":"74rdtoceN30ZdgFImKNThm7gPyMKZRqM"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone3.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone3.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone3.rgw.buckets.non-ec","index_type":0}}],"tier_config":{"event_retention_days":7,"start_with_full_sync":false},"realm_id":""} 2021-03-24T12:05:31.563 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:31.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:31.565 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:05:31.640 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:05:31.640 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:05:33.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2021-03-24T12:05:39.639 INFO:teuthology.orchestra.run.smithi161.stderr:Sending period to new master zone 37e7d5ac-1249-4c4d-9b86-81fc80607142 2021-03-24T12:05:40.829 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"5d6d539e-fcb5-4061-8385-16fad563da6c","epoch":3,"predecessor_uuid":"32291947-c5fa-4ba1-ac84-1accafc8f8b8","sync_status":[],"period_map":{"id":"5d6d539e-fcb5-4061-8385-16fad563da6c","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","zones":[{"id":"37e7d5ac-1249-4c4d-9b86-81fc80607142","name":"test-zone1","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","endpoints":["http://smithi161.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"a506567f-5df7-4073-bb4a-f3e68418b9c9","name":"test-zone3","endpoints":["http://smithi161.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"37e7d5ac-1249-4c4d-9b86-81fc80607142","val":3859867623},{"key":"4ed88107-7c59-4fb2-81d2-61fd98250599","val":3203212006},{"key":"a506567f-5df7-4073-bb4a-f3e68418b9c9","val":3546318610}]},"master_zonegroup":"test-zonegroup","master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","realm_name":"test-realm","realm_epoch":2} 2021-03-24T12:05:40.830 DEBUG:tasks.rgw.c2.client.1:waiting for process to exit 2021-03-24T12:05:40.831 INFO:teuthology.orchestra.run:waiting for 300 2021-03-24T12:05:40.873 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:05:40.870+0000 7fb41effd700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground (PID: 14421) UID: 0 2021-03-24T12:05:40.874 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:05:40.870+0000 7fb442e020c0 -1 shutting down 2021-03-24T12:05:44.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 is failed for ~0s 2021-03-24T12:05:46.936 INFO:tasks.rgw.c2.client.1:Stopped 2021-03-24T12:05:46.937 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-03-24T12:05:46.938 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-03-24T12:05:46.942 INFO:tasks.rgw.c2.client.1:Started 2021-03-24T12:05:46.943 DEBUG:teuthology.orchestra.run.smithi161:> curl http://smithi161.front.sepia.ceph.com:8001 2021-03-24T12:05:46.960 INFO:teuthology.orchestra.run.smithi161.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-03-24T12:05:46.961 INFO:teuthology.orchestra.run.smithi161.stderr: Dload Upload Total Spent Left Speed 2021-03-24T12:05:46.963 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-03-24T12:05:46.965 INFO:teuthology.orchestra.run.smithi161.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi161.front.sepia.ceph.com port 8001: Connection refused 2021-03-24T12:05:47.967 DEBUG:teuthology.orchestra.run.smithi161:> curl http://smithi161.front.sepia.ceph.com:8001 2021-03-24T12:05:47.985 INFO:teuthology.orchestra.run.smithi161.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-03-24T12:05:47.985 INFO:teuthology.orchestra.run.smithi161.stderr: Dload Upload Total Spent Left Speed 2021-03-24T12:05:47.991 INFO:teuthology.orchestra.run.smithi161.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 134 100 134 0 0 26800 0 --:--:-- --:--:-- --:--:-- 26800 2021-03-24T12:05:47.991 INFO:teuthology.orchestra.run.smithi161.stdout:{"Code":"MethodNotAllowed","RequestId":"tx000000000000000000001-00605b2b1b-10e4-test-zone3","HostId":"10e4-test-zone3-test-zonegroup"} 2021-03-24T12:05:47.992 INFO:tasks.rgw_multisite:rgw multisite configuration completed 2021-03-24T12:05:47.992 INFO:teuthology.run_tasks:Running task rgw-multisite-tests... 2021-03-24T12:05:48.008 INFO:tasks.rgw_multisite_tests:cloning suite branch octopus from https://github.com/ceph/ceph.git... 2021-03-24T12:05:48.015 DEBUG:teuthology.repo_utils:Setting repo remote to https://github.com/ceph/ceph.git 2021-03-24T12:05:48.034 INFO:teuthology.repo_utils:Fetching octopus from origin 2021-03-24T12:05:49.574 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/github.com_ceph_ceph_octopus to origin/octopus 2021-03-24T12:05:50.452 INFO:tasks.rgw_multisite_tests:importing tests from /home/teuthworker/src/github.com_ceph_ceph_octopus/src/test/rgw/rgw_multi 2021-03-24T12:05:50.478 INFO:tasks.rgw_multisite_tests:creating test user.. 2021-03-24T12:05:50.478 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:50.479 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:05:50.480 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid rgw-multisite-test-user --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Multisite Test User' --gen-access-key --gen-secret --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:05:50.525 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:05:50.526 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:05:50.685 INFO:teuthology.orchestra.run.smithi043.stdout:{"user_id":"rgw-multisite-test-user","display_name":"Multisite Test User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"rgw-multisite-test-user","access_key":"ZPUPJSL5CZVXDMECXS7P","secret_key":"v7BOjJJkwY5wNTKRyF1o4bgXnkBFUrNcFOt5LyIG"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2021-03-24T12:05:50.712 INFO:rgw_multi.tests:meta checkpoint 2021-03-24T12:05:50.712 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:05:50.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:05:50.713 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:05:50.795 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:05:50.795 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:05:50.941 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:05:50.971 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-03-24T12:05:50.971 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:05:50.972 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:05:50.972 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:05:50.973 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:05:51.016 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:05:51.016 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:05:51.187 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 has been restored 2021-03-24T12:05:51.199 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:05:51.199 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:05:56.201 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:05:56.203 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:05:56.204 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:05:56.244 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:05:56.244 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:05:56.427 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:05:56.428 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:06:01.429 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:01.429 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:01.430 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:06:01.472 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:06:01.473 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:06:01.641 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:06:01.641 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:06:06.642 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:06.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:06.647 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:06:06.687 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:06:06.688 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:06:06.904 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:06:06.905 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:06:11.907 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:11.907 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:11.908 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:06:11.948 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:06:11.949 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:06:12.133 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:06:12.134 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:06:17.135 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:17.136 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:17.136 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:06:17.176 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:06:17.176 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:06:17.371 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:06:17.371 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:06:22.373 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:22.373 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:22.374 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:06:22.414 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:06:22.415 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:06:22.606 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:06:22.607 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:06:27.608 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:27.609 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:27.610 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:06:27.649 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:06:27.650 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:06:27.828 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:06:27.829 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:06:32.831 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:32.831 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:32.832 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:06:32.873 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:06:32.874 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:06:33.081 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:06:33.082 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:06:38.083 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:38.084 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:38.084 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:06:38.126 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:06:38.126 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:06:38.326 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:06:38.327 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:06:43.328 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:43.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:43.329 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:06:43.370 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:06:43.370 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:06:43.548 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:06:43.549 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:06:48.550 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:48.551 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:48.551 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:06:48.590 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:06:48.590 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:06:48.787 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:06:48.787 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:06:53.788 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:53.789 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:53.790 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:06:53.836 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:06:53.836 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:06:54.037 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:06:54.037 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:06:59.038 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:59.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:06:59.043 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:06:59.085 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:06:59.085 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:06:59.291 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:06:59.291 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:07:04.292 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:04.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:04.297 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:07:04.337 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:07:04.337 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:07:04.522 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:07:04.522 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:07:09.524 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:09.525 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:09.525 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:07:09.564 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:07:09.565 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:07:09.759 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:07:09.760 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:07:14.761 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:14.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:14.762 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:07:14.804 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:07:14.804 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:07:15.006 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:07:15.007 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:07:20.008 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:20.009 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:20.009 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:07:20.051 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:07:20.051 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:07:20.244 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:07:20.245 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:07:25.246 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:25.247 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:25.247 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:07:25.288 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:07:25.288 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:07:25.474 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:07:25.475 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:07:30.476 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:30.477 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:30.477 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:07:30.521 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:07:30.521 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:07:30.737 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:07:30.737 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:07:35.738 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:35.739 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:35.740 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:07:35.780 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:07:35.781 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:07:35.973 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:07:35.973 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:07:40.974 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:40.975 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:40.975 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:07:41.015 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:07:41.016 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:07:41.211 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:07:41.211 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1616587550.682762_31.1 target= 2021-03-24T12:07:46.212 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:46.213 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:46.213 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:07:46.254 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:07:46.255 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:07:46.463 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:07:46.464 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:07:46.464 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:07:46.465 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:46.465 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:46.466 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:07:46.543 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:07:46.543 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:07:46.801 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:07:46.802 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:07:46.803 INFO:rgw_multi.tests:meta checkpoint 2021-03-24T12:07:46.803 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:46.803 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:46.804 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:07:46.844 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:07:46.845 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:07:47.003 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:07:47.033 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-03-24T12:07:47.034 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:07:47.034 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:47.034 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:47.035 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:07:47.075 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:07:47.075 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:07:47.274 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:07:47.274 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:07:47.275 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:07:47.275 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:47.276 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:47.276 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:07:47.356 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:07:47.356 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:07:47.614 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:07:47.614 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:07:47.615 INFO:tasks.rgw_multisite_tests:running rgw multisite tests on '/home/teuthworker/src/github.com_ceph_ceph_octopus/src/test/rgw/rgw_multi' with args=['tests.py', 'tests_ps.py'] 2021-03-24T12:07:47.676 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-1 2021-03-24T12:07:51.532 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-2 2021-03-24T12:07:55.547 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:55.548 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:55.549 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:07:55.588 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:07:55.588 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:07:55.741 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:07:55.770 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616587671.561122_33.1","last_update":"2021-03-24T12:07:51.561122Z"}] 2021-03-24T12:07:55.771 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:07:55.772 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:55.772 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:55.773 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:07:55.811 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:07:55.812 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:07:56.008 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587671.561122_33.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:07:51.561122Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:07:56.009 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:07:56.009 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:07:56.010 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:56.010 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:07:56.011 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:07:56.088 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:07:56.088 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:07:56.340 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587671.525015_26.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:07:51.525015Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:07:56.341 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=3 master=1_1616587671.561122_33.1 target=1_1616587671.525015_26.1 2021-03-24T12:08:01.342 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:01.343 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:01.343 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:01.384 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:01.385 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:01.639 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587671.561122_33.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:07:51.561122Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:01.639 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:08:01.659 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_create ... ok 2021-03-24T12:08:01.661 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-3 2021-03-24T12:08:01.687 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-4 2021-03-24T12:08:01.735 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:01.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:01.736 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:01.773 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:01.774 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:01.925 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:08:01.955 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616587681.715179_41.1","last_update":"2021-03-24T12:08:01.715179Z"}] 2021-03-24T12:08:01.956 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:08:01.957 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:01.957 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:01.958 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:01.998 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:01.998 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:02.189 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587671.561122_33.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:07:51.561122Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:02.189 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1616587681.715179_41.1 target=1_1616587671.561122_33.1 2021-03-24T12:08:07.191 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:07.191 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:07.192 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:07.233 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:07.233 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:07.423 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587681.715179_41.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:01.715179Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:07.423 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:08:07.424 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:08:07.425 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:07.425 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:07.426 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:07.506 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:07.506 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:07.754 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587681.715179_41.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:01.715179Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:07.754 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:08:07.998 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:07.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:07.999 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:08.037 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:08.037 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:08.189 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:08:08.219 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616587687.911786_60.1","last_update":"2021-03-24T12:08:07.911786Z"}] 2021-03-24T12:08:08.219 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:08:08.220 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:08.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:08.222 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:08.263 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:08.264 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:08.445 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587681.715179_41.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:01.715179Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:08.446 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1616587687.911786_60.1 target=1_1616587681.715179_41.1 2021-03-24T12:08:13.447 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:13.448 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:13.448 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:13.498 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:13.499 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:13.692 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587687.911786_60.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:07.911786Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:13.693 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:08:13.693 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:08:13.694 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:13.694 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:13.695 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:13.735 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:13.735 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:13.990 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587687.911786_60.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:07.911786Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:13.991 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:08:14.009 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_recreate ... ok 2021-03-24T12:08:14.010 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-5 2021-03-24T12:08:14.036 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-6 2021-03-24T12:08:14.088 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:14.089 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:14.090 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:14.130 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:14.131 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:14.281 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:08:14.311 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616587694.067610_71.1","last_update":"2021-03-24T12:08:14.067610Z"}] 2021-03-24T12:08:14.311 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:08:14.312 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:14.312 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:14.313 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:14.353 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:14.353 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:14.558 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587687.911786_60.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:07.911786Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:14.558 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1616587694.067610_71.1 target=1_1616587687.911786_60.1 2021-03-24T12:08:19.559 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:19.560 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:19.561 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:19.603 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:19.604 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:19.789 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587694.067610_71.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:14.067610Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:19.789 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:08:19.790 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:08:19.790 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:19.791 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:19.791 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:19.872 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:19.873 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:20.125 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587694.067610_71.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:14.067610Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:20.126 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:08:20.237 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:20.238 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:20.239 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:20.277 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:20.278 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:20.421 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:08:20.450 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616587700.216525_75.1","last_update":"2021-03-24T12:08:20.216525Z"}] 2021-03-24T12:08:20.451 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:08:20.451 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:20.452 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:20.452 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:20.493 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:20.494 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:20.685 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587694.067610_71.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:14.067610Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:20.686 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1616587700.216525_75.1 target=1_1616587694.067610_71.1 2021-03-24T12:08:25.688 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:25.689 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:25.689 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:25.730 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:25.730 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:25.928 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587700.216525_75.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:20.216525Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:25.928 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:08:25.929 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:08:25.929 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:25.930 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:25.930 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:26.010 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:26.010 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:26.267 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587700.216525_75.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:20.216525Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:26.267 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:08:26.274 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_remove ... ok 2021-03-24T12:08:26.275 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-7 2021-03-24T12:08:26.302 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-8 2021-03-24T12:08:26.739 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:26.740 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:26.740 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:26.780 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:26.929 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:08:26.958 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616587706.331161_83.1","last_update":"2021-03-24T12:08:26.331161Z"}] 2021-03-24T12:08:26.959 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:08:26.959 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:26.960 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:26.960 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:27.003 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:27.004 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:27.183 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587700.216525_75.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:20.216525Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:27.184 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1616587706.331161_83.1 target=1_1616587700.216525_75.1 2021-03-24T12:08:32.185 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:32.187 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:32.188 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:32.228 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:32.228 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:32.429 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587706.331161_83.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:26.331161Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:32.430 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:08:32.430 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:08:32.431 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:32.431 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:32.432 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:32.518 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:32.518 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:32.767 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587706.331161_83.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:26.331161Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:32.767 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:08:32.768 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-7', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:32.769 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-7', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:32.769 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-7 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:32.811 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:32.811 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:32.997 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.11.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.7.5"},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.10.5"},{"key":8,"val":"00000000001.8.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:08:32.998 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-7 2021-03-24T12:08:32.999 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:32.999 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:33.000 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-7 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:33.043 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:33.043 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:33.252 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.11.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"_myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.7.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"&","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.10.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":":","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.8.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:08:33.253 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-7 2021-03-24T12:08:33.254 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-7 zones={test-zone2, test-zone1} 2021-03-24T12:08:33.264 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:08:33.273 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-03-24T12:08:33.274 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-03-24T12:08:33.274 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-03-24T12:08:33.275 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-03-24T12:08:33.275 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:08:33.282 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-03-24T12:08:33.282 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-03-24T12:08:33.283 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-03-24T12:08:33.283 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-03-24T12:08:33.341 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-03-24T12:08:33.396 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-03-24T12:08:33.506 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-03-24T12:08:33.605 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-03-24T12:08:33.659 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-03-24T12:08:33.769 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-03-24T12:08:33.873 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-03-24T12:08:33.928 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-03-24T12:08:34.038 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-03-24T12:08:34.145 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-03-24T12:08:34.199 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-03-24T12:08:34.306 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-03-24T12:08:34.408 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-7 zones={test-zone2, test-zone1} 2021-03-24T12:08:34.409 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-7', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:34.410 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-7', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:34.410 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-7 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:34.450 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:34.450 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:34.628 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.11.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.7.5"},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.10.5"},{"key":8,"val":"00000000001.8.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:08:34.629 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-7 2021-03-24T12:08:34.629 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:34.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:34.631 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-7 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:34.674 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:34.675 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:34.931 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.11.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.7.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.10.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.8.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:08:34.932 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-7 2021-03-24T12:08:34.932 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-8', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:34.933 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-8', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:34.933 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-8 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:35.015 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:35.016 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:35.204 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.3.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.7.5"},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.9.5"},{"key":8,"val":"00000000001.2.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:08:35.204 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-8 2021-03-24T12:08:35.205 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-8', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:35.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-8', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:35.207 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-8 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:35.438 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.3.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"_myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.7.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"&","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.9.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":":","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.2.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:08:35.439 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-8 2021-03-24T12:08:35.439 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-8 zones={test-zone1, test-zone2} 2021-03-24T12:08:35.448 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:08:35.495 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-03-24T12:08:35.495 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-03-24T12:08:35.496 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-03-24T12:08:35.496 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-03-24T12:08:35.497 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:08:35.501 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-03-24T12:08:35.501 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-03-24T12:08:35.502 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-03-24T12:08:35.502 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-03-24T12:08:35.555 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-03-24T12:08:35.610 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-03-24T12:08:35.721 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-03-24T12:08:35.824 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-03-24T12:08:35.879 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-03-24T12:08:35.989 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-03-24T12:08:36.092 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-03-24T12:08:36.153 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-03-24T12:08:36.265 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-03-24T12:08:36.368 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-03-24T12:08:36.423 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-03-24T12:08:36.535 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-03-24T12:08:36.633 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-8 zones={test-zone1, test-zone2} 2021-03-24T12:08:36.634 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_sync ... ok 2021-03-24T12:08:36.635 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-9 2021-03-24T12:08:36.664 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-10 2021-03-24T12:08:36.811 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:36.811 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:36.813 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:36.856 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:36.856 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:37.009 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:08:37.039 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616587716.694293_69.1","last_update":"2021-03-24T12:08:36.694293Z"},{"marker":"1_1616587716.665846_87.1","last_update":"2021-03-24T12:08:36.665846Z"}] 2021-03-24T12:08:37.040 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:08:37.040 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:37.041 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:37.041 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:37.081 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:37.082 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:37.266 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587706.331161_83.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:26.331161Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:37.266 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616587716.694293_69.1 target=, shard=3 master=1_1616587716.665846_87.1 target=1_1616587706.331161_83.1 2021-03-24T12:08:42.268 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:42.268 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:42.269 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:42.309 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:42.310 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:42.493 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587716.694293_69.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.694293Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:42.494 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:08:42.495 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:08:42.495 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:42.496 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:42.496 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:42.577 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:42.578 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:42.829 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587716.694293_69.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.694293Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:42.830 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:08:42.831 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:42.832 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:42.832 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-9 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:42.877 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:42.877 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:43.054 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.8.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:08:43.054 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-9 2021-03-24T12:08:43.055 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:43.055 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:43.056 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-9 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:43.101 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:43.102 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:43.296 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.8.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:08:43.297 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-9 2021-03-24T12:08:43.297 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-9 zones={test-zone2, test-zone1} 2021-03-24T12:08:43.306 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:08:43.359 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-03-24T12:08:43.359 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:08:43.364 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-03-24T12:08:43.420 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-03-24T12:08:43.479 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-03-24T12:08:43.586 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-03-24T12:08:43.727 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-9 zones={test-zone2, test-zone1} 2021-03-24T12:08:43.727 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:43.728 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:43.728 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-9 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:43.772 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:43.773 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:43.953 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.8.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:08:43.954 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-9 2021-03-24T12:08:43.954 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:43.955 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:43.955 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-9 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:44.000 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:44.000 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:44.258 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.8.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:08:44.259 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-9 2021-03-24T12:08:44.260 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:44.260 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:44.261 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-10 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:44.341 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:44.341 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:44.519 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.10.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:08:44.520 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-10 2021-03-24T12:08:44.521 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:44.521 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:44.522 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-10 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:44.565 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:44.566 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:44.764 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.10.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:08:44.764 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-10 2021-03-24T12:08:44.765 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-10 zones={test-zone1, test-zone2} 2021-03-24T12:08:44.775 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:08:44.823 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-03-24T12:08:44.823 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:08:44.829 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-03-24T12:08:44.884 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-03-24T12:08:44.938 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-03-24T12:08:45.053 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-03-24T12:08:45.160 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-10 zones={test-zone1, test-zone2} 2021-03-24T12:08:45.177 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:45.177 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:45.178 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-9 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:45.216 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:45.216 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:45.398 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.10.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:08:45.398 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-9 2021-03-24T12:08:45.399 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:45.399 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:45.400 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-9 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:45.444 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:45.445 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:45.661 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.8.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:08:45.662 WARNING:rgw_multi.tests:bucket jlfoya-9 zone test-zone2 behind zone test-zone1: shard=1 master=00000000002.10.5 target=00000000001.8.5 2021-03-24T12:08:50.663 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:50.664 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:50.664 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-9 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:50.708 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:50.709 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:50.905 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.10.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:08:50.905 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-9 2021-03-24T12:08:50.906 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-9 zones={test-zone2, test-zone1} 2021-03-24T12:08:50.914 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:08:50.963 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:08:51.019 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-9 zones={test-zone2, test-zone1} 2021-03-24T12:08:51.020 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:51.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:51.021 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-9 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:51.063 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:51.064 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:51.244 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.10.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:08:51.244 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-9 2021-03-24T12:08:51.245 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:51.246 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:51.246 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-9 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:51.289 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:51.290 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:51.546 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.10.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:08:51.547 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-9 2021-03-24T12:08:51.562 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:51.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:51.563 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-10 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:51.629 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:51.629 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:51.814 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.13.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:08:51.918 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-10 2021-03-24T12:08:51.919 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:51.920 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:51.920 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-10 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:51.965 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:51.966 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:52.161 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.10.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:08:52.162 WARNING:rgw_multi.tests:bucket jlfoya-10 zone test-zone1 behind zone test-zone2: shard=1 master=00000000002.13.5 target=00000000001.10.5 2021-03-24T12:08:57.163 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:57.164 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:57.164 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-10 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:57.208 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:57.208 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:57.397 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.13.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:08:57.398 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-10 2021-03-24T12:08:57.398 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-10 zones={test-zone1, test-zone2} 2021-03-24T12:08:57.408 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:08:57.455 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:08:57.515 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-10 zones={test-zone1, test-zone2} 2021-03-24T12:08:57.516 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_delete ... ok 2021-03-24T12:08:57.517 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-11 2021-03-24T12:08:57.548 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-12 2021-03-24T12:08:57.614 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:57.614 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:57.615 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:57.655 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:57.656 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:57.806 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:08:57.836 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616587737.614399_89.1","last_update":"2021-03-24T12:08:57.614399Z"},{"marker":"1_1616587716.665846_87.1","last_update":"2021-03-24T12:08:36.665846Z"}] 2021-03-24T12:08:57.837 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:08:57.837 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:57.838 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:57.839 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:57.875 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:57.875 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:58.077 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587737.614399_89.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:57.614399Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:58.078 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:08:58.078 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:08:58.079 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:58.079 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:58.080 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:58.160 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:58.161 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:58.413 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587737.614399_89.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:57.614399Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:08:58.414 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:08:58.463 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:58.464 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:58.464 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:58.509 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:58.509 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:58.694 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.14.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:08:58.694 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-11 2021-03-24T12:08:58.695 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:58.696 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:08:58.696 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:08:58.742 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:08:58.742 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:08:58.931 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:08:58.931 WARNING:rgw_multi.tests:bucket jlfoya-11 zone test-zone2 behind zone test-zone1: shard=5 master=00000000002.14.10 target= 2021-03-24T12:09:03.933 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:03.934 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:03.934 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:03.979 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:03.979 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:04.185 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"C0aNjVspIV5nitihCvTM0W9NiJ7.LGJ","ns":""},"count":1},"inc_marker":{"position":"00000000003.16.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:04.186 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-11 2021-03-24T12:09:04.186 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:04.187 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:04.188 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:04.230 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:04.231 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:04.414 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.16.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:04.415 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-11 2021-03-24T12:09:04.415 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:04.416 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:04.417 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:04.462 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:04.462 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:04.711 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.16.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:04.712 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-11 2021-03-24T12:09:04.763 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:04.763 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:04.764 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:04.808 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:04.808 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:04.992 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.13.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:04.993 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-12 2021-03-24T12:09:04.993 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:04.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:04.995 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:05.040 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:05.041 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:05.239 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:05.240 WARNING:rgw_multi.tests:bucket jlfoya-12 zone test-zone1 behind zone test-zone2: shard=5 master=00000000002.13.10 target= 2021-03-24T12:09:10.242 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:10.243 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:10.243 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:10.289 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:10.289 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:10.481 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"nLDBOWUeR-wdg0vC7YFnReQG3FS8yVG","ns":""},"count":1},"inc_marker":{"position":"00000000003.15.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:10.482 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-12 2021-03-24T12:09:11.227 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:11.228 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:11.229 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:11.274 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:11.274 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:11.453 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000010.31.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.16.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:11.453 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-11 2021-03-24T12:09:11.454 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:11.455 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:11.455 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:11.713 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"z4i0-cb2CH24FOXQaWT5vXozOvNU2Y2","ns":""},"count":1},"inc_marker":{"position":"00000000010.31.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"C0aNjVspIV5nitihCvTM0W9NiJ7.LGJ","ns":""},"count":1},"inc_marker":{"position":"00000000003.16.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:11.713 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-11 2021-03-24T12:09:11.714 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:11.714 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:11.715 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:11.758 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:11.758 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:11.936 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000010.31.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.16.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:11.936 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-11 2021-03-24T12:09:11.937 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:11.937 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:11.938 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:11.980 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:11.980 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:12.230 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.31.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.16.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:12.284 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-11 2021-03-24T12:09:12.285 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:12.286 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:12.286 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:12.327 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:12.327 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:12.508 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.19.10"},{"key":2,"val":""},{"key":3,"val":"00000000010.27.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.16.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:12.508 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-11 2021-03-24T12:09:12.509 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:12.509 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:12.510 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:12.554 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:12.555 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:12.739 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"full-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.19.10"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"8.QAyoCL-GaddvUurCfLU-5fgX0.V-B","ns":""},"count":1},"inc_marker":{"position":"00000000010.27.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"C0aNjVspIV5nitihCvTM0W9NiJ7.LGJ","ns":""},"count":1},"inc_marker":{"position":"00000000002.16.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:12.740 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-11 2021-03-24T12:09:12.740 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-11 zones={test-zone2, test-zone1} 2021-03-24T12:09:12.749 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:09:12.755 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-03-24T12:09:12.756 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-03-24T12:09:12.756 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-03-24T12:09:12.757 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:09:12.762 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-03-24T12:09:12.762 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-03-24T12:09:12.763 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-03-24T12:09:12.771 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:12.779 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:12.841 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:12.899 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-03-24T12:09:12.955 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-03-24T12:09:13.061 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-03-24T12:09:13.159 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-03-24T12:09:13.215 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-03-24T12:09:13.319 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-03-24T12:09:13.428 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-11 zones={test-zone2, test-zone1} 2021-03-24T12:09:13.429 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:13.429 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:13.430 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:13.472 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:13.473 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:13.638 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000010.23.5"},{"key":2,"val":""},{"key":3,"val":"00000000002.5.10"},{"key":4,"val":""},{"key":5,"val":"00000000002.11.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:13.639 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-12 2021-03-24T12:09:13.639 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:13.640 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:13.640 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:13.689 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:13.690 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:13.876 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"A5yiM5vi3gPuEeWGuFjMyiO2hGpOEyJ","ns":""},"count":1},"inc_marker":{"position":"00000000010.23.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"U1lF3RORXqr2CJhHiKa1i5nrTO2uzcX","ns":""},"count":1},"inc_marker":{"position":"00000000002.5.10"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"nLDBOWUeR-wdg0vC7YFnReQG3FS8yVG","ns":""},"count":1},"inc_marker":{"position":"00000000002.11.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:13.877 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-12 2021-03-24T12:09:13.878 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:13.879 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:13.880 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:13.923 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:13.924 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:14.104 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000010.23.5"},{"key":2,"val":""},{"key":3,"val":"00000000002.5.10"},{"key":4,"val":""},{"key":5,"val":"00000000002.11.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:14.105 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-12 2021-03-24T12:09:14.105 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:14.106 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:14.106 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:14.151 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:14.152 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:14.513 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.23.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.5.10"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.11.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:14.513 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-12 2021-03-24T12:09:14.514 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:14.514 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:14.515 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:14.589 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:14.589 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:14.756 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.31.10"},{"key":2,"val":""},{"key":3,"val":"00000000010.21.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.15.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:14.757 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-12 2021-03-24T12:09:14.757 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:14.758 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:14.758 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:14.803 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:14.803 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:15.002 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"A5yiM5vi3gPuEeWGuFjMyiO2hGpOEyJ","ns":""},"count":1},"inc_marker":{"position":"00000000002.31.10"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"U1lF3RORXqr2CJhHiKa1i5nrTO2uzcX","ns":""},"count":1},"inc_marker":{"position":"00000000010.21.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"nLDBOWUeR-wdg0vC7YFnReQG3FS8yVG","ns":""},"count":1},"inc_marker":{"position":"00000000003.15.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:15.003 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-12 2021-03-24T12:09:15.003 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-12 zones={test-zone2, test-zone1} 2021-03-24T12:09:15.013 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:09:15.018 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-03-24T12:09:15.019 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-03-24T12:09:15.019 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-03-24T12:09:15.020 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:09:15.025 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-03-24T12:09:15.025 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-03-24T12:09:15.026 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-03-24T12:09:15.036 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:15.047 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:15.112 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:15.172 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-03-24T12:09:15.230 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-03-24T12:09:15.345 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-03-24T12:09:15.452 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-03-24T12:09:15.506 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-03-24T12:09:15.623 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-03-24T12:09:15.733 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-12 zones={test-zone2, test-zone1} 2021-03-24T12:09:16.008 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:16.009 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:16.010 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:16.055 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:16.055 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:16.244 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000011.35.5"},{"key":2,"val":""},{"key":3,"val":"00000000002.27.10"},{"key":4,"val":""},{"key":5,"val":"00000000003.16.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:16.244 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-11 2021-03-24T12:09:16.245 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:16.245 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:16.246 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:16.289 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:16.289 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:16.467 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"z4i0-cb2CH24FOXQaWT5vXozOvNU2Y2","ns":""},"count":1},"inc_marker":{"position":"00000000010.31.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"8.QAyoCL-GaddvUurCfLU-5fgX0.V-B","ns":""},"count":1},"inc_marker":{"position":"00000000002.27.10"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"C0aNjVspIV5nitihCvTM0W9NiJ7.LGJ","ns":""},"count":1},"inc_marker":{"position":"00000000003.16.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:16.468 WARNING:rgw_multi.tests:bucket jlfoya-11 zone test-zone2 behind zone test-zone1: shard=1 master=00000000011.35.5 target=00000000010.31.5 2021-03-24T12:09:21.469 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:21.469 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:21.470 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:21.514 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:21.514 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:21.686 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"z4i0-cb2CH24FOXQaWT5vXozOvNU2Y2","ns":""},"count":1},"inc_marker":{"position":"00000000011.35.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"8.QAyoCL-GaddvUurCfLU-5fgX0.V-B","ns":""},"count":1},"inc_marker":{"position":"00000000003.33.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"C0aNjVspIV5nitihCvTM0W9NiJ7.LGJ","ns":""},"count":1},"inc_marker":{"position":"00000000003.16.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:21.687 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-11 2021-03-24T12:09:21.688 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:21.688 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:21.689 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:21.731 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:21.732 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:21.918 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000011.35.5"},{"key":2,"val":""},{"key":3,"val":"00000000003.33.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.16.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:21.919 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-11 2021-03-24T12:09:21.919 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:21.920 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:21.921 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:21.965 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:21.965 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:22.222 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000011.35.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.33.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.16.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:22.223 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-11 2021-03-24T12:09:22.223 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:22.224 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:22.224 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:22.304 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:22.304 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:22.477 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000003.22.5"},{"key":2,"val":""},{"key":3,"val":"00000000011.35.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.16.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:22.477 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-11 2021-03-24T12:09:22.483 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:22.484 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:22.484 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:22.529 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:22.529 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:22.729 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"z4i0-cb2CH24FOXQaWT5vXozOvNU2Y2","ns":""},"count":1},"inc_marker":{"position":"00000000003.22.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"8.QAyoCL-GaddvUurCfLU-5fgX0.V-B","ns":""},"count":1},"inc_marker":{"position":"00000000011.35.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"C0aNjVspIV5nitihCvTM0W9NiJ7.LGJ","ns":""},"count":1},"inc_marker":{"position":"00000000002.16.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:22.730 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-11 2021-03-24T12:09:22.731 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-11 zones={test-zone2, test-zone1} 2021-03-24T12:09:22.746 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:09:22.752 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-03-24T12:09:22.753 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-03-24T12:09:22.754 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-03-24T12:09:22.754 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:09:22.760 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-03-24T12:09:22.761 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-03-24T12:09:22.761 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-03-24T12:09:22.772 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:22.785 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:22.853 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:22.916 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-03-24T12:09:22.975 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-03-24T12:09:23.086 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-03-24T12:09:23.188 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-03-24T12:09:23.243 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-03-24T12:09:23.358 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-03-24T12:09:23.466 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-11 zones={test-zone2, test-zone1} 2021-03-24T12:09:23.466 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:23.467 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:23.467 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:23.508 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:23.509 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:23.693 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000011.31.5"},{"key":2,"val":""},{"key":3,"val":"00000000003.8.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.11.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:23.693 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-12 2021-03-24T12:09:23.694 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:23.694 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:23.695 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:23.740 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:23.740 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:23.929 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"A5yiM5vi3gPuEeWGuFjMyiO2hGpOEyJ","ns":""},"count":1},"inc_marker":{"position":"00000000011.31.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"U1lF3RORXqr2CJhHiKa1i5nrTO2uzcX","ns":""},"count":1},"inc_marker":{"position":"00000000003.8.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"nLDBOWUeR-wdg0vC7YFnReQG3FS8yVG","ns":""},"count":1},"inc_marker":{"position":"00000000002.11.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:23.930 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-12 2021-03-24T12:09:23.930 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:23.931 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:23.931 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:23.972 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:23.973 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:24.150 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000011.31.5"},{"key":2,"val":""},{"key":3,"val":"00000000003.8.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.11.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:24.151 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-12 2021-03-24T12:09:24.152 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:24.152 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:24.153 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:24.197 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:24.197 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:24.452 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000011.31.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.8.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.11.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:24.453 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-12 2021-03-24T12:09:24.453 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:24.454 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:24.455 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:24.536 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:24.536 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:24.707 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000003.37.5"},{"key":2,"val":""},{"key":3,"val":"00000000011.25.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.15.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:24.707 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-12 2021-03-24T12:09:24.708 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:24.708 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:24.709 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:24.757 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:24.757 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:24.955 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"A5yiM5vi3gPuEeWGuFjMyiO2hGpOEyJ","ns":""},"count":1},"inc_marker":{"position":"00000000003.37.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"U1lF3RORXqr2CJhHiKa1i5nrTO2uzcX","ns":""},"count":1},"inc_marker":{"position":"00000000011.25.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"nLDBOWUeR-wdg0vC7YFnReQG3FS8yVG","ns":""},"count":1},"inc_marker":{"position":"00000000003.15.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:24.956 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-12 2021-03-24T12:09:24.956 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-12 zones={test-zone2, test-zone1} 2021-03-24T12:09:24.965 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:09:24.970 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-03-24T12:09:24.971 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-03-24T12:09:24.971 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-03-24T12:09:24.972 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:09:24.977 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-03-24T12:09:24.977 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-03-24T12:09:24.978 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-03-24T12:09:24.988 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:24.998 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:25.066 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:25.128 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-03-24T12:09:25.186 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-03-24T12:09:25.309 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-03-24T12:09:25.416 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-03-24T12:09:25.475 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-03-24T12:09:25.593 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-03-24T12:09:25.701 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-12 zones={test-zone2, test-zone1} 2021-03-24T12:09:25.701 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_versioned_object_incremental_sync ... ok 2021-03-24T12:09:25.738 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:25.739 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:25.740 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:25.779 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:25.779 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:25.932 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:09:25.961 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616587765.742617_112.1","last_update":"2021-03-24T12:09:25.742617Z"},{"marker":"1_1616587716.665846_87.1","last_update":"2021-03-24T12:08:36.665846Z"}] 2021-03-24T12:09:25.962 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:09:25.962 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:25.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:25.963 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:26.005 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:26.006 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:26.192 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587737.614399_89.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:57.614399Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:09:26.193 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616587765.742617_112.1 target=1_1616587737.614399_89.1 2021-03-24T12:09:31.193 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:31.194 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:31.195 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:31.236 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:31.236 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:31.411 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587765.742617_112.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:25.742617Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:09:31.411 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:09:31.412 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:09:31.412 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:31.413 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:31.414 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:31.497 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:31.498 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:31.738 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587765.742617_112.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:25.742617Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:09:31.738 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:09:31.790 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:31.791 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:31.792 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:31.831 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:31.832 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:32.024 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.15.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:32.025 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-13 2021-03-24T12:09:32.025 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:32.026 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:32.026 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:32.069 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:32.069 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:32.255 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:32.256 WARNING:rgw_multi.tests:bucket jlfoya-13 zone test-zone2 behind zone test-zone1: shard=5 master=00000000002.15.10 target= 2021-03-24T12:09:37.257 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:37.258 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:37.259 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:37.304 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:37.305 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:37.493 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"SdA6ztbCvS5OaGMul4E3pxvXD0UyQIh","ns":""},"count":1},"inc_marker":{"position":"00000000003.17.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:37.494 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-13 2021-03-24T12:09:37.494 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:37.495 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:37.495 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:37.536 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:37.537 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:37.720 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.17.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:37.721 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-13 2021-03-24T12:09:37.721 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:37.722 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:37.723 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:37.766 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:37.859 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:38.023 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.17.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:38.024 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-13 2021-03-24T12:09:38.025 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:38.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:38.026 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:38.107 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:38.107 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:38.275 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.36.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:38.275 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-13 2021-03-24T12:09:38.276 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:38.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:38.277 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:38.324 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:38.324 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:38.515 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"SdA6ztbCvS5OaGMul4E3pxvXD0UyQIh","ns":""},"count":1},"inc_marker":{"position":"00000000002.36.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:38.516 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-13 2021-03-24T12:09:38.517 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-13 zones={test-zone2, test-zone1} 2021-03-24T12:09:38.525 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:09:38.571 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-03-24T12:09:38.571 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:09:38.579 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-03-24T12:09:38.635 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:38.646 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:38.712 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:38.774 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-13 zones={test-zone2, test-zone1} 2021-03-24T12:09:39.759 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:39.810 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:39.811 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:39.853 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:40.029 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.17.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000029.80.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:40.029 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-13 2021-03-24T12:09:40.030 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:40.031 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:40.031 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:40.089 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:40.089 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:40.279 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"SdA6ztbCvS5OaGMul4E3pxvXD0UyQIh","ns":""},"count":1},"inc_marker":{"position":"00000000003.17.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"zTcLlAb1d-fxLZN.Hfjt9x-aVojXu5r","ns":""},"count":9},"inc_marker":{"position":"00000000031.84.8"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:40.279 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-13 2021-03-24T12:09:40.280 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:40.280 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:40.281 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:40.325 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:40.325 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:40.507 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.17.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000031.84.8"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:40.508 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-13 2021-03-24T12:09:40.509 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:40.509 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:40.510 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:40.555 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:40.555 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:40.807 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.17.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000029.80.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:40.808 WARNING:rgw_multi.tests:bucket jlfoya-13 zone test-zone3 behind zone test-zone1: shard=8 master=00000000031.84.8 target=00000000029.80.5 2021-03-24T12:09:45.809 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:45.810 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:45.811 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:45.858 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:45.858 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:46.113 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.17.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000031.84.8"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:46.114 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-13 2021-03-24T12:09:46.114 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:46.115 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:46.115 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:46.156 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:46.157 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:46.327 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.36.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000031.87.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:09:46.327 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-13 2021-03-24T12:09:46.328 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:46.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:46.329 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:46.374 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:46.374 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:46.568 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"SdA6ztbCvS5OaGMul4E3pxvXD0UyQIh","ns":""},"count":1},"inc_marker":{"position":"00000000002.36.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"yEiSvys6RFuSh5GdztSZ8vb3YN6nfCh","ns":""},"count":4},"inc_marker":{"position":"00000000031.87.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:09:46.568 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-13 2021-03-24T12:09:46.569 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-13 zones={test-zone2, test-zone1} 2021-03-24T12:09:46.587 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:09:46.594 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-03-24T12:09:46.594 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.595 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.595 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.595 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.596 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.596 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.597 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.597 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.597 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.598 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.598 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.599 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.599 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.599 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.600 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.600 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.601 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.601 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.601 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.602 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.602 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:09:46.611 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-03-24T12:09:46.612 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.612 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.612 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.613 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.613 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.614 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.614 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.615 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.615 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.615 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.616 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.616 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.617 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.617 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.618 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.618 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.618 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.619 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.619 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.620 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:09:46.638 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:46.650 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:46.716 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-03-24T12:09:46.777 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:46.830 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:46.945 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:47.054 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:47.111 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:47.233 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:47.346 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:47.399 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:47.514 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:47.618 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:47.675 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:47.797 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:47.902 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:47.956 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:48.076 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:48.183 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:48.243 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:48.360 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:48.465 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:48.518 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:48.634 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:48.741 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:48.799 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:48.951 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:49.057 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:49.111 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:49.227 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:49.333 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:49.392 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:49.507 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:49.605 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:49.659 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:49.779 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:49.890 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:49.948 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:50.068 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:50.173 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:50.228 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:50.346 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:50.454 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:50.511 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:50.625 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:50.729 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:50.783 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:50.901 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:51.010 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:51.064 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:51.185 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:51.290 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:51.342 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:51.460 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:51.565 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:51.622 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:51.738 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:51.846 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:51.903 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:52.022 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:52.131 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:52.187 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:52.302 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:09:52.409 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-13 zones={test-zone2, test-zone1} 2021-03-24T12:09:52.410 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:52.411 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:52.411 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:52.451 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:52.452 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:52.631 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587760.936057_36.2","last_update":"2021-03-24T12:09:20.936057Z"},{"marker":"1_1616587782.944095_107.1","last_update":"2021-03-24T12:09:42.944095Z"},{"marker":"1_1616587782.944095_114.1","last_update":"2021-03-24T12:09:42.944095Z"},{"marker":"1_1616587707.796042_42.1","last_update":"2021-03-24T12:08:27.796042Z"}] 2021-03-24T12:09:52.632 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-03-24T12:09:52.632 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:52.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:52.633 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:52.674 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:52.675 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:52.849 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616587782.944095_107.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:42.944095Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616587782.944095_114.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:42.944095Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587707.796042_42.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:27.796042Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:09:52.849 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-03-24T12:09:52.850 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:52.850 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:52.851 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:52.890 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:52.890 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:53.069 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587760.936057_36.2","last_update":"2021-03-24T12:09:20.936057Z"},{"marker":"1_1616587782.944095_107.1","last_update":"2021-03-24T12:09:42.944095Z"},{"marker":"1_1616587782.944095_114.1","last_update":"2021-03-24T12:09:42.944095Z"},{"marker":"1_1616587707.796042_42.1","last_update":"2021-03-24T12:08:27.796042Z"}] 2021-03-24T12:09:53.070 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-03-24T12:09:53.070 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:53.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:53.071 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:53.115 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:53.174 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:53.375 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11510987327438770569},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616587782.944095_107.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:42.944095Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616587782.944095_114.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:42.944095Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587707.796042_42.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:27.796042Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:09:53.375 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-03-24T12:09:53.376 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:53.376 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:53.377 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:53.417 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:53.417 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:53.568 INFO:teuthology.orchestra.run.smithi161.stdout:[{"marker":"1_1616587761.853631_25.2","last_update":"2021-03-24T12:09:21.853631Z"},{"marker":"1_1616587783.860722_103.1","last_update":"2021-03-24T12:09:43.860722Z"},{"marker":"1_1616587783.860722_131.1","last_update":"2021-03-24T12:09:43.860722Z"},{"marker":"1_1616587707.660850_62.1","last_update":"2021-03-24T12:08:27.660850Z"}] 2021-03-24T12:09:53.568 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-03-24T12:09:53.569 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:53.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:53.570 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:53.612 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:53.613 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:53.799 INFO:teuthology.orchestra.run.smithi043.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":15157172713664070086},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587761.853631_25.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:21.853631Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616587783.860722_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:43.860722Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616587783.860722_131.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:43.860722Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587707.660850_62.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:27.660850Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:09:53.800 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-03-24T12:09:53.801 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_concurrent_versioned_object_incremental_sync ... ok 2021-03-24T12:09:53.827 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:53.828 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:53.828 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:53.879 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:53.879 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:54.035 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:09:54.064 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616587793.830203_126.1","last_update":"2021-03-24T12:09:53.830203Z"},{"marker":"1_1616587716.665846_87.1","last_update":"2021-03-24T12:08:36.665846Z"}] 2021-03-24T12:09:54.064 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:09:54.065 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:54.065 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:54.066 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:54.106 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:54.106 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:54.286 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587765.742617_112.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:25.742617Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:09:54.287 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616587793.830203_126.1 target=1_1616587765.742617_112.1 2021-03-24T12:09:59.288 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:59.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:59.290 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:59.329 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:59.329 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:59.510 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587793.830203_126.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:53.830203Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:09:59.510 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:09:59.511 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:09:59.512 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:59.512 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:59.513 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:59.590 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:59.591 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:09:59.844 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587793.830203_126.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:53.830203Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:09:59.845 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:09:59.894 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:59.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:09:59.896 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:09:59.935 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:09:59.935 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:00.105 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.9.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:10:00.106 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-14 2021-03-24T12:10:00.106 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:00.107 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:00.107 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:00.153 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:00.153 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:00.349 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:00.349 WARNING:rgw_multi.tests:bucket jlfoya-14 zone test-zone2 behind zone test-zone1: shard=8 master=00000000001.9.5 target= 2021-03-24T12:10:05.350 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:05.351 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:05.352 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:05.397 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:05.398 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:05.591 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.9.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:05.592 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-14 2021-03-24T12:10:05.593 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:05.594 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:05.595 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:05.637 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:05.638 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:05.822 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.9.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:10:05.822 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-14 2021-03-24T12:10:05.823 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:05.823 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:05.824 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:05.867 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:05.868 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:06.122 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.9.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:06.123 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-14 2021-03-24T12:10:06.123 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:06.124 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:06.124 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:06.203 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:06.204 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:06.392 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.16.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:10:06.393 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-14 2021-03-24T12:10:06.394 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:06.394 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:06.395 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:06.440 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:06.441 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:06.629 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.16.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:06.630 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-14 2021-03-24T12:10:06.631 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-14 zones={test-zone2, test-zone1} 2021-03-24T12:10:06.640 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:10:06.687 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:06.687 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:10:06.693 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:06.748 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:06.759 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:06.826 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:06.884 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-14 zones={test-zone2, test-zone1} 2021-03-24T12:10:06.898 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:06.899 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:06.900 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:06.938 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:06.939 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:07.098 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:10:07.127 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616587806.902205_132.1","last_update":"2021-03-24T12:10:06.902205Z"},{"marker":"1_1616587716.665846_87.1","last_update":"2021-03-24T12:08:36.665846Z"}] 2021-03-24T12:10:07.128 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:10:07.128 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:07.129 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:07.129 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:07.171 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:07.171 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:07.354 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587793.830203_126.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:53.830203Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:10:07.355 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616587806.902205_132.1 target=1_1616587793.830203_126.1 2021-03-24T12:10:12.357 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:12.358 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:12.358 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:12.401 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:12.401 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:12.579 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587806.902205_132.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:10:06.902205Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:10:12.580 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:10:12.580 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:10:12.581 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:12.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:12.582 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:12.660 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:12.661 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:13.019 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587806.902205_132.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:10:06.902205Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:10:13.019 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:10:13.067 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:13.067 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:13.068 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:13.110 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:13.110 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:13.299 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.12.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:10:13.300 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-14 2021-03-24T12:10:13.300 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:13.301 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:13.301 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:13.345 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:13.346 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:13.534 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.9.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:13.535 WARNING:rgw_multi.tests:bucket jlfoya-14 zone test-zone2 behind zone test-zone1: shard=8 master=00000000003.12.12 target=00000000001.9.5 2021-03-24T12:10:18.537 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:18.538 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:18.538 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:18.583 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:18.583 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:18.792 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000003.12.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:18.792 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-14 2021-03-24T12:10:18.793 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:18.793 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:18.794 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:18.836 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:18.836 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:19.017 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.12.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:10:19.018 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-14 2021-03-24T12:10:19.018 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:19.019 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:19.019 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:19.064 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:19.064 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:19.321 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.12.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:19.322 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-14 2021-03-24T12:10:19.322 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:19.323 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:19.323 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:19.405 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:19.406 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:19.560 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.20.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:10:19.561 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-14 2021-03-24T12:10:19.562 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:19.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:19.563 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:19.608 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:19.608 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:19.797 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000003.20.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:19.798 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-14 2021-03-24T12:10:19.798 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-14 zones={test-zone2, test-zone1} 2021-03-24T12:10:19.807 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:10:19.855 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:19.855 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:19.856 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:10:19.862 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:19.862 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:19.916 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:19.927 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:19.991 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:20.048 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:20.058 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:20.122 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:20.180 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-14 zones={test-zone2, test-zone1} 2021-03-24T12:10:20.192 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:20.193 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:20.193 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:20.231 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:20.231 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:20.385 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:10:20.417 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616587820.195106_138.1","last_update":"2021-03-24T12:10:20.195106Z"},{"marker":"1_1616587716.665846_87.1","last_update":"2021-03-24T12:08:36.665846Z"}] 2021-03-24T12:10:20.417 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:10:20.418 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:20.418 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:20.419 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:20.461 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:20.461 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:20.638 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587806.902205_132.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:10:06.902205Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:10:20.639 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616587820.195106_138.1 target=1_1616587806.902205_132.1 2021-03-24T12:10:25.640 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:25.641 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:25.642 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:25.682 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:25.682 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:25.857 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587820.195106_138.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:10:20.195106Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:10:25.857 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:10:25.858 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:10:25.858 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:25.859 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:25.859 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:25.941 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:25.942 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:26.200 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587820.195106_138.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:10:20.195106Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:10:26.200 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:10:26.251 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:26.252 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:26.252 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:26.303 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:26.303 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:26.482 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000005.16.17"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:10:26.483 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-14 2021-03-24T12:10:26.483 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:26.484 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:26.484 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:26.531 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:26.531 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:26.718 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000003.12.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:26.719 WARNING:rgw_multi.tests:bucket jlfoya-14 zone test-zone2 behind zone test-zone1: shard=8 master=00000000005.16.17 target=00000000003.12.12 2021-03-24T12:10:31.720 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:31.721 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:31.721 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:31.764 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:31.764 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:31.961 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000005.16.17"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:31.962 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-14 2021-03-24T12:10:31.962 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:31.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:31.963 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:32.005 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:32.006 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:32.191 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000005.16.17"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:10:32.191 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-14 2021-03-24T12:10:32.192 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:32.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:32.193 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:32.239 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:32.239 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:32.498 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000005.16.17"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:32.499 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-14 2021-03-24T12:10:32.499 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:32.500 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:32.500 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:32.539 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:32.540 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:32.702 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000005.25.17"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:10:32.703 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-14 2021-03-24T12:10:32.704 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:32.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:32.705 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:32.751 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:32.752 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:32.947 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000005.25.17"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:32.947 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-14 2021-03-24T12:10:32.948 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-14 zones={test-zone2, test-zone1} 2021-03-24T12:10:32.956 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:10:33.007 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:33.007 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:33.008 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:10:33.013 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:33.014 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:33.072 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:33.083 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:33.145 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:33.204 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:33.213 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:33.277 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:33.336 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-14 zones={test-zone2, test-zone1} 2021-03-24T12:10:33.336 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_version_suspended_incremental_sync ... ok 2021-03-24T12:10:33.337 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-15 2021-03-24T12:10:33.363 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-16 2021-03-24T12:10:33.432 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:33.432 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:33.433 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:33.474 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:33.474 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:33.616 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:10:33.645 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616587833.429962_154.1","last_update":"2021-03-24T12:10:33.429962Z"},{"marker":"1_1616587716.665846_87.1","last_update":"2021-03-24T12:08:36.665846Z"}] 2021-03-24T12:10:33.645 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:10:33.646 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:33.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:33.647 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:33.688 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:33.689 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:33.874 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587820.195106_138.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:10:20.195106Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:10:33.875 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616587833.429962_154.1 target=1_1616587820.195106_138.1 2021-03-24T12:10:38.876 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:38.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:38.878 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:38.918 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:38.918 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:39.127 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587833.429962_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:10:33.429962Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:10:39.127 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:10:39.128 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:10:39.129 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:39.129 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:39.130 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:39.207 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:39.207 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:39.465 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587833.429962_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:10:33.429962Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:10:39.466 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:10:39.603 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:39.604 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:39.605 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-15 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:39.647 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:39.647 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:39.833 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.7.11"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:10:39.834 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-15 2021-03-24T12:10:39.835 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:39.835 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:39.836 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-15 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:39.881 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:39.881 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:40.080 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:40.081 WARNING:rgw_multi.tests:bucket jlfoya-15 zone test-zone2 behind zone test-zone1: shard=8 master=00000000003.7.11 target= 2021-03-24T12:10:45.082 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:45.083 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:45.084 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-15 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:45.127 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:45.127 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:45.327 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"jtBJBxkPVRbjVEIk-nAXoIHvlFjBin5","ns":""},"count":1},"inc_marker":{"position":"00000000003.7.11"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:45.328 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-15 2021-03-24T12:10:45.328 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:45.329 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:45.330 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-15 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:45.373 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:45.373 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:45.539 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.7.11"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:10:45.540 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-15 2021-03-24T12:10:45.541 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:45.541 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:45.542 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-15 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:45.583 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:45.583 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:45.837 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.7.11"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:45.838 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-15 2021-03-24T12:10:45.838 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:45.839 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:45.839 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-15 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:45.916 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:45.917 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:46.109 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000002.9.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:10:46.109 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-15 2021-03-24T12:10:46.110 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:46.111 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:46.111 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-15 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:46.154 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:46.155 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:46.352 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"jtBJBxkPVRbjVEIk-nAXoIHvlFjBin5","ns":""},"count":1},"inc_marker":{"position":"00000000002.9.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:46.353 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-15 2021-03-24T12:10:46.353 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-15 zones={test-zone2, test-zone1} 2021-03-24T12:10:46.362 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:10:46.411 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:46.411 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:46.412 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:10:46.418 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:46.419 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:46.473 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:46.480 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:46.490 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:46.555 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-15 zones={test-zone2, test-zone1} 2021-03-24T12:10:46.556 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:46.556 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:46.557 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:46.599 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:46.599 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:46.784 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000002.10.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:10:46.785 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-16 2021-03-24T12:10:46.785 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:46.786 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:46.787 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:46.831 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:46.831 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:47.038 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"Dl0Sj.lCf700F70pEoyVOwlYHowYhtU","ns":""},"count":2},"inc_marker":{"position":"00000000002.10.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:47.038 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-16 2021-03-24T12:10:47.039 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:47.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:47.040 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:47.082 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:47.083 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:47.262 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000002.10.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:10:47.262 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-16 2021-03-24T12:10:47.263 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:47.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:47.264 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:47.306 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:47.307 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:47.560 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.10.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:47.560 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-16 2021-03-24T12:10:47.561 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:47.561 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:47.562 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:47.642 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:47.821 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.14.11"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:10:47.822 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-16 2021-03-24T12:10:47.822 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:47.823 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:47.823 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:47.868 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:47.868 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:48.065 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"Dl0Sj.lCf700F70pEoyVOwlYHowYhtU","ns":""},"count":2},"inc_marker":{"position":"00000000003.14.11"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:48.065 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-16 2021-03-24T12:10:48.066 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-16 zones={test-zone2, test-zone1} 2021-03-24T12:10:48.075 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:10:48.127 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:48.127 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:48.128 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:10:48.133 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:48.134 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:10:48.192 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:48.200 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:48.210 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:10:48.279 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-16 zones={test-zone2, test-zone1} 2021-03-24T12:10:48.280 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_delete_marker_full_sync ... ok 2021-03-24T12:10:48.281 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-17 2021-03-24T12:10:48.305 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-18 2021-03-24T12:10:48.403 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:48.404 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:48.405 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:48.447 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:48.448 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:48.594 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:10:48.623 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616587848.398925_177.1","last_update":"2021-03-24T12:10:48.398925Z"},{"marker":"1_1616587716.665846_87.1","last_update":"2021-03-24T12:08:36.665846Z"}] 2021-03-24T12:10:48.624 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:10:48.625 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:48.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:48.626 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:48.668 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:48.669 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:48.858 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587833.429962_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:10:33.429962Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:10:48.859 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616587848.398925_177.1 target=1_1616587833.429962_154.1 2021-03-24T12:10:53.860 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:53.861 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:53.862 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:53.904 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:53.904 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:54.090 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587848.398925_177.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:10:48.398925Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:10:54.091 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:10:54.091 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:10:54.092 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:54.092 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:54.093 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:54.171 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:54.172 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:54.427 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587848.398925_177.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:10:48.398925Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:10:54.428 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:10:54.566 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:54.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:54.567 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:54.610 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:54.610 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:54.793 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.25.6"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:10:54.793 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-17 2021-03-24T12:10:54.794 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:54.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:10:54.795 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:10:54.839 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:10:54.839 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:10:55.034 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:10:55.035 WARNING:rgw_multi.tests:bucket jlfoya-17 zone test-zone2 behind zone test-zone1: shard=8 master=00000000003.25.6 target= 2021-03-24T12:11:00.037 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:00.037 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:00.038 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:00.081 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:00.081 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:00.278 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"00000000003.25.6"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:11:00.279 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-17 2021-03-24T12:11:00.279 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:00.280 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:00.280 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:00.321 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:00.321 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:00.495 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.25.6"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:11:00.496 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-17 2021-03-24T12:11:00.496 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:00.497 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:00.498 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:00.543 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:00.543 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:00.790 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.25.6"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:11:00.791 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-17 2021-03-24T12:11:00.791 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:00.792 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:00.792 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:00.833 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:00.834 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:01.036 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.23.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:11:01.036 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-17 2021-03-24T12:11:01.037 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:01.037 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:01.038 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:01.083 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:01.084 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:01.285 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"00000000001.23.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:11:01.286 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-17 2021-03-24T12:11:01.286 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-17 zones={test-zone2, test-zone1} 2021-03-24T12:11:01.295 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:11:01.343 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:11:01.343 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:11:01.348 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:11:01.399 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:11:01.405 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-17 zones={test-zone2, test-zone1} 2021-03-24T12:11:01.405 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:01.406 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:01.406 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-18 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:01.448 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:01.448 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:01.614 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.35.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:11:01.615 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-18 2021-03-24T12:11:01.615 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:01.616 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:01.617 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-18 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:01.662 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:01.662 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:01.866 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"00000000001.35.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:11:01.867 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-18 2021-03-24T12:11:01.868 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:01.868 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:01.869 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-18 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:01.912 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:01.913 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:02.099 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.35.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:11:02.100 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-18 2021-03-24T12:11:02.100 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:02.101 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:02.101 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-18 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:02.144 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:02.144 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:02.397 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.35.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:11:02.398 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-18 2021-03-24T12:11:02.398 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:02.399 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:02.400 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-18 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:02.479 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:02.480 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:02.668 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.46.6"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:11:02.669 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-18 2021-03-24T12:11:02.670 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:02.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:02.671 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-18 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:02.715 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:02.716 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:02.910 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"00000000003.46.6"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:11:02.910 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-18 2021-03-24T12:11:02.911 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-18 zones={test-zone2, test-zone1} 2021-03-24T12:11:02.920 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:11:02.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:11:02.967 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:11:02.973 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-03-24T12:11:03.024 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-03-24T12:11:03.029 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-18 zones={test-zone2, test-zone1} 2021-03-24T12:11:03.030 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_suspended_delete_marker_full_sync ... ok 2021-03-24T12:11:03.030 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-19 2021-03-24T12:11:03.056 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-20 2021-03-24T12:11:03.214 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_versioning ... ok 2021-03-24T12:11:03.215 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-21 2021-03-24T12:11:03.242 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-22 2021-03-24T12:11:03.411 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_acl ... ok 2021-03-24T12:11:03.411 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-23 2021-03-24T12:11:03.437 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-24 2021-03-24T12:11:04.603 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_cors ... ok 2021-03-24T12:11:04.604 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-25 2021-03-24T12:11:04.630 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-26 2021-03-24T12:11:04.673 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:04.674 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:04.674 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:04.712 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:04.713 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:04.862 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:11:04.894 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616587864.653774_238.1","last_update":"2021-03-24T12:11:04.653774Z"},{"marker":"1_1616587716.665846_87.1","last_update":"2021-03-24T12:08:36.665846Z"}] 2021-03-24T12:11:04.894 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:11:04.895 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:04.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:04.896 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:04.935 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:04.936 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:05.114 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587863.488418_227.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:03.488418Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:11:05.115 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616587864.653774_238.1 target=1_1616587863.488418_227.1 2021-03-24T12:11:10.116 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:10.117 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:10.118 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:10.160 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:10.161 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:10.340 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587864.653774_238.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:04.653774Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:11:10.341 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:11:10.341 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:11:10.342 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:10.342 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:10.343 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:10.423 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:10.423 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:10.678 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587864.653774_238.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:04.653774Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:11:10.679 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:11:10.903 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_delete_notempty ... ok 2021-03-24T12:11:10.904 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-27 2021-03-24T12:11:10.924 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-28 2021-03-24T12:11:10.969 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:10.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:10.971 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:11.009 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:11.009 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:11.158 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=5d6d539e-fcb5-4061-8385-16fad563da6c 2021-03-24T12:11:11.190 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587550.682762_31.1","last_update":"2021-03-24T12:05:50.682762Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616587870.950038_251.1","last_update":"2021-03-24T12:11:10.950038Z"},{"marker":"1_1616587716.665846_87.1","last_update":"2021-03-24T12:08:36.665846Z"}] 2021-03-24T12:11:11.190 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:11:11.191 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:11.191 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:11.192 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:11.233 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:11.233 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:11.410 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587864.653774_238.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:04.653774Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:11:11.411 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616587870.950038_251.1 target=1_1616587864.653774_238.1 2021-03-24T12:11:16.412 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:16.413 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:16.414 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:16.455 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:16.455 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:16.633 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587870.950038_251.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:10.950038Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:11:16.634 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:11:16.635 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:11:16.635 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:16.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:11:16.636 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:11:16.716 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:16.717 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:16.970 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"5d6d539e-fcb5-4061-8385-16fad563da6c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616587870.950038_251.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:10.950038Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:11:16.971 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:11:16.972 DEBUG:tasks.rgw.c2.client.1:waiting for process to exit 2021-03-24T12:11:16.975 INFO:teuthology.orchestra.run:waiting for 300 2021-03-24T12:11:17.012 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:11:17.009+0000 7f1462392700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 17117) UID: 0 2021-03-24T12:11:17.012 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:11:17.009+0000 7f1479a570c0 -1 shutting down 2021-03-24T12:11:22.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 is failed for ~0s 2021-03-24T12:11:23.077 INFO:tasks.rgw.c2.client.1:Stopped 2021-03-24T12:11:23.078 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:11:23.078 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:11:23.079 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --master --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:11:23.119 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:23.119 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:23.146 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:11:23.141+0000 7f195de3d080 0 NOTICE: overriding master zone: 37e7d5ac-1249-4c4d-9b86-81fc80607142 2021-03-24T12:11:23.146 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:11:23.141+0000 7f195de3d080 0 failed reading obj info from .rgw.root:zone_info.37e7d5ac-1249-4c4d-9b86-81fc80607142: (2) No such file or directory 2021-03-24T12:11:23.147 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:11:23.141+0000 7f195de3d080 0 WARNING: could not read zone params for zone id=37e7d5ac-1249-4c4d-9b86-81fc80607142 name=test-zone1 2021-03-24T12:11:23.158 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"SS7NZB400H0K0O9S","secret_key":"74rdtoceN30ZdgFImKNThm7gPyMKZRqM"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1"} 2021-03-24T12:11:23.159 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:11:23.159 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:11:23.160 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:11:23.236 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:11:23.236 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:11:23.479 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"e06f2557-2a7e-4195-9afd-348b105acc69","epoch":1,"predecessor_uuid":"5d6d539e-fcb5-4061-8385-16fad563da6c","sync_status":["1_1616587550.682762_31.1","","1_1616587870.950038_251.1","1_1616587716.665846_87.1"],"period_map":{"id":"e06f2557-2a7e-4195-9afd-348b105acc69","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"4ed88107-7c59-4fb2-81d2-61fd98250599","zones":[{"id":"37e7d5ac-1249-4c4d-9b86-81fc80607142","name":"test-zone1","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","endpoints":["http://smithi161.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"a506567f-5df7-4073-bb4a-f3e68418b9c9","name":"test-zone3","endpoints":["http://smithi161.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"37e7d5ac-1249-4c4d-9b86-81fc80607142","val":3859867623},{"key":"4ed88107-7c59-4fb2-81d2-61fd98250599","val":3203212006},{"key":"a506567f-5df7-4073-bb4a-f3e68418b9c9","val":3546318610}]},"master_zonegroup":"test-zonegroup","master_zone":"4ed88107-7c59-4fb2-81d2-61fd98250599","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","realm_name":"test-realm","realm_epoch":3} 2021-03-24T12:11:23.479 INFO:rgw_multi.tests:Set master zone=test-zone2, waiting 60s for reconfiguration.. 2021-03-24T12:11:27.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 has been restored 2021-03-24T12:12:23.481 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-29 2021-03-24T12:12:23.541 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-30 2021-03-24T12:12:23.571 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:12:23.573 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:12:23.574 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:12:23.611 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:12:23.611 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:12:23.787 INFO:teuthology.orchestra.run.smithi161.stderr:No --period given, using current period=e06f2557-2a7e-4195-9afd-348b105acc69 2021-03-24T12:12:23.819 INFO:teuthology.orchestra.run.smithi161.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616587943.566236_586.1","last_update":"2021-03-24T12:12:23.566236Z"},{"marker":"","last_update":"0.000000"}] 2021-03-24T12:12:23.819 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone1 2021-03-24T12:12:23.820 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:12:23.820 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:12:23.821 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:12:23.862 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:12:23.862 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:12:24.046 INFO:teuthology.orchestra.run.smithi043.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"e06f2557-2a7e-4195-9afd-348b105acc69","realm_epoch":3},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":55,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":3}}]},"full_sync":{"total":55,"complete":55}} 2021-03-24T12:12:24.047 WARNING:rgw_multi.tests:zone test-zone1 behind master: shard=2 master=1_1616587943.566236_586.1 target= 2021-03-24T12:12:29.049 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:12:29.058 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:12:29.059 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:12:29.102 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:12:29.103 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:12:29.282 INFO:teuthology.orchestra.run.smithi043.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"e06f2557-2a7e-4195-9afd-348b105acc69","realm_epoch":3},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":55,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":2,"val":{"state":1,"marker":"1_1616587943.566236_586.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:12:23.566236Z","realm_epoch":3}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":3}}]},"full_sync":{"total":55,"complete":55}} 2021-03-24T12:12:29.282 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone1 2021-03-24T12:12:29.283 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:12:29.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'modify', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:12:29.296 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone modify --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --master --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:12:29.363 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:12:29.364 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:12:29.390 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:12:29.386+0000 7fe7544bb080 0 NOTICE: overriding master zone: 4ed88107-7c59-4fb2-81d2-61fd98250599 2021-03-24T12:12:29.391 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:12:29.386+0000 7fe7544bb080 0 failed reading obj info from .rgw.root:zone_info.4ed88107-7c59-4fb2-81d2-61fd98250599: (2) No such file or directory 2021-03-24T12:12:29.392 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:12:29.386+0000 7fe7544bb080 0 WARNING: could not read zone params for zone id=4ed88107-7c59-4fb2-81d2-61fd98250599 name=test-zone2 2021-03-24T12:12:29.392 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:12:29.390+0000 7fe7544bb080 0 failed reading obj info from .rgw.root:zone_info.a506567f-5df7-4073-bb4a-f3e68418b9c9: (2) No such file or directory 2021-03-24T12:12:29.392 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:12:29.390+0000 7fe7544bb080 0 WARNING: could not read zone params for zone id=a506567f-5df7-4073-bb4a-f3e68418b9c9 name=test-zone3 2021-03-24T12:12:29.403 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"37e7d5ac-1249-4c4d-9b86-81fc80607142","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"SS7NZB400H0K0O9S","secret_key":"74rdtoceN30ZdgFImKNThm7gPyMKZRqM"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1"} 2021-03-24T12:12:29.404 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:12:29.405 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:12:29.405 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:12:29.489 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:12:29.490 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:12:29.712 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","epoch":1,"predecessor_uuid":"e06f2557-2a7e-4195-9afd-348b105acc69","sync_status":["","","1_1616587943.566236_586.1",""],"period_map":{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","zones":[{"id":"37e7d5ac-1249-4c4d-9b86-81fc80607142","name":"test-zone1","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","endpoints":["http://smithi161.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"a506567f-5df7-4073-bb4a-f3e68418b9c9","name":"test-zone3","endpoints":["http://smithi161.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"37e7d5ac-1249-4c4d-9b86-81fc80607142","val":3859867623},{"key":"4ed88107-7c59-4fb2-81d2-61fd98250599","val":3203212006},{"key":"a506567f-5df7-4073-bb4a-f3e68418b9c9","val":3546318610}]},"master_zonegroup":"test-zonegroup","master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","realm_name":"test-realm","realm_epoch":4} 2021-03-24T12:12:29.713 INFO:rgw_multi.tests:Set master zone=test-zone1, waiting 60s for reconfiguration.. 2021-03-24T12:13:29.714 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-31 2021-03-24T12:13:29.750 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-32 2021-03-24T12:13:29.803 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-03-24T12:13:29.804 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-03-24T12:13:29.808 INFO:tasks.rgw.c2.client.1:Started 2021-03-24T12:13:29.808 DEBUG:teuthology.orchestra.run.smithi161:> curl http://smithi161.front.sepia.ceph.com:8001 2021-03-24T12:13:29.823 INFO:teuthology.orchestra.run.smithi161.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-03-24T12:13:29.823 INFO:teuthology.orchestra.run.smithi161.stderr: Dload Upload Total Spent Left Speed 2021-03-24T12:13:29.826 INFO:teuthology.orchestra.run.smithi161.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi161.front.sepia.ceph.com port 8001: Connection refused 2021-03-24T12:13:29.827 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-03-24T12:13:30.829 DEBUG:teuthology.orchestra.run.smithi161:> curl http://smithi161.front.sepia.ceph.com:8001 2021-03-24T12:13:30.849 INFO:teuthology.orchestra.run.smithi161.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-03-24T12:13:30.849 INFO:teuthology.orchestra.run.smithi161.stderr: Dload Upload Total Spent Left Speed 2021-03-24T12:13:30.854 INFO:teuthology.orchestra.run.smithi161.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 134 100 134 0 0 33500 0 --:--:-- --:--:-- --:--:-- 33500 2021-03-24T12:13:30.855 INFO:teuthology.orchestra.run.smithi161.stdout:{"Code":"MethodNotAllowed","RequestId":"tx000000000000000000001-00605b2cea-143b-test-zone3","HostId":"143b-test-zone3-test-zonegroup"} 2021-03-24T12:13:30.855 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:30.856 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:30.857 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:30.896 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:30.897 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:31.057 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=876ba0ea-d5b5-41b8-b270-94bbb5b3c639 2021-03-24T12:13:31.087 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616588009.781732_186.1","last_update":"2021-03-24T12:13:29.781732Z"},{"marker":"","last_update":"0.000000"}] 2021-03-24T12:13:31.088 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:13:31.088 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:31.089 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:31.089 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:31.129 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:31.129 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:31.324 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588009.781732_186.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:29.781732Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:13:31.325 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:13:31.325 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:13:31.326 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:31.326 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:31.327 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:31.411 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:31.412 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:31.668 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588009.781732_186.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:29.781732Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:13:31.668 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:13:31.669 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-27 zones={test-zone2, test-zone1} 2021-03-24T12:13:31.685 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:13:31.739 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:13:31.799 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-27 zones={test-zone2, test-zone1} 2021-03-24T12:13:31.800 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-27 zones={test-zone1, test-zone2} 2021-03-24T12:13:31.810 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:13:31.859 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:13:31.915 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-27 zones={test-zone1, test-zone2} 2021-03-24T12:13:31.916 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-28 zones={test-zone2, test-zone1} 2021-03-24T12:13:31.926 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:13:31.975 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:13:32.032 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-28 zones={test-zone2, test-zone1} 2021-03-24T12:13:32.032 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-28 zones={test-zone1, test-zone2} 2021-03-24T12:13:32.041 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:13:32.091 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:13:32.148 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-28 zones={test-zone1, test-zone2} 2021-03-24T12:13:32.148 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-29 zones={test-zone2, test-zone1} 2021-03-24T12:13:32.156 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:13:32.204 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:13:32.269 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-29 zones={test-zone2, test-zone1} 2021-03-24T12:13:32.441 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-29 zones={test-zone1, test-zone2} 2021-03-24T12:13:32.451 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:13:32.503 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:13:32.559 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-29 zones={test-zone1, test-zone2} 2021-03-24T12:13:32.559 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-30 zones={test-zone2, test-zone1} 2021-03-24T12:13:32.567 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:13:32.619 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:13:32.676 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-30 zones={test-zone2, test-zone1} 2021-03-24T12:13:32.676 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-30 zones={test-zone1, test-zone2} 2021-03-24T12:13:32.685 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:13:32.731 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:13:32.789 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-30 zones={test-zone1, test-zone2} 2021-03-24T12:13:32.790 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-31 zones={test-zone2, test-zone1} 2021-03-24T12:13:32.799 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:13:32.847 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:13:32.904 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-31 zones={test-zone2, test-zone1} 2021-03-24T12:13:32.904 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-31 zones={test-zone1, test-zone2} 2021-03-24T12:13:32.912 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:13:32.959 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:13:33.020 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-31 zones={test-zone1, test-zone2} 2021-03-24T12:13:33.021 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-32 zones={test-zone2, test-zone1} 2021-03-24T12:13:33.030 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:13:33.075 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:13:33.132 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-32 zones={test-zone2, test-zone1} 2021-03-24T12:13:33.133 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-32 zones={test-zone1, test-zone2} 2021-03-24T12:13:33.142 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:13:33.195 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:13:33.256 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-32 zones={test-zone1, test-zone2} 2021-03-24T12:13:33.257 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '5d6d539e-fcb5-4061-8385-16fad563da6c', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:33.258 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '5d6d539e-fcb5-4061-8385-16fad563da6c', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:33.259 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 5d6d539e-fcb5-4061-8385-16fad563da6c --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:33.300 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:33.300 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:33.500 INFO:teuthology.orchestra.run.smithi043.stdout:[{"id":"1_1616587550.675677_29.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-03-24T12:05:50.675677399Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6KcPBmQaugY6CjNqS6Le3RQ","ver":1},"status":{"status":"write"}}},{"id":"1_1616587550.682762_31.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-03-24T12:05:50.682762862Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6KcPBmQaugY6CjNqS6Le3RQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587716.682848_63.1","section":"bucket.instance","name":"jlfoya-10:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.14","timestamp":"2021-03-24T12:08:36.682848487Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rg1h9ZYIGqQOolFs1RXp4Mh","ver":1},"status":{"status":"write"}}},{"id":"1_1616587716.688127_67.1","section":"bucket.instance","name":"jlfoya-10:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.14","timestamp":"2021-03-24T12:08:36.688127405Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rg1h9ZYIGqQOolFs1RXp4Mh","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587716.689817_68.1","section":"bucket","name":"jlfoya-10","timestamp":"2021-03-24T12:08:36.689817399Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lXCyZiNazORv7teZ5YJN-Pa","ver":1},"status":{"status":"write"}}},{"id":"1_1616587716.694293_69.1","section":"bucket","name":"jlfoya-10","timestamp":"2021-03-24T12:08:36.694293526Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lXCyZiNazORv7teZ5YJN-Pa","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587737.539850_70.1","section":"bucket.instance","name":"jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15","timestamp":"2021-03-24T12:08:57.539850502Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":1},"status":{"status":"write"}}},{"id":"1_1616587737.544669_79.1","section":"bucket.instance","name":"jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15","timestamp":"2021-03-24T12:08:57.544669956Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587737.546171_80.1","section":"bucket","name":"jlfoya-11","timestamp":"2021-03-24T12:08:57.546171696Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__RUabtIDWoeGFbORDGivKd5","ver":1},"status":{"status":"write"}}},{"id":"1_1616587737.550753_81.1","section":"bucket","name":"jlfoya-11","timestamp":"2021-03-24T12:08:57.550753488Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__RUabtIDWoeGFbORDGivKd5","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587737.566397_82.1","section":"bucket.instance","name":"jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16","timestamp":"2021-03-24T12:08:57.566397219Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":1},"status":{"status":"write"}}},{"id":"1_1616587737.571374_83.1","section":"bucket.instance","name":"jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16","timestamp":"2021-03-24T12:08:57.571374170Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587737.573485_84.1","section":"bucket","name":"jlfoya-12","timestamp":"2021-03-24T12:08:57.573485071Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0oNWZZmIFF6cc0a1TJFmkRZ","ver":1},"status":{"status":"write"}}},{"id":"1_1616587737.577901_85.1","section":"bucket","name":"jlfoya-12","timestamp":"2021-03-24T12:08:57.577901486Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0oNWZZmIFF6cc0a1TJFmkRZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587737.598120_86.1","section":"bucket.instance","name":"jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15","timestamp":"2021-03-24T12:08:57.598120265Z","data":{"read_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":1},"write_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":2},"status":{"status":"write"}}},{"id":"1_1616587737.603801_87.1","section":"bucket.instance","name":"jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15","timestamp":"2021-03-24T12:08:57.603801422Z","data":{"read_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":1},"write_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587737.608228_88.1","section":"bucket.instance","name":"jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16","timestamp":"2021-03-24T12:08:57.608228841Z","data":{"read_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":1},"write_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":2},"status":{"status":"write"}}},{"id":"1_1616587737.614399_89.1","section":"bucket.instance","name":"jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16","timestamp":"2021-03-24T12:08:57.614399116Z","data":{"read_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":1},"write_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587765.720699_90.1","section":"bucket.instance","name":"jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17","timestamp":"2021-03-24T12:09:25.720699170Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":1},"status":{"status":"write"}}},{"id":"1_1616587765.725616_108.1","section":"bucket.instance","name":"jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17","timestamp":"2021-03-24T12:09:25.725616205Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587765.727212_109.1","section":"bucket","name":"jlfoya-13","timestamp":"2021-03-24T12:09:25.727212117Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1Q07ubVI1eY9ry2c0jK32Ko","ver":1},"status":{"status":"write"}}},{"id":"1_1616587765.731501_110.1","section":"bucket","name":"jlfoya-13","timestamp":"2021-03-24T12:09:25.731501211Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1Q07ubVI1eY9ry2c0jK32Ko","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587765.737387_111.1","section":"bucket.instance","name":"jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17","timestamp":"2021-03-24T12:09:25.737387919Z","data":{"read_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":1},"write_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":2},"status":{"status":"write"}}},{"id":"1_1616587765.742617_112.1","section":"bucket.instance","name":"jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17","timestamp":"2021-03-24T12:09:25.742617283Z","data":{"read_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":1},"write_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587793.818656_113.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:09:53.818656261Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":1},"status":{"status":"write"}}},{"id":"1_1616587793.823825_124.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:09:53.823825068Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587793.825600_125.1","section":"bucket","name":"jlfoya-14","timestamp":"2021-03-24T12:09:53.825600115Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QW96sea5aZVepYZO-z7_j9U","ver":1},"status":{"status":"write"}}},{"id":"1_1616587793.830203_126.1","section":"bucket","name":"jlfoya-14","timestamp":"2021-03-24T12:09:53.830203560Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QW96sea5aZVepYZO-z7_j9U","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587806.894096_127.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:10:06.894096972Z","data":{"read_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":1},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":2},"status":{"status":"write"}}},{"id":"1_1616587806.902205_132.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:10:06.902205585Z","data":{"read_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":1},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587820.187906_133.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:10:20.187906106Z","data":{"read_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":2},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":3},"status":{"status":"write"}}},{"id":"1_1616587820.195106_138.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:10:20.195106231Z","data":{"read_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":2},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":3},"status":{"status":"complete"}}},{"id":"1_1616587833.352018_139.1","section":"bucket.instance","name":"jlfoya-15:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.19","timestamp":"2021-03-24T12:10:33.352018249Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":1},"status":{"status":"write"}}},{"id":"1_1616587833.356941_144.1","section":"bucket.instance","name":"jlfoya-15:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.19","timestamp":"2021-03-24T12:10:33.356941972Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587833.358874_145.1","section":"bucket","name":"jlfoya-15","timestamp":"2021-03-24T12:10:33.358874924Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GDXZAfEyhVoCakmOLtmbMnk","ver":1},"status":{"status":"write"}}},{"id":"1_1616587833.363317_146.1","section":"bucket","name":"jlfoya-15","timestamp":"2021-03-24T12:10:33.363317801Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GDXZAfEyhVoCakmOLtmbMnk","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587833.379493_147.1","section":"bucket.instance","name":"jlfoya-16:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.20","timestamp":"2021-03-24T12:10:33.379493948Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":1},"status":{"status":"write"}}},{"id":"1_1616587833.385066_148.1","section":"bucket.instance","name":"jlfoya-16:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.20","timestamp":"2021-03-24T12:10:33.385066216Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587833.386845_149.1","section":"bucket","name":"jlfoya-16","timestamp":"2021-03-24T12:10:33.386845499Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DsVjQllVvSJ8MaEPChUnKDq","ver":1},"status":{"status":"write"}}},{"id":"1_1616587833.390929_150.1","section":"bucket","name":"jlfoya-16","timestamp":"2021-03-24T12:10:33.390929239Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DsVjQllVvSJ8MaEPChUnKDq","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587833.413009_151.1","section":"bucket.instance","name":"jlfoya-15:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.19","timestamp":"2021-03-24T12:10:33.413009491Z","data":{"read_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":1},"write_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":2},"status":{"status":"write"}}},{"id":"1_1616587833.419187_152.1","section":"bucket.instance","name":"jlfoya-15:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.19","timestamp":"2021-03-24T12:10:33.419187376Z","data":{"read_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":1},"write_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587833.424089_153.1","section":"bucket.instance","name":"jlfoya-16:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.20","timestamp":"2021-03-24T12:10:33.424089009Z","data":{"read_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":1},"write_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":2},"status":{"status":"write"}}},{"id":"1_1616587833.429962_154.1","section":"bucket.instance","name":"jlfoya-16:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.20","timestamp":"2021-03-24T12:10:33.429962684Z","data":{"read_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":1},"write_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587848.294780_155.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.294780794Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":1},"status":{"status":"write"}}},{"id":"1_1616587848.298873_163.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.298873824Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587848.300376_164.1","section":"bucket","name":"jlfoya-17","timestamp":"2021-03-24T12:10:48.300376620Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ETwgVz58fZ8am7wVPac3vxr","ver":1},"status":{"status":"write"}}},{"id":"1_1616587848.304548_165.1","section":"bucket","name":"jlfoya-17","timestamp":"2021-03-24T12:10:48.304548123Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ETwgVz58fZ8am7wVPac3vxr","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587848.320133_166.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.320133479Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":1},"status":{"status":"write"}}},{"id":"1_1616587848.325643_167.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.325643092Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587848.327338_168.1","section":"bucket","name":"jlfoya-18","timestamp":"2021-03-24T12:10:48.327338896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c7udEzNtUlrN14sIVt-5DA-","ver":1},"status":{"status":"write"}}},{"id":"1_1616587848.331668_169.1","section":"bucket","name":"jlfoya-18","timestamp":"2021-03-24T12:10:48.331668494Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c7udEzNtUlrN14sIVt-5DA-","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587848.356541_170.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.356541395Z","data":{"read_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":1},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":2},"status":{"status":"write"}}},{"id":"1_1616587848.362642_171.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.362642178Z","data":{"read_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":1},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587848.366844_172.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.366844502Z","data":{"read_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":2},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":3},"status":{"status":"write"}}},{"id":"1_1616587848.372757_173.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.372757221Z","data":{"read_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":2},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":3},"status":{"status":"complete"}}},{"id":"1_1616587848.377512_174.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.377512993Z","data":{"read_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":1},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":2},"status":{"status":"write"}}},{"id":"1_1616587848.383426_175.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.383426651Z","data":{"read_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":1},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587848.392783_176.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.392783990Z","data":{"read_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":2},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":3},"status":{"status":"write"}}},{"id":"1_1616587848.398925_177.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.398925684Z","data":{"read_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":2},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":3},"status":{"status":"complete"}}},{"id":"1_1616587863.043236_189.1","section":"bucket.instance","name":"jlfoya-19:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.23","timestamp":"2021-03-24T12:11:03.043236174Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.048576_195.1","section":"bucket.instance","name":"jlfoya-19:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.23","timestamp":"2021-03-24T12:11:03.048576121Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.050487_196.1","section":"bucket","name":"jlfoya-19","timestamp":"2021-03-24T12:11:03.050487954Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7N_RzKj5_nb8ztfcXUaVOJQ","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.054466_197.1","section":"bucket","name":"jlfoya-19","timestamp":"2021-03-24T12:11:03.054466861Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7N_RzKj5_nb8ztfcXUaVOJQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.070764_198.1","section":"bucket.instance","name":"jlfoya-20:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.24","timestamp":"2021-03-24T12:11:03.070764210Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.075866_199.1","section":"bucket.instance","name":"jlfoya-20:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.24","timestamp":"2021-03-24T12:11:03.075866473Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.077471_200.1","section":"bucket","name":"jlfoya-20","timestamp":"2021-03-24T12:11:03.077471736Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EyzWjbixr6F4jPJFHty8FSb","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.081380_201.1","section":"bucket","name":"jlfoya-20","timestamp":"2021-03-24T12:11:03.081380371Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EyzWjbixr6F4jPJFHty8FSb","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.103898_202.1","section":"bucket.instance","name":"jlfoya-19:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.23","timestamp":"2021-03-24T12:11:03.103898749Z","data":{"read_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":1},"write_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":2},"status":{"status":"write"}}},{"id":"1_1616587863.109729_203.1","section":"bucket.instance","name":"jlfoya-19:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.23","timestamp":"2021-03-24T12:11:03.109729782Z","data":{"read_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":1},"write_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587863.159738_204.1","section":"bucket.instance","name":"jlfoya-20:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.24","timestamp":"2021-03-24T12:11:03.159738037Z","data":{"read_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":1},"write_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":2},"status":{"status":"write"}}},{"id":"1_1616587863.166854_205.1","section":"bucket.instance","name":"jlfoya-20:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.24","timestamp":"2021-03-24T12:11:03.166854336Z","data":{"read_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":1},"write_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587863.229651_206.1","section":"bucket.instance","name":"jlfoya-21:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.25","timestamp":"2021-03-24T12:11:03.229651649Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.234767_207.1","section":"bucket.instance","name":"jlfoya-21:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.25","timestamp":"2021-03-24T12:11:03.234767067Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.236248_208.1","section":"bucket","name":"jlfoya-21","timestamp":"2021-03-24T12:11:03.236248226Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_g91DT4K_wcxCnLLeTyzujUh","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.240050_209.1","section":"bucket","name":"jlfoya-21","timestamp":"2021-03-24T12:11:03.240050098Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_g91DT4K_wcxCnLLeTyzujUh","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.257301_210.1","section":"bucket.instance","name":"jlfoya-22:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.26","timestamp":"2021-03-24T12:11:03.257301022Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.262927_211.1","section":"bucket.instance","name":"jlfoya-22:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.26","timestamp":"2021-03-24T12:11:03.262927978Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.264884_212.1","section":"bucket","name":"jlfoya-22","timestamp":"2021-03-24T12:11:03.264884421Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q_yC4z5we_KuXZkz74NR_YY","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.269983_213.1","section":"bucket","name":"jlfoya-22","timestamp":"2021-03-24T12:11:03.269983689Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q_yC4z5we_KuXZkz74NR_YY","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.294923_214.1","section":"bucket.instance","name":"jlfoya-21:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.25","timestamp":"2021-03-24T12:11:03.294923585Z","data":{"read_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":1},"write_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":2},"status":{"status":"write"}}},{"id":"1_1616587863.301299_215.1","section":"bucket.instance","name":"jlfoya-21:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.25","timestamp":"2021-03-24T12:11:03.301299413Z","data":{"read_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":1},"write_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587863.353474_216.1","section":"bucket.instance","name":"jlfoya-22:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.26","timestamp":"2021-03-24T12:11:03.353474673Z","data":{"read_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":1},"write_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":2},"status":{"status":"write"}}},{"id":"1_1616587863.361616_217.1","section":"bucket.instance","name":"jlfoya-22:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.26","timestamp":"2021-03-24T12:11:03.361616751Z","data":{"read_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":1},"write_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587863.425636_218.1","section":"bucket.instance","name":"jlfoya-23:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.27","timestamp":"2021-03-24T12:11:03.425636576Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.430356_219.1","section":"bucket.instance","name":"jlfoya-23:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.27","timestamp":"2021-03-24T12:11:03.430356674Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.431699_220.1","section":"bucket","name":"jlfoya-23","timestamp":"2021-03-24T12:11:03.431699542Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_28j60sygG45tYwzerUPXLrf","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.435420_221.1","section":"bucket","name":"jlfoya-23","timestamp":"2021-03-24T12:11:03.435420963Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_28j60sygG45tYwzerUPXLrf","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.450782_222.1","section":"bucket.instance","name":"jlfoya-24:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.28","timestamp":"2021-03-24T12:11:03.450782785Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.454876_223.1","section":"bucket.instance","name":"jlfoya-24:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.28","timestamp":"2021-03-24T12:11:03.454876286Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.456342_224.1","section":"bucket","name":"jlfoya-24","timestamp":"2021-03-24T12:11:03.456342166Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-uiXURuI6PiGJpMm5n2TVga","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.460131_225.1","section":"bucket","name":"jlfoya-24","timestamp":"2021-03-24T12:11:03.460131765Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-uiXURuI6PiGJpMm5n2TVga","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.483132_226.1","section":"bucket.instance","name":"jlfoya-23:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.27","timestamp":"2021-03-24T12:11:03.483132179Z","data":{"read_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":1},"write_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":2},"status":{"status":"write"}}},{"id":"1_1616587863.488418_227.1","section":"bucket.instance","name":"jlfoya-23:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.27","timestamp":"2021-03-24T12:11:03.488418847Z","data":{"read_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":1},"write_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587864.540369_228.1","section":"bucket.instance","name":"jlfoya-24:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.28","timestamp":"2021-03-24T12:11:04.540369158Z","data":{"read_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":1},"write_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":2},"status":{"status":"write"}}},{"id":"1_1616587864.548208_229.1","section":"bucket.instance","name":"jlfoya-24:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.28","timestamp":"2021-03-24T12:11:04.548208111Z","data":{"read_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":1},"write_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587864.618831_230.1","section":"bucket.instance","name":"jlfoya-25:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.29","timestamp":"2021-03-24T12:11:04.618831504Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xDnyYxrny8m2pB4PzKcm8NY","ver":1},"status":{"status":"write"}}},{"id":"1_1616587864.623768_231.1","section":"bucket.instance","name":"jlfoya-25:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.29","timestamp":"2021-03-24T12:11:04.623768958Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xDnyYxrny8m2pB4PzKcm8NY","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587864.625235_232.1","section":"bucket","name":"jlfoya-25","timestamp":"2021-03-24T12:11:04.625235957Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2WgmSA4Nois7Lpv53s7Mc5X","ver":1},"status":{"status":"write"}}},{"id":"1_1616587864.629010_233.1","section":"bucket","name":"jlfoya-25","timestamp":"2021-03-24T12:11:04.629010849Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2WgmSA4Nois7Lpv53s7Mc5X","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587864.642842_235.1","section":"bucket.instance","name":"jlfoya-26:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.30","timestamp":"2021-03-24T12:11:04.642842977Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Lic9zQtowFETx4u-zISp5P_","ver":1},"status":{"status":"write"}}},{"id":"1_1616587864.647495_236.1","section":"bucket.instance","name":"jlfoya-26:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.30","timestamp":"2021-03-24T12:11:04.647495526Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Lic9zQtowFETx4u-zISp5P_","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587864.649465_237.1","section":"bucket","name":"jlfoya-26","timestamp":"2021-03-24T12:11:04.649465443Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OXqOHcjQU77z8q_VC_nd4J1","ver":1},"status":{"status":"write"}}},{"id":"1_1616587864.653774_238.1","section":"bucket","name":"jlfoya-26","timestamp":"2021-03-24T12:11:04.653774803Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OXqOHcjQU77z8q_VC_nd4J1","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587870.913455_244.1","section":"bucket.instance","name":"jlfoya-27:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.31","timestamp":"2021-03-24T12:11:10.913455332Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UN4R0QAQBFnB4nXfz-07vy0","ver":1},"status":{"status":"write"}}},{"id":"1_1616587870.917554_245.1","section":"bucket.instance","name":"jlfoya-27:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.31","timestamp":"2021-03-24T12:11:10.917554086Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UN4R0QAQBFnB4nXfz-07vy0","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587870.919042_246.1","section":"bucket","name":"jlfoya-27","timestamp":"2021-03-24T12:11:10.919042415Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2rg73VHjr2S1Dn-vEtO7Yc6","ver":1},"status":{"status":"write"}}},{"id":"1_1616587870.922929_247.1","section":"bucket","name":"jlfoya-27","timestamp":"2021-03-24T12:11:10.922929178Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2rg73VHjr2S1Dn-vEtO7Yc6","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587870.938808_248.1","section":"bucket.instance","name":"jlfoya-28:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.32","timestamp":"2021-03-24T12:11:10.938808024Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oxJewX121dvcHzqxFRBwymy","ver":1},"status":{"status":"write"}}},{"id":"1_1616587870.943800_249.1","section":"bucket.instance","name":"jlfoya-28:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.32","timestamp":"2021-03-24T12:11:10.943800693Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oxJewX121dvcHzqxFRBwymy","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587870.945888_250.1","section":"bucket","name":"jlfoya-28","timestamp":"2021-03-24T12:11:10.945888485Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_53ilzIgzmwdlWb2ejqYF71I","ver":1},"status":{"status":"write"}}},{"id":"1_1616587870.950038_251.1","section":"bucket","name":"jlfoya-28","timestamp":"2021-03-24T12:11:10.950038914Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_53ilzIgzmwdlWb2ejqYF71I","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587671.525015_26.1","section":"bucket.instance","name":"jlfoya-1:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.1","timestamp":"2021-03-24T12:07:51.525015135Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xGBc8XzZBCwN6lfmC5KQRJc","ver":1},"status":{"status":"write"}}},{"id":"1_1616587671.528864_27.1","section":"bucket.instance","name":"jlfoya-1:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.1","timestamp":"2021-03-24T12:07:51.528864420Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xGBc8XzZBCwN6lfmC5KQRJc","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587671.530059_28.1","section":"bucket","name":"jlfoya-1","timestamp":"2021-03-24T12:07:51.530059359Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_G9eSL8lglDY17VZRsC4sUQh","ver":1},"status":{"status":"write"}}},{"id":"1_1616587671.533457_29.1","section":"bucket","name":"jlfoya-1","timestamp":"2021-03-24T12:07:51.533457052Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_G9eSL8lglDY17VZRsC4sUQh","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587671.550187_30.1","section":"bucket.instance","name":"jlfoya-2:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.2","timestamp":"2021-03-24T12:07:51.550187246Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WvnmsaILa9xw32VSbHCUTTH","ver":1},"status":{"status":"write"}}},{"id":"1_1616587671.555163_31.1","section":"bucket.instance","name":"jlfoya-2:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.2","timestamp":"2021-03-24T12:07:51.555163704Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WvnmsaILa9xw32VSbHCUTTH","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587671.556841_32.1","section":"bucket","name":"jlfoya-2","timestamp":"2021-03-24T12:07:51.556841421Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Xr2svrr-8bZXkOmG6VfG-z","ver":1},"status":{"status":"write"}}},{"id":"1_1616587671.561122_33.1","section":"bucket","name":"jlfoya-2","timestamp":"2021-03-24T12:07:51.561122704Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Xr2svrr-8bZXkOmG6VfG-z","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587681.678709_34.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.3","timestamp":"2021-03-24T12:08:01.678709902Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_peIkv89fti0uogbWsS9ROt4","ver":1},"status":{"status":"write"}}},{"id":"1_1616587681.684061_35.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.3","timestamp":"2021-03-24T12:08:01.684061812Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_peIkv89fti0uogbWsS9ROt4","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587681.685783_36.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:01.685783533Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hhFWOBiiVqTODyEPOQ20cGw","ver":1},"status":{"status":"write"}}},{"id":"1_1616587681.689470_37.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:01.689470564Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hhFWOBiiVqTODyEPOQ20cGw","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587681.704523_38.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.4","timestamp":"2021-03-24T12:08:01.704523924Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-kf_f9i5CAs_wWtJy8zenwv","ver":1},"status":{"status":"write"}}},{"id":"1_1616587681.709290_39.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.4","timestamp":"2021-03-24T12:08:01.709290725Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-kf_f9i5CAs_wWtJy8zenwv","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587681.710934_40.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:01.710934882Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_p2wS0iipS32DkQ9UcbvJVmc","ver":1},"status":{"status":"write"}}},{"id":"1_1616587681.715179_41.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:01.715179052Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_p2wS0iipS32DkQ9UcbvJVmc","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587687.787829_44.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.5","timestamp":"2021-03-24T12:08:07.787829366Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LMB6mmpu42gLYwj4p9_-vQ-","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.793308_45.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.5","timestamp":"2021-03-24T12:08:07.793308292Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LMB6mmpu42gLYwj4p9_-vQ-","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587687.795167_46.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:07.795167007Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CtkiSkhcO0qSKvfNBgDaJ3o","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.798263_47.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:07.798263485Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CtkiSkhcO0qSKvfNBgDaJ3o","ver":1},"status":{"status":"abort"}}},{"id":"1_1616587687.818052_48.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.6","timestamp":"2021-03-24T12:08:07.818052095Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bM7FupHB0IhALIerpCpV66b","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.822554_49.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.6","timestamp":"2021-03-24T12:08:07.822554908Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bM7FupHB0IhALIerpCpV66b","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587687.824152_50.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:07.824152839Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jijbeeGhY8EfR-O5L-h1WeL","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.827161_51.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:07.827161071Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jijbeeGhY8EfR-O5L-h1WeL","ver":1},"status":{"status":"abort"}}},{"id":"1_1616587687.849585_53.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.7","timestamp":"2021-03-24T12:08:07.849585326Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MMVw4ikWkCM1-p1Ag5x-ble","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.854354_54.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.7","timestamp":"2021-03-24T12:08:07.854354765Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MMVw4ikWkCM1-p1Ag5x-ble","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587687.856126_55.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:07.856126385Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9ZQzqdf0u6cs_hTEXkKiIIA","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.859374_56.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:07.859374360Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9ZQzqdf0u6cs_hTEXkKiIIA","ver":1},"status":{"status":"abort"}}},{"id":"1_1616587687.900484_57.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.8","timestamp":"2021-03-24T12:08:07.900484057Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vRDskGBmeVeNpqYJNe29HU-","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.906310_58.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.8","timestamp":"2021-03-24T12:08:07.906310291Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vRDskGBmeVeNpqYJNe29HU-","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587687.908537_59.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:07.908537979Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OR5nzqpk2CNcWS567A8E1lM","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.911786_60.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:07.911786205Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OR5nzqpk2CNcWS567A8E1lM","ver":1},"status":{"status":"abort"}}},{"id":"1_1616587694.025764_64.1","section":"bucket.instance","name":"jlfoya-5:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.9","timestamp":"2021-03-24T12:08:14.025764815Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BKLX5Oo3N0rSYpCKUbmLuR_","ver":1},"status":{"status":"write"}}},{"id":"1_1616587694.031300_65.1","section":"bucket.instance","name":"jlfoya-5:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.9","timestamp":"2021-03-24T12:08:14.031300768Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BKLX5Oo3N0rSYpCKUbmLuR_","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587694.033041_66.1","section":"bucket","name":"jlfoya-5","timestamp":"2021-03-24T12:08:14.033041117Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":1},"status":{"status":"write"}}},{"id":"1_1616587694.037524_67.1","section":"bucket","name":"jlfoya-5","timestamp":"2021-03-24T12:08:14.037524884Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587694.055675_68.1","section":"bucket.instance","name":"jlfoya-6:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.10","timestamp":"2021-03-24T12:08:14.055675506Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xN_p9wc0oXuNZ9fFoDUELIm","ver":1},"status":{"status":"write"}}},{"id":"1_1616587694.061020_69.1","section":"bucket.instance","name":"jlfoya-6:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.10","timestamp":"2021-03-24T12:08:14.061020181Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xN_p9wc0oXuNZ9fFoDUELIm","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587694.062889_70.1","section":"bucket","name":"jlfoya-6","timestamp":"2021-03-24T12:08:14.062889517Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":1},"status":{"status":"write"}}},{"id":"1_1616587694.067610_71.1","section":"bucket","name":"jlfoya-6","timestamp":"2021-03-24T12:08:14.067610628Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587700.166078_72.1","section":"bucket","name":"jlfoya-5","timestamp":"2021-03-24T12:08:20.166078475Z","data":{"read_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":1},"write_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":2},"status":{"status":"remove"}}},{"id":"1_1616587700.171949_73.1","section":"bucket","name":"jlfoya-5","timestamp":"2021-03-24T12:08:20.171949884Z","data":{"read_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":1},"write_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587700.210222_74.1","section":"bucket","name":"jlfoya-6","timestamp":"2021-03-24T12:08:20.210222785Z","data":{"read_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":1},"write_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":2},"status":{"status":"remove"}}},{"id":"1_1616587700.216525_75.1","section":"bucket","name":"jlfoya-6","timestamp":"2021-03-24T12:08:20.216525028Z","data":{"read_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":1},"write_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587706.294959_76.1","section":"bucket.instance","name":"jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11","timestamp":"2021-03-24T12:08:26.294959829Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IrblIlPENwXNmuqr5sqYNhB","ver":1},"status":{"status":"write"}}},{"id":"1_1616587706.299846_77.1","section":"bucket.instance","name":"jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11","timestamp":"2021-03-24T12:08:26.299846411Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IrblIlPENwXNmuqr5sqYNhB","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587706.301296_78.1","section":"bucket","name":"jlfoya-7","timestamp":"2021-03-24T12:08:26.301296632Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OhcrZa7MslrBrCRXERooTan","ver":1},"status":{"status":"write"}}},{"id":"1_1616587706.305050_79.1","section":"bucket","name":"jlfoya-7","timestamp":"2021-03-24T12:08:26.305050032Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OhcrZa7MslrBrCRXERooTan","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587706.319864_80.1","section":"bucket.instance","name":"jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12","timestamp":"2021-03-24T12:08:26.319864901Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FYtpqg46w2xkQJingexvaFZ","ver":1},"status":{"status":"write"}}},{"id":"1_1616587706.324671_81.1","section":"bucket.instance","name":"jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12","timestamp":"2021-03-24T12:08:26.324671935Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FYtpqg46w2xkQJingexvaFZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587706.326648_82.1","section":"bucket","name":"jlfoya-8","timestamp":"2021-03-24T12:08:26.326648917Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c7LAl7nuIs8w-WPWiUI7_iu","ver":1},"status":{"status":"write"}}},{"id":"1_1616587706.331161_83.1","section":"bucket","name":"jlfoya-8","timestamp":"2021-03-24T12:08:26.331161071Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c7LAl7nuIs8w-WPWiUI7_iu","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587716.654751_84.1","section":"bucket.instance","name":"jlfoya-9:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.13","timestamp":"2021-03-24T12:08:36.654751026Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RK57Yueu_qMKqyQG5Qd2rQk","ver":1},"status":{"status":"write"}}},{"id":"1_1616587716.660222_85.1","section":"bucket.instance","name":"jlfoya-9:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.13","timestamp":"2021-03-24T12:08:36.660222482Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RK57Yueu_qMKqyQG5Qd2rQk","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587716.661946_86.1","section":"bucket","name":"jlfoya-9","timestamp":"2021-03-24T12:08:36.661946287Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Av-37SOsD82ILKqYnxO8Dd-","ver":1},"status":{"status":"write"}}},{"id":"1_1616587716.665846_87.1","section":"bucket","name":"jlfoya-9","timestamp":"2021-03-24T12:08:36.665846681Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Av-37SOsD82ILKqYnxO8Dd-","ver":1},"status":{"status":"complete"}}}] 2021-03-24T12:13:33.502 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '5d6d539e-fcb5-4061-8385-16fad563da6c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:33.502 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '5d6d539e-fcb5-4061-8385-16fad563da6c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:33.503 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 5d6d539e-fcb5-4061-8385-16fad563da6c --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:33.539 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:33.539 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:33.727 INFO:teuthology.orchestra.run.smithi161.stdout:[{"id":"1_1616587550.675677_29.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-03-24T12:05:50.675677399Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6KcPBmQaugY6CjNqS6Le3RQ","ver":1},"status":{"status":"write"}}},{"id":"1_1616587550.682762_31.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-03-24T12:05:50.682762862Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6KcPBmQaugY6CjNqS6Le3RQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587716.682848_63.1","section":"bucket.instance","name":"jlfoya-10:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.14","timestamp":"2021-03-24T12:08:36.682848487Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rg1h9ZYIGqQOolFs1RXp4Mh","ver":1},"status":{"status":"write"}}},{"id":"1_1616587716.688127_67.1","section":"bucket.instance","name":"jlfoya-10:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.14","timestamp":"2021-03-24T12:08:36.688127405Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rg1h9ZYIGqQOolFs1RXp4Mh","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587716.689817_68.1","section":"bucket","name":"jlfoya-10","timestamp":"2021-03-24T12:08:36.689817399Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lXCyZiNazORv7teZ5YJN-Pa","ver":1},"status":{"status":"write"}}},{"id":"1_1616587716.694293_69.1","section":"bucket","name":"jlfoya-10","timestamp":"2021-03-24T12:08:36.694293526Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lXCyZiNazORv7teZ5YJN-Pa","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587737.539850_70.1","section":"bucket.instance","name":"jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15","timestamp":"2021-03-24T12:08:57.539850502Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":1},"status":{"status":"write"}}},{"id":"1_1616587737.544669_79.1","section":"bucket.instance","name":"jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15","timestamp":"2021-03-24T12:08:57.544669956Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587737.546171_80.1","section":"bucket","name":"jlfoya-11","timestamp":"2021-03-24T12:08:57.546171696Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__RUabtIDWoeGFbORDGivKd5","ver":1},"status":{"status":"write"}}},{"id":"1_1616587737.550753_81.1","section":"bucket","name":"jlfoya-11","timestamp":"2021-03-24T12:08:57.550753488Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__RUabtIDWoeGFbORDGivKd5","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587737.566397_82.1","section":"bucket.instance","name":"jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16","timestamp":"2021-03-24T12:08:57.566397219Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":1},"status":{"status":"write"}}},{"id":"1_1616587737.571374_83.1","section":"bucket.instance","name":"jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16","timestamp":"2021-03-24T12:08:57.571374170Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587737.573485_84.1","section":"bucket","name":"jlfoya-12","timestamp":"2021-03-24T12:08:57.573485071Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0oNWZZmIFF6cc0a1TJFmkRZ","ver":1},"status":{"status":"write"}}},{"id":"1_1616587737.577901_85.1","section":"bucket","name":"jlfoya-12","timestamp":"2021-03-24T12:08:57.577901486Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0oNWZZmIFF6cc0a1TJFmkRZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587737.598120_86.1","section":"bucket.instance","name":"jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15","timestamp":"2021-03-24T12:08:57.598120265Z","data":{"read_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":1},"write_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":2},"status":{"status":"write"}}},{"id":"1_1616587737.603801_87.1","section":"bucket.instance","name":"jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15","timestamp":"2021-03-24T12:08:57.603801422Z","data":{"read_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":1},"write_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587737.608228_88.1","section":"bucket.instance","name":"jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16","timestamp":"2021-03-24T12:08:57.608228841Z","data":{"read_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":1},"write_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":2},"status":{"status":"write"}}},{"id":"1_1616587737.614399_89.1","section":"bucket.instance","name":"jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16","timestamp":"2021-03-24T12:08:57.614399116Z","data":{"read_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":1},"write_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587765.720699_90.1","section":"bucket.instance","name":"jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17","timestamp":"2021-03-24T12:09:25.720699170Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":1},"status":{"status":"write"}}},{"id":"1_1616587765.725616_108.1","section":"bucket.instance","name":"jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17","timestamp":"2021-03-24T12:09:25.725616205Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587765.727212_109.1","section":"bucket","name":"jlfoya-13","timestamp":"2021-03-24T12:09:25.727212117Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1Q07ubVI1eY9ry2c0jK32Ko","ver":1},"status":{"status":"write"}}},{"id":"1_1616587765.731501_110.1","section":"bucket","name":"jlfoya-13","timestamp":"2021-03-24T12:09:25.731501211Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1Q07ubVI1eY9ry2c0jK32Ko","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587765.737387_111.1","section":"bucket.instance","name":"jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17","timestamp":"2021-03-24T12:09:25.737387919Z","data":{"read_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":1},"write_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":2},"status":{"status":"write"}}},{"id":"1_1616587765.742617_112.1","section":"bucket.instance","name":"jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17","timestamp":"2021-03-24T12:09:25.742617283Z","data":{"read_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":1},"write_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587793.818656_113.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:09:53.818656261Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":1},"status":{"status":"write"}}},{"id":"1_1616587793.823825_124.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:09:53.823825068Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587793.825600_125.1","section":"bucket","name":"jlfoya-14","timestamp":"2021-03-24T12:09:53.825600115Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QW96sea5aZVepYZO-z7_j9U","ver":1},"status":{"status":"write"}}},{"id":"1_1616587793.830203_126.1","section":"bucket","name":"jlfoya-14","timestamp":"2021-03-24T12:09:53.830203560Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QW96sea5aZVepYZO-z7_j9U","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587806.894096_127.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:10:06.894096972Z","data":{"read_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":1},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":2},"status":{"status":"write"}}},{"id":"1_1616587806.902205_132.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:10:06.902205585Z","data":{"read_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":1},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587820.187906_133.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:10:20.187906106Z","data":{"read_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":2},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":3},"status":{"status":"write"}}},{"id":"1_1616587820.195106_138.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:10:20.195106231Z","data":{"read_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":2},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":3},"status":{"status":"complete"}}},{"id":"1_1616587833.352018_139.1","section":"bucket.instance","name":"jlfoya-15:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.19","timestamp":"2021-03-24T12:10:33.352018249Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":1},"status":{"status":"write"}}},{"id":"1_1616587833.356941_144.1","section":"bucket.instance","name":"jlfoya-15:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.19","timestamp":"2021-03-24T12:10:33.356941972Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587833.358874_145.1","section":"bucket","name":"jlfoya-15","timestamp":"2021-03-24T12:10:33.358874924Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GDXZAfEyhVoCakmOLtmbMnk","ver":1},"status":{"status":"write"}}},{"id":"1_1616587833.363317_146.1","section":"bucket","name":"jlfoya-15","timestamp":"2021-03-24T12:10:33.363317801Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GDXZAfEyhVoCakmOLtmbMnk","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587833.379493_147.1","section":"bucket.instance","name":"jlfoya-16:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.20","timestamp":"2021-03-24T12:10:33.379493948Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":1},"status":{"status":"write"}}},{"id":"1_1616587833.385066_148.1","section":"bucket.instance","name":"jlfoya-16:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.20","timestamp":"2021-03-24T12:10:33.385066216Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587833.386845_149.1","section":"bucket","name":"jlfoya-16","timestamp":"2021-03-24T12:10:33.386845499Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DsVjQllVvSJ8MaEPChUnKDq","ver":1},"status":{"status":"write"}}},{"id":"1_1616587833.390929_150.1","section":"bucket","name":"jlfoya-16","timestamp":"2021-03-24T12:10:33.390929239Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DsVjQllVvSJ8MaEPChUnKDq","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587833.413009_151.1","section":"bucket.instance","name":"jlfoya-15:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.19","timestamp":"2021-03-24T12:10:33.413009491Z","data":{"read_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":1},"write_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":2},"status":{"status":"write"}}},{"id":"1_1616587833.419187_152.1","section":"bucket.instance","name":"jlfoya-15:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.19","timestamp":"2021-03-24T12:10:33.419187376Z","data":{"read_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":1},"write_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587833.424089_153.1","section":"bucket.instance","name":"jlfoya-16:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.20","timestamp":"2021-03-24T12:10:33.424089009Z","data":{"read_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":1},"write_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":2},"status":{"status":"write"}}},{"id":"1_1616587833.429962_154.1","section":"bucket.instance","name":"jlfoya-16:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.20","timestamp":"2021-03-24T12:10:33.429962684Z","data":{"read_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":1},"write_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587848.294780_155.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.294780794Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":1},"status":{"status":"write"}}},{"id":"1_1616587848.298873_163.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.298873824Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587848.300376_164.1","section":"bucket","name":"jlfoya-17","timestamp":"2021-03-24T12:10:48.300376620Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ETwgVz58fZ8am7wVPac3vxr","ver":1},"status":{"status":"write"}}},{"id":"1_1616587848.304548_165.1","section":"bucket","name":"jlfoya-17","timestamp":"2021-03-24T12:10:48.304548123Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ETwgVz58fZ8am7wVPac3vxr","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587848.320133_166.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.320133479Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":1},"status":{"status":"write"}}},{"id":"1_1616587848.325643_167.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.325643092Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587848.327338_168.1","section":"bucket","name":"jlfoya-18","timestamp":"2021-03-24T12:10:48.327338896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c7udEzNtUlrN14sIVt-5DA-","ver":1},"status":{"status":"write"}}},{"id":"1_1616587848.331668_169.1","section":"bucket","name":"jlfoya-18","timestamp":"2021-03-24T12:10:48.331668494Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c7udEzNtUlrN14sIVt-5DA-","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587848.356541_170.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.356541395Z","data":{"read_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":1},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":2},"status":{"status":"write"}}},{"id":"1_1616587848.362642_171.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.362642178Z","data":{"read_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":1},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587848.366844_172.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.366844502Z","data":{"read_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":2},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":3},"status":{"status":"write"}}},{"id":"1_1616587848.372757_173.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.372757221Z","data":{"read_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":2},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":3},"status":{"status":"complete"}}},{"id":"1_1616587848.377512_174.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.377512993Z","data":{"read_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":1},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":2},"status":{"status":"write"}}},{"id":"1_1616587848.383426_175.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.383426651Z","data":{"read_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":1},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587848.392783_176.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.392783990Z","data":{"read_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":2},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":3},"status":{"status":"write"}}},{"id":"1_1616587848.398925_177.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.398925684Z","data":{"read_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":2},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":3},"status":{"status":"complete"}}},{"id":"1_1616587863.043236_189.1","section":"bucket.instance","name":"jlfoya-19:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.23","timestamp":"2021-03-24T12:11:03.043236174Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.048576_195.1","section":"bucket.instance","name":"jlfoya-19:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.23","timestamp":"2021-03-24T12:11:03.048576121Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.050487_196.1","section":"bucket","name":"jlfoya-19","timestamp":"2021-03-24T12:11:03.050487954Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7N_RzKj5_nb8ztfcXUaVOJQ","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.054466_197.1","section":"bucket","name":"jlfoya-19","timestamp":"2021-03-24T12:11:03.054466861Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7N_RzKj5_nb8ztfcXUaVOJQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.070764_198.1","section":"bucket.instance","name":"jlfoya-20:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.24","timestamp":"2021-03-24T12:11:03.070764210Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.075866_199.1","section":"bucket.instance","name":"jlfoya-20:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.24","timestamp":"2021-03-24T12:11:03.075866473Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.077471_200.1","section":"bucket","name":"jlfoya-20","timestamp":"2021-03-24T12:11:03.077471736Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EyzWjbixr6F4jPJFHty8FSb","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.081380_201.1","section":"bucket","name":"jlfoya-20","timestamp":"2021-03-24T12:11:03.081380371Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EyzWjbixr6F4jPJFHty8FSb","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.103898_202.1","section":"bucket.instance","name":"jlfoya-19:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.23","timestamp":"2021-03-24T12:11:03.103898749Z","data":{"read_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":1},"write_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":2},"status":{"status":"write"}}},{"id":"1_1616587863.109729_203.1","section":"bucket.instance","name":"jlfoya-19:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.23","timestamp":"2021-03-24T12:11:03.109729782Z","data":{"read_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":1},"write_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587863.159738_204.1","section":"bucket.instance","name":"jlfoya-20:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.24","timestamp":"2021-03-24T12:11:03.159738037Z","data":{"read_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":1},"write_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":2},"status":{"status":"write"}}},{"id":"1_1616587863.166854_205.1","section":"bucket.instance","name":"jlfoya-20:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.24","timestamp":"2021-03-24T12:11:03.166854336Z","data":{"read_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":1},"write_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587863.229651_206.1","section":"bucket.instance","name":"jlfoya-21:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.25","timestamp":"2021-03-24T12:11:03.229651649Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.234767_207.1","section":"bucket.instance","name":"jlfoya-21:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.25","timestamp":"2021-03-24T12:11:03.234767067Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.236248_208.1","section":"bucket","name":"jlfoya-21","timestamp":"2021-03-24T12:11:03.236248226Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_g91DT4K_wcxCnLLeTyzujUh","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.240050_209.1","section":"bucket","name":"jlfoya-21","timestamp":"2021-03-24T12:11:03.240050098Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_g91DT4K_wcxCnLLeTyzujUh","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.257301_210.1","section":"bucket.instance","name":"jlfoya-22:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.26","timestamp":"2021-03-24T12:11:03.257301022Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.262927_211.1","section":"bucket.instance","name":"jlfoya-22:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.26","timestamp":"2021-03-24T12:11:03.262927978Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.264884_212.1","section":"bucket","name":"jlfoya-22","timestamp":"2021-03-24T12:11:03.264884421Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q_yC4z5we_KuXZkz74NR_YY","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.269983_213.1","section":"bucket","name":"jlfoya-22","timestamp":"2021-03-24T12:11:03.269983689Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q_yC4z5we_KuXZkz74NR_YY","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.294923_214.1","section":"bucket.instance","name":"jlfoya-21:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.25","timestamp":"2021-03-24T12:11:03.294923585Z","data":{"read_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":1},"write_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":2},"status":{"status":"write"}}},{"id":"1_1616587863.301299_215.1","section":"bucket.instance","name":"jlfoya-21:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.25","timestamp":"2021-03-24T12:11:03.301299413Z","data":{"read_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":1},"write_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587863.353474_216.1","section":"bucket.instance","name":"jlfoya-22:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.26","timestamp":"2021-03-24T12:11:03.353474673Z","data":{"read_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":1},"write_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":2},"status":{"status":"write"}}},{"id":"1_1616587863.361616_217.1","section":"bucket.instance","name":"jlfoya-22:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.26","timestamp":"2021-03-24T12:11:03.361616751Z","data":{"read_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":1},"write_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587863.425636_218.1","section":"bucket.instance","name":"jlfoya-23:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.27","timestamp":"2021-03-24T12:11:03.425636576Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.430356_219.1","section":"bucket.instance","name":"jlfoya-23:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.27","timestamp":"2021-03-24T12:11:03.430356674Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.431699_220.1","section":"bucket","name":"jlfoya-23","timestamp":"2021-03-24T12:11:03.431699542Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_28j60sygG45tYwzerUPXLrf","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.435420_221.1","section":"bucket","name":"jlfoya-23","timestamp":"2021-03-24T12:11:03.435420963Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_28j60sygG45tYwzerUPXLrf","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.450782_222.1","section":"bucket.instance","name":"jlfoya-24:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.28","timestamp":"2021-03-24T12:11:03.450782785Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.454876_223.1","section":"bucket.instance","name":"jlfoya-24:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.28","timestamp":"2021-03-24T12:11:03.454876286Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.456342_224.1","section":"bucket","name":"jlfoya-24","timestamp":"2021-03-24T12:11:03.456342166Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-uiXURuI6PiGJpMm5n2TVga","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.460131_225.1","section":"bucket","name":"jlfoya-24","timestamp":"2021-03-24T12:11:03.460131765Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-uiXURuI6PiGJpMm5n2TVga","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.483132_226.1","section":"bucket.instance","name":"jlfoya-23:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.27","timestamp":"2021-03-24T12:11:03.483132179Z","data":{"read_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":1},"write_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":2},"status":{"status":"write"}}},{"id":"1_1616587863.488418_227.1","section":"bucket.instance","name":"jlfoya-23:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.27","timestamp":"2021-03-24T12:11:03.488418847Z","data":{"read_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":1},"write_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587864.540369_228.1","section":"bucket.instance","name":"jlfoya-24:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.28","timestamp":"2021-03-24T12:11:04.540369158Z","data":{"read_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":1},"write_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":2},"status":{"status":"write"}}},{"id":"1_1616587864.548208_229.1","section":"bucket.instance","name":"jlfoya-24:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.28","timestamp":"2021-03-24T12:11:04.548208111Z","data":{"read_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":1},"write_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587864.618831_230.1","section":"bucket.instance","name":"jlfoya-25:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.29","timestamp":"2021-03-24T12:11:04.618831504Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xDnyYxrny8m2pB4PzKcm8NY","ver":1},"status":{"status":"write"}}},{"id":"1_1616587864.623768_231.1","section":"bucket.instance","name":"jlfoya-25:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.29","timestamp":"2021-03-24T12:11:04.623768958Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xDnyYxrny8m2pB4PzKcm8NY","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587864.625235_232.1","section":"bucket","name":"jlfoya-25","timestamp":"2021-03-24T12:11:04.625235957Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2WgmSA4Nois7Lpv53s7Mc5X","ver":1},"status":{"status":"write"}}},{"id":"1_1616587864.629010_233.1","section":"bucket","name":"jlfoya-25","timestamp":"2021-03-24T12:11:04.629010849Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2WgmSA4Nois7Lpv53s7Mc5X","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587864.642842_235.1","section":"bucket.instance","name":"jlfoya-26:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.30","timestamp":"2021-03-24T12:11:04.642842977Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Lic9zQtowFETx4u-zISp5P_","ver":1},"status":{"status":"write"}}},{"id":"1_1616587864.647495_236.1","section":"bucket.instance","name":"jlfoya-26:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.30","timestamp":"2021-03-24T12:11:04.647495526Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Lic9zQtowFETx4u-zISp5P_","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587864.649465_237.1","section":"bucket","name":"jlfoya-26","timestamp":"2021-03-24T12:11:04.649465443Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OXqOHcjQU77z8q_VC_nd4J1","ver":1},"status":{"status":"write"}}},{"id":"1_1616587864.653774_238.1","section":"bucket","name":"jlfoya-26","timestamp":"2021-03-24T12:11:04.653774803Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OXqOHcjQU77z8q_VC_nd4J1","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587870.913455_244.1","section":"bucket.instance","name":"jlfoya-27:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.31","timestamp":"2021-03-24T12:11:10.913455332Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UN4R0QAQBFnB4nXfz-07vy0","ver":1},"status":{"status":"write"}}},{"id":"1_1616587870.917554_245.1","section":"bucket.instance","name":"jlfoya-27:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.31","timestamp":"2021-03-24T12:11:10.917554086Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UN4R0QAQBFnB4nXfz-07vy0","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587870.919042_246.1","section":"bucket","name":"jlfoya-27","timestamp":"2021-03-24T12:11:10.919042415Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2rg73VHjr2S1Dn-vEtO7Yc6","ver":1},"status":{"status":"write"}}},{"id":"1_1616587870.922929_247.1","section":"bucket","name":"jlfoya-27","timestamp":"2021-03-24T12:11:10.922929178Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2rg73VHjr2S1Dn-vEtO7Yc6","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587870.938808_248.1","section":"bucket.instance","name":"jlfoya-28:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.32","timestamp":"2021-03-24T12:11:10.938808024Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oxJewX121dvcHzqxFRBwymy","ver":1},"status":{"status":"write"}}},{"id":"1_1616587870.943800_249.1","section":"bucket.instance","name":"jlfoya-28:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.32","timestamp":"2021-03-24T12:11:10.943800693Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oxJewX121dvcHzqxFRBwymy","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587870.945888_250.1","section":"bucket","name":"jlfoya-28","timestamp":"2021-03-24T12:11:10.945888485Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_53ilzIgzmwdlWb2ejqYF71I","ver":1},"status":{"status":"write"}}},{"id":"1_1616587870.950038_251.1","section":"bucket","name":"jlfoya-28","timestamp":"2021-03-24T12:11:10.950038914Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_53ilzIgzmwdlWb2ejqYF71I","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587671.525015_26.1","section":"bucket.instance","name":"jlfoya-1:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.1","timestamp":"2021-03-24T12:07:51.525015135Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xGBc8XzZBCwN6lfmC5KQRJc","ver":1},"status":{"status":"write"}}},{"id":"1_1616587671.528864_27.1","section":"bucket.instance","name":"jlfoya-1:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.1","timestamp":"2021-03-24T12:07:51.528864420Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xGBc8XzZBCwN6lfmC5KQRJc","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587671.530059_28.1","section":"bucket","name":"jlfoya-1","timestamp":"2021-03-24T12:07:51.530059359Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_G9eSL8lglDY17VZRsC4sUQh","ver":1},"status":{"status":"write"}}},{"id":"1_1616587671.533457_29.1","section":"bucket","name":"jlfoya-1","timestamp":"2021-03-24T12:07:51.533457052Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_G9eSL8lglDY17VZRsC4sUQh","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587671.550187_30.1","section":"bucket.instance","name":"jlfoya-2:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.2","timestamp":"2021-03-24T12:07:51.550187246Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WvnmsaILa9xw32VSbHCUTTH","ver":1},"status":{"status":"write"}}},{"id":"1_1616587671.555163_31.1","section":"bucket.instance","name":"jlfoya-2:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.2","timestamp":"2021-03-24T12:07:51.555163704Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WvnmsaILa9xw32VSbHCUTTH","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587671.556841_32.1","section":"bucket","name":"jlfoya-2","timestamp":"2021-03-24T12:07:51.556841421Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Xr2svrr-8bZXkOmG6VfG-z","ver":1},"status":{"status":"write"}}},{"id":"1_1616587671.561122_33.1","section":"bucket","name":"jlfoya-2","timestamp":"2021-03-24T12:07:51.561122704Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Xr2svrr-8bZXkOmG6VfG-z","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587681.678709_34.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.3","timestamp":"2021-03-24T12:08:01.678709902Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_peIkv89fti0uogbWsS9ROt4","ver":1},"status":{"status":"write"}}},{"id":"1_1616587681.684061_35.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.3","timestamp":"2021-03-24T12:08:01.684061812Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_peIkv89fti0uogbWsS9ROt4","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587681.685783_36.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:01.685783533Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hhFWOBiiVqTODyEPOQ20cGw","ver":1},"status":{"status":"write"}}},{"id":"1_1616587681.689470_37.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:01.689470564Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hhFWOBiiVqTODyEPOQ20cGw","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587681.704523_38.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.4","timestamp":"2021-03-24T12:08:01.704523924Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-kf_f9i5CAs_wWtJy8zenwv","ver":1},"status":{"status":"write"}}},{"id":"1_1616587681.709290_39.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.4","timestamp":"2021-03-24T12:08:01.709290725Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-kf_f9i5CAs_wWtJy8zenwv","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587681.710934_40.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:01.710934882Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_p2wS0iipS32DkQ9UcbvJVmc","ver":1},"status":{"status":"write"}}},{"id":"1_1616587681.715179_41.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:01.715179052Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_p2wS0iipS32DkQ9UcbvJVmc","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587687.787829_44.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.5","timestamp":"2021-03-24T12:08:07.787829366Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LMB6mmpu42gLYwj4p9_-vQ-","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.793308_45.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.5","timestamp":"2021-03-24T12:08:07.793308292Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LMB6mmpu42gLYwj4p9_-vQ-","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587687.795167_46.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:07.795167007Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CtkiSkhcO0qSKvfNBgDaJ3o","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.798263_47.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:07.798263485Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CtkiSkhcO0qSKvfNBgDaJ3o","ver":1},"status":{"status":"abort"}}},{"id":"1_1616587687.818052_48.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.6","timestamp":"2021-03-24T12:08:07.818052095Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bM7FupHB0IhALIerpCpV66b","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.822554_49.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.6","timestamp":"2021-03-24T12:08:07.822554908Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bM7FupHB0IhALIerpCpV66b","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587687.824152_50.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:07.824152839Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jijbeeGhY8EfR-O5L-h1WeL","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.827161_51.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:07.827161071Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jijbeeGhY8EfR-O5L-h1WeL","ver":1},"status":{"status":"abort"}}},{"id":"1_1616587687.849585_53.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.7","timestamp":"2021-03-24T12:08:07.849585326Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MMVw4ikWkCM1-p1Ag5x-ble","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.854354_54.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.7","timestamp":"2021-03-24T12:08:07.854354765Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MMVw4ikWkCM1-p1Ag5x-ble","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587687.856126_55.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:07.856126385Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9ZQzqdf0u6cs_hTEXkKiIIA","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.859374_56.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:07.859374360Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9ZQzqdf0u6cs_hTEXkKiIIA","ver":1},"status":{"status":"abort"}}},{"id":"1_1616587687.900484_57.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.8","timestamp":"2021-03-24T12:08:07.900484057Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vRDskGBmeVeNpqYJNe29HU-","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.906310_58.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.8","timestamp":"2021-03-24T12:08:07.906310291Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vRDskGBmeVeNpqYJNe29HU-","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587687.908537_59.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:07.908537979Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OR5nzqpk2CNcWS567A8E1lM","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.911786_60.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:07.911786205Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OR5nzqpk2CNcWS567A8E1lM","ver":1},"status":{"status":"abort"}}},{"id":"1_1616587694.025764_64.1","section":"bucket.instance","name":"jlfoya-5:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.9","timestamp":"2021-03-24T12:08:14.025764815Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BKLX5Oo3N0rSYpCKUbmLuR_","ver":1},"status":{"status":"write"}}},{"id":"1_1616587694.031300_65.1","section":"bucket.instance","name":"jlfoya-5:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.9","timestamp":"2021-03-24T12:08:14.031300768Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BKLX5Oo3N0rSYpCKUbmLuR_","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587694.033041_66.1","section":"bucket","name":"jlfoya-5","timestamp":"2021-03-24T12:08:14.033041117Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":1},"status":{"status":"write"}}},{"id":"1_1616587694.037524_67.1","section":"bucket","name":"jlfoya-5","timestamp":"2021-03-24T12:08:14.037524884Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587694.055675_68.1","section":"bucket.instance","name":"jlfoya-6:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.10","timestamp":"2021-03-24T12:08:14.055675506Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xN_p9wc0oXuNZ9fFoDUELIm","ver":1},"status":{"status":"write"}}},{"id":"1_1616587694.061020_69.1","section":"bucket.instance","name":"jlfoya-6:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.10","timestamp":"2021-03-24T12:08:14.061020181Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xN_p9wc0oXuNZ9fFoDUELIm","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587694.062889_70.1","section":"bucket","name":"jlfoya-6","timestamp":"2021-03-24T12:08:14.062889517Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":1},"status":{"status":"write"}}},{"id":"1_1616587694.067610_71.1","section":"bucket","name":"jlfoya-6","timestamp":"2021-03-24T12:08:14.067610628Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587700.166078_72.1","section":"bucket","name":"jlfoya-5","timestamp":"2021-03-24T12:08:20.166078475Z","data":{"read_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":1},"write_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":2},"status":{"status":"remove"}}},{"id":"1_1616587700.171949_73.1","section":"bucket","name":"jlfoya-5","timestamp":"2021-03-24T12:08:20.171949884Z","data":{"read_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":1},"write_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587700.210222_74.1","section":"bucket","name":"jlfoya-6","timestamp":"2021-03-24T12:08:20.210222785Z","data":{"read_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":1},"write_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":2},"status":{"status":"remove"}}},{"id":"1_1616587700.216525_75.1","section":"bucket","name":"jlfoya-6","timestamp":"2021-03-24T12:08:20.216525028Z","data":{"read_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":1},"write_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587706.294959_76.1","section":"bucket.instance","name":"jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11","timestamp":"2021-03-24T12:08:26.294959829Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IrblIlPENwXNmuqr5sqYNhB","ver":1},"status":{"status":"write"}}},{"id":"1_1616587706.299846_77.1","section":"bucket.instance","name":"jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11","timestamp":"2021-03-24T12:08:26.299846411Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IrblIlPENwXNmuqr5sqYNhB","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587706.301296_78.1","section":"bucket","name":"jlfoya-7","timestamp":"2021-03-24T12:08:26.301296632Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OhcrZa7MslrBrCRXERooTan","ver":1},"status":{"status":"write"}}},{"id":"1_1616587706.305050_79.1","section":"bucket","name":"jlfoya-7","timestamp":"2021-03-24T12:08:26.305050032Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OhcrZa7MslrBrCRXERooTan","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587706.319864_80.1","section":"bucket.instance","name":"jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12","timestamp":"2021-03-24T12:08:26.319864901Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FYtpqg46w2xkQJingexvaFZ","ver":1},"status":{"status":"write"}}},{"id":"1_1616587706.324671_81.1","section":"bucket.instance","name":"jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12","timestamp":"2021-03-24T12:08:26.324671935Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FYtpqg46w2xkQJingexvaFZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587706.326648_82.1","section":"bucket","name":"jlfoya-8","timestamp":"2021-03-24T12:08:26.326648917Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c7LAl7nuIs8w-WPWiUI7_iu","ver":1},"status":{"status":"write"}}},{"id":"1_1616587706.331161_83.1","section":"bucket","name":"jlfoya-8","timestamp":"2021-03-24T12:08:26.331161071Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c7LAl7nuIs8w-WPWiUI7_iu","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587716.654751_84.1","section":"bucket.instance","name":"jlfoya-9:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.13","timestamp":"2021-03-24T12:08:36.654751026Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RK57Yueu_qMKqyQG5Qd2rQk","ver":1},"status":{"status":"write"}}},{"id":"1_1616587716.660222_85.1","section":"bucket.instance","name":"jlfoya-9:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.13","timestamp":"2021-03-24T12:08:36.660222482Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RK57Yueu_qMKqyQG5Qd2rQk","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587716.661946_86.1","section":"bucket","name":"jlfoya-9","timestamp":"2021-03-24T12:08:36.661946287Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Av-37SOsD82ILKqYnxO8Dd-","ver":1},"status":{"status":"write"}}},{"id":"1_1616587716.665846_87.1","section":"bucket","name":"jlfoya-9","timestamp":"2021-03-24T12:08:36.665846681Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Av-37SOsD82ILKqYnxO8Dd-","ver":1},"status":{"status":"complete"}}}] 2021-03-24T12:13:33.733 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '5d6d539e-fcb5-4061-8385-16fad563da6c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:33.734 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '5d6d539e-fcb5-4061-8385-16fad563da6c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:33.735 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 5d6d539e-fcb5-4061-8385-16fad563da6c --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:33.805 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:33.806 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:33.991 INFO:teuthology.orchestra.run.smithi161.stdout:[{"id":"1_1616587550.675677_29.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-03-24T12:05:50.675677399Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6KcPBmQaugY6CjNqS6Le3RQ","ver":1},"status":{"status":"write"}}},{"id":"1_1616587550.682762_31.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-03-24T12:05:50.682762862Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6KcPBmQaugY6CjNqS6Le3RQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587716.682848_63.1","section":"bucket.instance","name":"jlfoya-10:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.14","timestamp":"2021-03-24T12:08:36.682848487Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rg1h9ZYIGqQOolFs1RXp4Mh","ver":1},"status":{"status":"write"}}},{"id":"1_1616587716.688127_67.1","section":"bucket.instance","name":"jlfoya-10:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.14","timestamp":"2021-03-24T12:08:36.688127405Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rg1h9ZYIGqQOolFs1RXp4Mh","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587716.689817_68.1","section":"bucket","name":"jlfoya-10","timestamp":"2021-03-24T12:08:36.689817399Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lXCyZiNazORv7teZ5YJN-Pa","ver":1},"status":{"status":"write"}}},{"id":"1_1616587716.694293_69.1","section":"bucket","name":"jlfoya-10","timestamp":"2021-03-24T12:08:36.694293526Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lXCyZiNazORv7teZ5YJN-Pa","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587737.539850_70.1","section":"bucket.instance","name":"jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15","timestamp":"2021-03-24T12:08:57.539850502Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":1},"status":{"status":"write"}}},{"id":"1_1616587737.544669_79.1","section":"bucket.instance","name":"jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15","timestamp":"2021-03-24T12:08:57.544669956Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587737.546171_80.1","section":"bucket","name":"jlfoya-11","timestamp":"2021-03-24T12:08:57.546171696Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__RUabtIDWoeGFbORDGivKd5","ver":1},"status":{"status":"write"}}},{"id":"1_1616587737.550753_81.1","section":"bucket","name":"jlfoya-11","timestamp":"2021-03-24T12:08:57.550753488Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__RUabtIDWoeGFbORDGivKd5","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587737.566397_82.1","section":"bucket.instance","name":"jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16","timestamp":"2021-03-24T12:08:57.566397219Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":1},"status":{"status":"write"}}},{"id":"1_1616587737.571374_83.1","section":"bucket.instance","name":"jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16","timestamp":"2021-03-24T12:08:57.571374170Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587737.573485_84.1","section":"bucket","name":"jlfoya-12","timestamp":"2021-03-24T12:08:57.573485071Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0oNWZZmIFF6cc0a1TJFmkRZ","ver":1},"status":{"status":"write"}}},{"id":"1_1616587737.577901_85.1","section":"bucket","name":"jlfoya-12","timestamp":"2021-03-24T12:08:57.577901486Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0oNWZZmIFF6cc0a1TJFmkRZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587737.598120_86.1","section":"bucket.instance","name":"jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15","timestamp":"2021-03-24T12:08:57.598120265Z","data":{"read_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":1},"write_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":2},"status":{"status":"write"}}},{"id":"1_1616587737.603801_87.1","section":"bucket.instance","name":"jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15","timestamp":"2021-03-24T12:08:57.603801422Z","data":{"read_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":1},"write_version":{"tag":"_AEC0tVjdSG-Gs3KpEmaTl3G","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587737.608228_88.1","section":"bucket.instance","name":"jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16","timestamp":"2021-03-24T12:08:57.608228841Z","data":{"read_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":1},"write_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":2},"status":{"status":"write"}}},{"id":"1_1616587737.614399_89.1","section":"bucket.instance","name":"jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16","timestamp":"2021-03-24T12:08:57.614399116Z","data":{"read_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":1},"write_version":{"tag":"_kHghY0q9iUpBVj17X_KG_K6","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587765.720699_90.1","section":"bucket.instance","name":"jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17","timestamp":"2021-03-24T12:09:25.720699170Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":1},"status":{"status":"write"}}},{"id":"1_1616587765.725616_108.1","section":"bucket.instance","name":"jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17","timestamp":"2021-03-24T12:09:25.725616205Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587765.727212_109.1","section":"bucket","name":"jlfoya-13","timestamp":"2021-03-24T12:09:25.727212117Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1Q07ubVI1eY9ry2c0jK32Ko","ver":1},"status":{"status":"write"}}},{"id":"1_1616587765.731501_110.1","section":"bucket","name":"jlfoya-13","timestamp":"2021-03-24T12:09:25.731501211Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1Q07ubVI1eY9ry2c0jK32Ko","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587765.737387_111.1","section":"bucket.instance","name":"jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17","timestamp":"2021-03-24T12:09:25.737387919Z","data":{"read_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":1},"write_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":2},"status":{"status":"write"}}},{"id":"1_1616587765.742617_112.1","section":"bucket.instance","name":"jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17","timestamp":"2021-03-24T12:09:25.742617283Z","data":{"read_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":1},"write_version":{"tag":"_syYjnz0ppVqmiiLMbazWZ_q","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587793.818656_113.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:09:53.818656261Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":1},"status":{"status":"write"}}},{"id":"1_1616587793.823825_124.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:09:53.823825068Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587793.825600_125.1","section":"bucket","name":"jlfoya-14","timestamp":"2021-03-24T12:09:53.825600115Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QW96sea5aZVepYZO-z7_j9U","ver":1},"status":{"status":"write"}}},{"id":"1_1616587793.830203_126.1","section":"bucket","name":"jlfoya-14","timestamp":"2021-03-24T12:09:53.830203560Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QW96sea5aZVepYZO-z7_j9U","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587806.894096_127.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:10:06.894096972Z","data":{"read_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":1},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":2},"status":{"status":"write"}}},{"id":"1_1616587806.902205_132.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:10:06.902205585Z","data":{"read_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":1},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587820.187906_133.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:10:20.187906106Z","data":{"read_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":2},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":3},"status":{"status":"write"}}},{"id":"1_1616587820.195106_138.1","section":"bucket.instance","name":"jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18","timestamp":"2021-03-24T12:10:20.195106231Z","data":{"read_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":2},"write_version":{"tag":"_r7Vf3YCvazbokM0-mWSaYNU","ver":3},"status":{"status":"complete"}}},{"id":"1_1616587833.352018_139.1","section":"bucket.instance","name":"jlfoya-15:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.19","timestamp":"2021-03-24T12:10:33.352018249Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":1},"status":{"status":"write"}}},{"id":"1_1616587833.356941_144.1","section":"bucket.instance","name":"jlfoya-15:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.19","timestamp":"2021-03-24T12:10:33.356941972Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587833.358874_145.1","section":"bucket","name":"jlfoya-15","timestamp":"2021-03-24T12:10:33.358874924Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GDXZAfEyhVoCakmOLtmbMnk","ver":1},"status":{"status":"write"}}},{"id":"1_1616587833.363317_146.1","section":"bucket","name":"jlfoya-15","timestamp":"2021-03-24T12:10:33.363317801Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GDXZAfEyhVoCakmOLtmbMnk","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587833.379493_147.1","section":"bucket.instance","name":"jlfoya-16:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.20","timestamp":"2021-03-24T12:10:33.379493948Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":1},"status":{"status":"write"}}},{"id":"1_1616587833.385066_148.1","section":"bucket.instance","name":"jlfoya-16:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.20","timestamp":"2021-03-24T12:10:33.385066216Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587833.386845_149.1","section":"bucket","name":"jlfoya-16","timestamp":"2021-03-24T12:10:33.386845499Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DsVjQllVvSJ8MaEPChUnKDq","ver":1},"status":{"status":"write"}}},{"id":"1_1616587833.390929_150.1","section":"bucket","name":"jlfoya-16","timestamp":"2021-03-24T12:10:33.390929239Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DsVjQllVvSJ8MaEPChUnKDq","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587833.413009_151.1","section":"bucket.instance","name":"jlfoya-15:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.19","timestamp":"2021-03-24T12:10:33.413009491Z","data":{"read_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":1},"write_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":2},"status":{"status":"write"}}},{"id":"1_1616587833.419187_152.1","section":"bucket.instance","name":"jlfoya-15:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.19","timestamp":"2021-03-24T12:10:33.419187376Z","data":{"read_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":1},"write_version":{"tag":"_-xnQWfcaCsik_LsTUV-Cbjf","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587833.424089_153.1","section":"bucket.instance","name":"jlfoya-16:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.20","timestamp":"2021-03-24T12:10:33.424089009Z","data":{"read_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":1},"write_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":2},"status":{"status":"write"}}},{"id":"1_1616587833.429962_154.1","section":"bucket.instance","name":"jlfoya-16:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.20","timestamp":"2021-03-24T12:10:33.429962684Z","data":{"read_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":1},"write_version":{"tag":"_L3SDOvLbjcpKSoUz4l69BCV","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587848.294780_155.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.294780794Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":1},"status":{"status":"write"}}},{"id":"1_1616587848.298873_163.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.298873824Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587848.300376_164.1","section":"bucket","name":"jlfoya-17","timestamp":"2021-03-24T12:10:48.300376620Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ETwgVz58fZ8am7wVPac3vxr","ver":1},"status":{"status":"write"}}},{"id":"1_1616587848.304548_165.1","section":"bucket","name":"jlfoya-17","timestamp":"2021-03-24T12:10:48.304548123Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ETwgVz58fZ8am7wVPac3vxr","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587848.320133_166.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.320133479Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":1},"status":{"status":"write"}}},{"id":"1_1616587848.325643_167.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.325643092Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587848.327338_168.1","section":"bucket","name":"jlfoya-18","timestamp":"2021-03-24T12:10:48.327338896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c7udEzNtUlrN14sIVt-5DA-","ver":1},"status":{"status":"write"}}},{"id":"1_1616587848.331668_169.1","section":"bucket","name":"jlfoya-18","timestamp":"2021-03-24T12:10:48.331668494Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c7udEzNtUlrN14sIVt-5DA-","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587848.356541_170.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.356541395Z","data":{"read_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":1},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":2},"status":{"status":"write"}}},{"id":"1_1616587848.362642_171.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.362642178Z","data":{"read_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":1},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587848.366844_172.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.366844502Z","data":{"read_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":2},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":3},"status":{"status":"write"}}},{"id":"1_1616587848.372757_173.1","section":"bucket.instance","name":"jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21","timestamp":"2021-03-24T12:10:48.372757221Z","data":{"read_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":2},"write_version":{"tag":"_gg-2-i9DdnqV7C2kJ8mhoGR","ver":3},"status":{"status":"complete"}}},{"id":"1_1616587848.377512_174.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.377512993Z","data":{"read_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":1},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":2},"status":{"status":"write"}}},{"id":"1_1616587848.383426_175.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.383426651Z","data":{"read_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":1},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587848.392783_176.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.392783990Z","data":{"read_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":2},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":3},"status":{"status":"write"}}},{"id":"1_1616587848.398925_177.1","section":"bucket.instance","name":"jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22","timestamp":"2021-03-24T12:10:48.398925684Z","data":{"read_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":2},"write_version":{"tag":"_2J4BQoedZBjxvkWpYHQZOnz","ver":3},"status":{"status":"complete"}}},{"id":"1_1616587863.043236_189.1","section":"bucket.instance","name":"jlfoya-19:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.23","timestamp":"2021-03-24T12:11:03.043236174Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.048576_195.1","section":"bucket.instance","name":"jlfoya-19:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.23","timestamp":"2021-03-24T12:11:03.048576121Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.050487_196.1","section":"bucket","name":"jlfoya-19","timestamp":"2021-03-24T12:11:03.050487954Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7N_RzKj5_nb8ztfcXUaVOJQ","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.054466_197.1","section":"bucket","name":"jlfoya-19","timestamp":"2021-03-24T12:11:03.054466861Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7N_RzKj5_nb8ztfcXUaVOJQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.070764_198.1","section":"bucket.instance","name":"jlfoya-20:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.24","timestamp":"2021-03-24T12:11:03.070764210Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.075866_199.1","section":"bucket.instance","name":"jlfoya-20:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.24","timestamp":"2021-03-24T12:11:03.075866473Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.077471_200.1","section":"bucket","name":"jlfoya-20","timestamp":"2021-03-24T12:11:03.077471736Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EyzWjbixr6F4jPJFHty8FSb","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.081380_201.1","section":"bucket","name":"jlfoya-20","timestamp":"2021-03-24T12:11:03.081380371Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EyzWjbixr6F4jPJFHty8FSb","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.103898_202.1","section":"bucket.instance","name":"jlfoya-19:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.23","timestamp":"2021-03-24T12:11:03.103898749Z","data":{"read_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":1},"write_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":2},"status":{"status":"write"}}},{"id":"1_1616587863.109729_203.1","section":"bucket.instance","name":"jlfoya-19:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.23","timestamp":"2021-03-24T12:11:03.109729782Z","data":{"read_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":1},"write_version":{"tag":"_6oy3aicIWQCdFOA6icXYmE5","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587863.159738_204.1","section":"bucket.instance","name":"jlfoya-20:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.24","timestamp":"2021-03-24T12:11:03.159738037Z","data":{"read_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":1},"write_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":2},"status":{"status":"write"}}},{"id":"1_1616587863.166854_205.1","section":"bucket.instance","name":"jlfoya-20:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.24","timestamp":"2021-03-24T12:11:03.166854336Z","data":{"read_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":1},"write_version":{"tag":"__0OCtVEUxzBPVMkYoOMAiw-","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587863.229651_206.1","section":"bucket.instance","name":"jlfoya-21:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.25","timestamp":"2021-03-24T12:11:03.229651649Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.234767_207.1","section":"bucket.instance","name":"jlfoya-21:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.25","timestamp":"2021-03-24T12:11:03.234767067Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.236248_208.1","section":"bucket","name":"jlfoya-21","timestamp":"2021-03-24T12:11:03.236248226Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_g91DT4K_wcxCnLLeTyzujUh","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.240050_209.1","section":"bucket","name":"jlfoya-21","timestamp":"2021-03-24T12:11:03.240050098Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_g91DT4K_wcxCnLLeTyzujUh","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.257301_210.1","section":"bucket.instance","name":"jlfoya-22:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.26","timestamp":"2021-03-24T12:11:03.257301022Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.262927_211.1","section":"bucket.instance","name":"jlfoya-22:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.26","timestamp":"2021-03-24T12:11:03.262927978Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.264884_212.1","section":"bucket","name":"jlfoya-22","timestamp":"2021-03-24T12:11:03.264884421Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q_yC4z5we_KuXZkz74NR_YY","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.269983_213.1","section":"bucket","name":"jlfoya-22","timestamp":"2021-03-24T12:11:03.269983689Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q_yC4z5we_KuXZkz74NR_YY","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.294923_214.1","section":"bucket.instance","name":"jlfoya-21:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.25","timestamp":"2021-03-24T12:11:03.294923585Z","data":{"read_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":1},"write_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":2},"status":{"status":"write"}}},{"id":"1_1616587863.301299_215.1","section":"bucket.instance","name":"jlfoya-21:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.25","timestamp":"2021-03-24T12:11:03.301299413Z","data":{"read_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":1},"write_version":{"tag":"_ix20-chhWoixtdbwLOYy537","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587863.353474_216.1","section":"bucket.instance","name":"jlfoya-22:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.26","timestamp":"2021-03-24T12:11:03.353474673Z","data":{"read_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":1},"write_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":2},"status":{"status":"write"}}},{"id":"1_1616587863.361616_217.1","section":"bucket.instance","name":"jlfoya-22:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.26","timestamp":"2021-03-24T12:11:03.361616751Z","data":{"read_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":1},"write_version":{"tag":"_BhiDFfOXmNdn4uL_413eFcK","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587863.425636_218.1","section":"bucket.instance","name":"jlfoya-23:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.27","timestamp":"2021-03-24T12:11:03.425636576Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.430356_219.1","section":"bucket.instance","name":"jlfoya-23:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.27","timestamp":"2021-03-24T12:11:03.430356674Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.431699_220.1","section":"bucket","name":"jlfoya-23","timestamp":"2021-03-24T12:11:03.431699542Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_28j60sygG45tYwzerUPXLrf","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.435420_221.1","section":"bucket","name":"jlfoya-23","timestamp":"2021-03-24T12:11:03.435420963Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_28j60sygG45tYwzerUPXLrf","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.450782_222.1","section":"bucket.instance","name":"jlfoya-24:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.28","timestamp":"2021-03-24T12:11:03.450782785Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.454876_223.1","section":"bucket.instance","name":"jlfoya-24:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.28","timestamp":"2021-03-24T12:11:03.454876286Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.456342_224.1","section":"bucket","name":"jlfoya-24","timestamp":"2021-03-24T12:11:03.456342166Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-uiXURuI6PiGJpMm5n2TVga","ver":1},"status":{"status":"write"}}},{"id":"1_1616587863.460131_225.1","section":"bucket","name":"jlfoya-24","timestamp":"2021-03-24T12:11:03.460131765Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-uiXURuI6PiGJpMm5n2TVga","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587863.483132_226.1","section":"bucket.instance","name":"jlfoya-23:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.27","timestamp":"2021-03-24T12:11:03.483132179Z","data":{"read_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":1},"write_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":2},"status":{"status":"write"}}},{"id":"1_1616587863.488418_227.1","section":"bucket.instance","name":"jlfoya-23:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.27","timestamp":"2021-03-24T12:11:03.488418847Z","data":{"read_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":1},"write_version":{"tag":"_pp6LDs7Zrdda0eRtIZb9I3R","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587864.540369_228.1","section":"bucket.instance","name":"jlfoya-24:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.28","timestamp":"2021-03-24T12:11:04.540369158Z","data":{"read_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":1},"write_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":2},"status":{"status":"write"}}},{"id":"1_1616587864.548208_229.1","section":"bucket.instance","name":"jlfoya-24:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.28","timestamp":"2021-03-24T12:11:04.548208111Z","data":{"read_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":1},"write_version":{"tag":"_ia7B9urAS3UUMpnLC8CosSP","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587864.618831_230.1","section":"bucket.instance","name":"jlfoya-25:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.29","timestamp":"2021-03-24T12:11:04.618831504Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xDnyYxrny8m2pB4PzKcm8NY","ver":1},"status":{"status":"write"}}},{"id":"1_1616587864.623768_231.1","section":"bucket.instance","name":"jlfoya-25:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.29","timestamp":"2021-03-24T12:11:04.623768958Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xDnyYxrny8m2pB4PzKcm8NY","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587864.625235_232.1","section":"bucket","name":"jlfoya-25","timestamp":"2021-03-24T12:11:04.625235957Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2WgmSA4Nois7Lpv53s7Mc5X","ver":1},"status":{"status":"write"}}},{"id":"1_1616587864.629010_233.1","section":"bucket","name":"jlfoya-25","timestamp":"2021-03-24T12:11:04.629010849Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2WgmSA4Nois7Lpv53s7Mc5X","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587864.642842_235.1","section":"bucket.instance","name":"jlfoya-26:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.30","timestamp":"2021-03-24T12:11:04.642842977Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Lic9zQtowFETx4u-zISp5P_","ver":1},"status":{"status":"write"}}},{"id":"1_1616587864.647495_236.1","section":"bucket.instance","name":"jlfoya-26:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.30","timestamp":"2021-03-24T12:11:04.647495526Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Lic9zQtowFETx4u-zISp5P_","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587864.649465_237.1","section":"bucket","name":"jlfoya-26","timestamp":"2021-03-24T12:11:04.649465443Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OXqOHcjQU77z8q_VC_nd4J1","ver":1},"status":{"status":"write"}}},{"id":"1_1616587864.653774_238.1","section":"bucket","name":"jlfoya-26","timestamp":"2021-03-24T12:11:04.653774803Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OXqOHcjQU77z8q_VC_nd4J1","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587870.913455_244.1","section":"bucket.instance","name":"jlfoya-27:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.31","timestamp":"2021-03-24T12:11:10.913455332Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UN4R0QAQBFnB4nXfz-07vy0","ver":1},"status":{"status":"write"}}},{"id":"1_1616587870.917554_245.1","section":"bucket.instance","name":"jlfoya-27:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.31","timestamp":"2021-03-24T12:11:10.917554086Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UN4R0QAQBFnB4nXfz-07vy0","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587870.919042_246.1","section":"bucket","name":"jlfoya-27","timestamp":"2021-03-24T12:11:10.919042415Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2rg73VHjr2S1Dn-vEtO7Yc6","ver":1},"status":{"status":"write"}}},{"id":"1_1616587870.922929_247.1","section":"bucket","name":"jlfoya-27","timestamp":"2021-03-24T12:11:10.922929178Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2rg73VHjr2S1Dn-vEtO7Yc6","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587870.938808_248.1","section":"bucket.instance","name":"jlfoya-28:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.32","timestamp":"2021-03-24T12:11:10.938808024Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oxJewX121dvcHzqxFRBwymy","ver":1},"status":{"status":"write"}}},{"id":"1_1616587870.943800_249.1","section":"bucket.instance","name":"jlfoya-28:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.32","timestamp":"2021-03-24T12:11:10.943800693Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oxJewX121dvcHzqxFRBwymy","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587870.945888_250.1","section":"bucket","name":"jlfoya-28","timestamp":"2021-03-24T12:11:10.945888485Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_53ilzIgzmwdlWb2ejqYF71I","ver":1},"status":{"status":"write"}}},{"id":"1_1616587870.950038_251.1","section":"bucket","name":"jlfoya-28","timestamp":"2021-03-24T12:11:10.950038914Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_53ilzIgzmwdlWb2ejqYF71I","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587671.525015_26.1","section":"bucket.instance","name":"jlfoya-1:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.1","timestamp":"2021-03-24T12:07:51.525015135Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xGBc8XzZBCwN6lfmC5KQRJc","ver":1},"status":{"status":"write"}}},{"id":"1_1616587671.528864_27.1","section":"bucket.instance","name":"jlfoya-1:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.1","timestamp":"2021-03-24T12:07:51.528864420Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xGBc8XzZBCwN6lfmC5KQRJc","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587671.530059_28.1","section":"bucket","name":"jlfoya-1","timestamp":"2021-03-24T12:07:51.530059359Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_G9eSL8lglDY17VZRsC4sUQh","ver":1},"status":{"status":"write"}}},{"id":"1_1616587671.533457_29.1","section":"bucket","name":"jlfoya-1","timestamp":"2021-03-24T12:07:51.533457052Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_G9eSL8lglDY17VZRsC4sUQh","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587671.550187_30.1","section":"bucket.instance","name":"jlfoya-2:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.2","timestamp":"2021-03-24T12:07:51.550187246Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WvnmsaILa9xw32VSbHCUTTH","ver":1},"status":{"status":"write"}}},{"id":"1_1616587671.555163_31.1","section":"bucket.instance","name":"jlfoya-2:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.2","timestamp":"2021-03-24T12:07:51.555163704Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WvnmsaILa9xw32VSbHCUTTH","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587671.556841_32.1","section":"bucket","name":"jlfoya-2","timestamp":"2021-03-24T12:07:51.556841421Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Xr2svrr-8bZXkOmG6VfG-z","ver":1},"status":{"status":"write"}}},{"id":"1_1616587671.561122_33.1","section":"bucket","name":"jlfoya-2","timestamp":"2021-03-24T12:07:51.561122704Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Xr2svrr-8bZXkOmG6VfG-z","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587681.678709_34.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.3","timestamp":"2021-03-24T12:08:01.678709902Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_peIkv89fti0uogbWsS9ROt4","ver":1},"status":{"status":"write"}}},{"id":"1_1616587681.684061_35.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.3","timestamp":"2021-03-24T12:08:01.684061812Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_peIkv89fti0uogbWsS9ROt4","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587681.685783_36.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:01.685783533Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hhFWOBiiVqTODyEPOQ20cGw","ver":1},"status":{"status":"write"}}},{"id":"1_1616587681.689470_37.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:01.689470564Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hhFWOBiiVqTODyEPOQ20cGw","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587681.704523_38.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.4","timestamp":"2021-03-24T12:08:01.704523924Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-kf_f9i5CAs_wWtJy8zenwv","ver":1},"status":{"status":"write"}}},{"id":"1_1616587681.709290_39.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.4","timestamp":"2021-03-24T12:08:01.709290725Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-kf_f9i5CAs_wWtJy8zenwv","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587681.710934_40.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:01.710934882Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_p2wS0iipS32DkQ9UcbvJVmc","ver":1},"status":{"status":"write"}}},{"id":"1_1616587681.715179_41.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:01.715179052Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_p2wS0iipS32DkQ9UcbvJVmc","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587687.787829_44.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.5","timestamp":"2021-03-24T12:08:07.787829366Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LMB6mmpu42gLYwj4p9_-vQ-","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.793308_45.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.5","timestamp":"2021-03-24T12:08:07.793308292Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LMB6mmpu42gLYwj4p9_-vQ-","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587687.795167_46.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:07.795167007Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CtkiSkhcO0qSKvfNBgDaJ3o","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.798263_47.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:07.798263485Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CtkiSkhcO0qSKvfNBgDaJ3o","ver":1},"status":{"status":"abort"}}},{"id":"1_1616587687.818052_48.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.6","timestamp":"2021-03-24T12:08:07.818052095Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bM7FupHB0IhALIerpCpV66b","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.822554_49.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.6","timestamp":"2021-03-24T12:08:07.822554908Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bM7FupHB0IhALIerpCpV66b","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587687.824152_50.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:07.824152839Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jijbeeGhY8EfR-O5L-h1WeL","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.827161_51.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:07.827161071Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jijbeeGhY8EfR-O5L-h1WeL","ver":1},"status":{"status":"abort"}}},{"id":"1_1616587687.849585_53.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.7","timestamp":"2021-03-24T12:08:07.849585326Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MMVw4ikWkCM1-p1Ag5x-ble","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.854354_54.1","section":"bucket.instance","name":"jlfoya-3:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.7","timestamp":"2021-03-24T12:08:07.854354765Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MMVw4ikWkCM1-p1Ag5x-ble","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587687.856126_55.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:07.856126385Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9ZQzqdf0u6cs_hTEXkKiIIA","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.859374_56.1","section":"bucket","name":"jlfoya-3","timestamp":"2021-03-24T12:08:07.859374360Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9ZQzqdf0u6cs_hTEXkKiIIA","ver":1},"status":{"status":"abort"}}},{"id":"1_1616587687.900484_57.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.8","timestamp":"2021-03-24T12:08:07.900484057Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vRDskGBmeVeNpqYJNe29HU-","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.906310_58.1","section":"bucket.instance","name":"jlfoya-4:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.8","timestamp":"2021-03-24T12:08:07.906310291Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vRDskGBmeVeNpqYJNe29HU-","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587687.908537_59.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:07.908537979Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OR5nzqpk2CNcWS567A8E1lM","ver":1},"status":{"status":"write"}}},{"id":"1_1616587687.911786_60.1","section":"bucket","name":"jlfoya-4","timestamp":"2021-03-24T12:08:07.911786205Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OR5nzqpk2CNcWS567A8E1lM","ver":1},"status":{"status":"abort"}}},{"id":"1_1616587694.025764_64.1","section":"bucket.instance","name":"jlfoya-5:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.9","timestamp":"2021-03-24T12:08:14.025764815Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BKLX5Oo3N0rSYpCKUbmLuR_","ver":1},"status":{"status":"write"}}},{"id":"1_1616587694.031300_65.1","section":"bucket.instance","name":"jlfoya-5:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.9","timestamp":"2021-03-24T12:08:14.031300768Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BKLX5Oo3N0rSYpCKUbmLuR_","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587694.033041_66.1","section":"bucket","name":"jlfoya-5","timestamp":"2021-03-24T12:08:14.033041117Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":1},"status":{"status":"write"}}},{"id":"1_1616587694.037524_67.1","section":"bucket","name":"jlfoya-5","timestamp":"2021-03-24T12:08:14.037524884Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587694.055675_68.1","section":"bucket.instance","name":"jlfoya-6:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.10","timestamp":"2021-03-24T12:08:14.055675506Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xN_p9wc0oXuNZ9fFoDUELIm","ver":1},"status":{"status":"write"}}},{"id":"1_1616587694.061020_69.1","section":"bucket.instance","name":"jlfoya-6:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.10","timestamp":"2021-03-24T12:08:14.061020181Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xN_p9wc0oXuNZ9fFoDUELIm","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587694.062889_70.1","section":"bucket","name":"jlfoya-6","timestamp":"2021-03-24T12:08:14.062889517Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":1},"status":{"status":"write"}}},{"id":"1_1616587694.067610_71.1","section":"bucket","name":"jlfoya-6","timestamp":"2021-03-24T12:08:14.067610628Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587700.166078_72.1","section":"bucket","name":"jlfoya-5","timestamp":"2021-03-24T12:08:20.166078475Z","data":{"read_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":1},"write_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":2},"status":{"status":"remove"}}},{"id":"1_1616587700.171949_73.1","section":"bucket","name":"jlfoya-5","timestamp":"2021-03-24T12:08:20.171949884Z","data":{"read_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":1},"write_version":{"tag":"_PokK4IhEdzkzp-46_0JZufr","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587700.210222_74.1","section":"bucket","name":"jlfoya-6","timestamp":"2021-03-24T12:08:20.210222785Z","data":{"read_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":1},"write_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":2},"status":{"status":"remove"}}},{"id":"1_1616587700.216525_75.1","section":"bucket","name":"jlfoya-6","timestamp":"2021-03-24T12:08:20.216525028Z","data":{"read_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":1},"write_version":{"tag":"_5cO-pcmvGqb0cSTJkpQqGna","ver":2},"status":{"status":"complete"}}},{"id":"1_1616587706.294959_76.1","section":"bucket.instance","name":"jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11","timestamp":"2021-03-24T12:08:26.294959829Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IrblIlPENwXNmuqr5sqYNhB","ver":1},"status":{"status":"write"}}},{"id":"1_1616587706.299846_77.1","section":"bucket.instance","name":"jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11","timestamp":"2021-03-24T12:08:26.299846411Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IrblIlPENwXNmuqr5sqYNhB","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587706.301296_78.1","section":"bucket","name":"jlfoya-7","timestamp":"2021-03-24T12:08:26.301296632Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OhcrZa7MslrBrCRXERooTan","ver":1},"status":{"status":"write"}}},{"id":"1_1616587706.305050_79.1","section":"bucket","name":"jlfoya-7","timestamp":"2021-03-24T12:08:26.305050032Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OhcrZa7MslrBrCRXERooTan","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587706.319864_80.1","section":"bucket.instance","name":"jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12","timestamp":"2021-03-24T12:08:26.319864901Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FYtpqg46w2xkQJingexvaFZ","ver":1},"status":{"status":"write"}}},{"id":"1_1616587706.324671_81.1","section":"bucket.instance","name":"jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12","timestamp":"2021-03-24T12:08:26.324671935Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FYtpqg46w2xkQJingexvaFZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587706.326648_82.1","section":"bucket","name":"jlfoya-8","timestamp":"2021-03-24T12:08:26.326648917Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c7LAl7nuIs8w-WPWiUI7_iu","ver":1},"status":{"status":"write"}}},{"id":"1_1616587706.331161_83.1","section":"bucket","name":"jlfoya-8","timestamp":"2021-03-24T12:08:26.331161071Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_c7LAl7nuIs8w-WPWiUI7_iu","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587716.654751_84.1","section":"bucket.instance","name":"jlfoya-9:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.13","timestamp":"2021-03-24T12:08:36.654751026Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RK57Yueu_qMKqyQG5Qd2rQk","ver":1},"status":{"status":"write"}}},{"id":"1_1616587716.660222_85.1","section":"bucket.instance","name":"jlfoya-9:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.13","timestamp":"2021-03-24T12:08:36.660222482Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RK57Yueu_qMKqyQG5Qd2rQk","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587716.661946_86.1","section":"bucket","name":"jlfoya-9","timestamp":"2021-03-24T12:08:36.661946287Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Av-37SOsD82ILKqYnxO8Dd-","ver":1},"status":{"status":"write"}}},{"id":"1_1616587716.665846_87.1","section":"bucket","name":"jlfoya-9","timestamp":"2021-03-24T12:08:36.665846681Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Av-37SOsD82ILKqYnxO8Dd-","ver":1},"status":{"status":"complete"}}}] 2021-03-24T12:13:33.992 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'e06f2557-2a7e-4195-9afd-348b105acc69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:33.993 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'e06f2557-2a7e-4195-9afd-348b105acc69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:33.993 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period e06f2557-2a7e-4195-9afd-348b105acc69 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:34.035 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:34.035 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:34.228 INFO:teuthology.orchestra.run.smithi043.stdout:[{"id":"1_1616587943.511144_579.1","section":"bucket.instance","name":"jlfoya-29:4ed88107-7c59-4fb2-81d2-61fd98250599.5165.1","timestamp":"2021-03-24T12:12:23.511144439Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_JcsJFQvrZ_NdX19vkCnjGSp","ver":1},"status":{"status":"write"}}},{"id":"1_1616587943.515658_580.1","section":"bucket.instance","name":"jlfoya-29:4ed88107-7c59-4fb2-81d2-61fd98250599.5165.1","timestamp":"2021-03-24T12:12:23.515658732Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_JcsJFQvrZ_NdX19vkCnjGSp","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587943.517630_581.1","section":"bucket","name":"jlfoya-29","timestamp":"2021-03-24T12:12:23.517630157Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZDXWDc0NKMzBI_hjAGLb367","ver":1},"status":{"status":"write"}}},{"id":"1_1616587943.522394_582.1","section":"bucket","name":"jlfoya-29","timestamp":"2021-03-24T12:12:23.522394466Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZDXWDc0NKMzBI_hjAGLb367","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587943.554203_583.1","section":"bucket.instance","name":"jlfoya-30:4ed88107-7c59-4fb2-81d2-61fd98250599.5165.2","timestamp":"2021-03-24T12:12:23.554203867Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ghcUTk7HRZV5MALeYOp_MnH","ver":1},"status":{"status":"write"}}},{"id":"1_1616587943.559463_584.1","section":"bucket.instance","name":"jlfoya-30:4ed88107-7c59-4fb2-81d2-61fd98250599.5165.2","timestamp":"2021-03-24T12:12:23.559463684Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ghcUTk7HRZV5MALeYOp_MnH","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587943.561569_585.1","section":"bucket","name":"jlfoya-30","timestamp":"2021-03-24T12:12:23.561569978Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_i8FcJJ4uJ4ngLcTbPqLWR7R","ver":1},"status":{"status":"write"}}},{"id":"1_1616587943.566236_586.1","section":"bucket","name":"jlfoya-30","timestamp":"2021-03-24T12:12:23.566236635Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_i8FcJJ4uJ4ngLcTbPqLWR7R","ver":1},"status":{"status":"complete"}}}] 2021-03-24T12:13:34.229 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'e06f2557-2a7e-4195-9afd-348b105acc69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:34.230 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'e06f2557-2a7e-4195-9afd-348b105acc69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:34.230 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period e06f2557-2a7e-4195-9afd-348b105acc69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:34.270 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:34.271 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:34.446 INFO:teuthology.orchestra.run.smithi161.stdout:[{"id":"1_1616587943.511144_579.1","section":"bucket.instance","name":"jlfoya-29:4ed88107-7c59-4fb2-81d2-61fd98250599.5165.1","timestamp":"2021-03-24T12:12:23.511144439Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_JcsJFQvrZ_NdX19vkCnjGSp","ver":1},"status":{"status":"write"}}},{"id":"1_1616587943.515658_580.1","section":"bucket.instance","name":"jlfoya-29:4ed88107-7c59-4fb2-81d2-61fd98250599.5165.1","timestamp":"2021-03-24T12:12:23.515658732Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_JcsJFQvrZ_NdX19vkCnjGSp","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587943.517630_581.1","section":"bucket","name":"jlfoya-29","timestamp":"2021-03-24T12:12:23.517630157Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZDXWDc0NKMzBI_hjAGLb367","ver":1},"status":{"status":"write"}}},{"id":"1_1616587943.522394_582.1","section":"bucket","name":"jlfoya-29","timestamp":"2021-03-24T12:12:23.522394466Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZDXWDc0NKMzBI_hjAGLb367","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587943.554203_583.1","section":"bucket.instance","name":"jlfoya-30:4ed88107-7c59-4fb2-81d2-61fd98250599.5165.2","timestamp":"2021-03-24T12:12:23.554203867Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ghcUTk7HRZV5MALeYOp_MnH","ver":1},"status":{"status":"write"}}},{"id":"1_1616587943.559463_584.1","section":"bucket.instance","name":"jlfoya-30:4ed88107-7c59-4fb2-81d2-61fd98250599.5165.2","timestamp":"2021-03-24T12:12:23.559463684Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ghcUTk7HRZV5MALeYOp_MnH","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587943.561569_585.1","section":"bucket","name":"jlfoya-30","timestamp":"2021-03-24T12:12:23.561569978Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_i8FcJJ4uJ4ngLcTbPqLWR7R","ver":1},"status":{"status":"write"}}},{"id":"1_1616587943.566236_586.1","section":"bucket","name":"jlfoya-30","timestamp":"2021-03-24T12:12:23.566236635Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_i8FcJJ4uJ4ngLcTbPqLWR7R","ver":1},"status":{"status":"complete"}}}] 2021-03-24T12:13:34.447 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'e06f2557-2a7e-4195-9afd-348b105acc69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:34.447 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'e06f2557-2a7e-4195-9afd-348b105acc69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:34.448 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period e06f2557-2a7e-4195-9afd-348b105acc69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:34.524 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:34.525 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:34.703 INFO:teuthology.orchestra.run.smithi161.stdout:[{"id":"1_1616587943.511144_579.1","section":"bucket.instance","name":"jlfoya-29:4ed88107-7c59-4fb2-81d2-61fd98250599.5165.1","timestamp":"2021-03-24T12:12:23.511144439Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_JcsJFQvrZ_NdX19vkCnjGSp","ver":1},"status":{"status":"write"}}},{"id":"1_1616587943.515658_580.1","section":"bucket.instance","name":"jlfoya-29:4ed88107-7c59-4fb2-81d2-61fd98250599.5165.1","timestamp":"2021-03-24T12:12:23.515658732Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_JcsJFQvrZ_NdX19vkCnjGSp","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587943.517630_581.1","section":"bucket","name":"jlfoya-29","timestamp":"2021-03-24T12:12:23.517630157Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZDXWDc0NKMzBI_hjAGLb367","ver":1},"status":{"status":"write"}}},{"id":"1_1616587943.522394_582.1","section":"bucket","name":"jlfoya-29","timestamp":"2021-03-24T12:12:23.522394466Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZDXWDc0NKMzBI_hjAGLb367","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587943.554203_583.1","section":"bucket.instance","name":"jlfoya-30:4ed88107-7c59-4fb2-81d2-61fd98250599.5165.2","timestamp":"2021-03-24T12:12:23.554203867Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ghcUTk7HRZV5MALeYOp_MnH","ver":1},"status":{"status":"write"}}},{"id":"1_1616587943.559463_584.1","section":"bucket.instance","name":"jlfoya-30:4ed88107-7c59-4fb2-81d2-61fd98250599.5165.2","timestamp":"2021-03-24T12:12:23.559463684Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ghcUTk7HRZV5MALeYOp_MnH","ver":1},"status":{"status":"complete"}}},{"id":"1_1616587943.561569_585.1","section":"bucket","name":"jlfoya-30","timestamp":"2021-03-24T12:12:23.561569978Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_i8FcJJ4uJ4ngLcTbPqLWR7R","ver":1},"status":{"status":"write"}}},{"id":"1_1616587943.566236_586.1","section":"bucket","name":"jlfoya-30","timestamp":"2021-03-24T12:12:23.566236635Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_i8FcJJ4uJ4ngLcTbPqLWR7R","ver":1},"status":{"status":"complete"}}}] 2021-03-24T12:13:34.704 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '876ba0ea-d5b5-41b8-b270-94bbb5b3c639', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:34.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '876ba0ea-d5b5-41b8-b270-94bbb5b3c639', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:34.705 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 876ba0ea-d5b5-41b8-b270-94bbb5b3c639 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:34.744 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:34.744 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:34.936 INFO:teuthology.orchestra.run.smithi043.stdout:[{"id":"1_1616588009.735010_179.1","section":"bucket.instance","name":"jlfoya-31:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.1","timestamp":"2021-03-24T12:13:29.735010969Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4yY4e7C5X-aCuPuYnGMAojZ","ver":1},"status":{"status":"write"}}},{"id":"1_1616588009.740032_180.1","section":"bucket.instance","name":"jlfoya-31:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.1","timestamp":"2021-03-24T12:13:29.740032741Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4yY4e7C5X-aCuPuYnGMAojZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1616588009.741641_181.1","section":"bucket","name":"jlfoya-31","timestamp":"2021-03-24T12:13:29.741641705Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_99oZu-GoG1Rl01z82G7CAHk","ver":1},"status":{"status":"write"}}},{"id":"1_1616588009.745945_182.1","section":"bucket","name":"jlfoya-31","timestamp":"2021-03-24T12:13:29.745945067Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_99oZu-GoG1Rl01z82G7CAHk","ver":1},"status":{"status":"complete"}}},{"id":"1_1616588009.770643_183.1","section":"bucket.instance","name":"jlfoya-32:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.2","timestamp":"2021-03-24T12:13:29.770643542Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5eFGWGY-DF-Pu3mb0qf1cXe","ver":1},"status":{"status":"write"}}},{"id":"1_1616588009.775508_184.1","section":"bucket.instance","name":"jlfoya-32:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.2","timestamp":"2021-03-24T12:13:29.775508400Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5eFGWGY-DF-Pu3mb0qf1cXe","ver":1},"status":{"status":"complete"}}},{"id":"1_1616588009.777217_185.1","section":"bucket","name":"jlfoya-32","timestamp":"2021-03-24T12:13:29.777217701Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I7yvGD_C7e2S5DtSKDQPn9T","ver":1},"status":{"status":"write"}}},{"id":"1_1616588009.781732_186.1","section":"bucket","name":"jlfoya-32","timestamp":"2021-03-24T12:13:29.781732821Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I7yvGD_C7e2S5DtSKDQPn9T","ver":1},"status":{"status":"complete"}}}] 2021-03-24T12:13:34.937 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '876ba0ea-d5b5-41b8-b270-94bbb5b3c639', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:34.938 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '876ba0ea-d5b5-41b8-b270-94bbb5b3c639', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:34.939 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 876ba0ea-d5b5-41b8-b270-94bbb5b3c639 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:34.976 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:34.977 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:35.161 INFO:teuthology.orchestra.run.smithi161.stdout:[{"id":"1_1616588009.735010_179.1","section":"bucket.instance","name":"jlfoya-31:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.1","timestamp":"2021-03-24T12:13:29.735010969Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4yY4e7C5X-aCuPuYnGMAojZ","ver":1},"status":{"status":"write"}}},{"id":"1_1616588009.740032_180.1","section":"bucket.instance","name":"jlfoya-31:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.1","timestamp":"2021-03-24T12:13:29.740032741Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4yY4e7C5X-aCuPuYnGMAojZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1616588009.741641_181.1","section":"bucket","name":"jlfoya-31","timestamp":"2021-03-24T12:13:29.741641705Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_99oZu-GoG1Rl01z82G7CAHk","ver":1},"status":{"status":"write"}}},{"id":"1_1616588009.745945_182.1","section":"bucket","name":"jlfoya-31","timestamp":"2021-03-24T12:13:29.745945067Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_99oZu-GoG1Rl01z82G7CAHk","ver":1},"status":{"status":"complete"}}},{"id":"1_1616588009.770643_183.1","section":"bucket.instance","name":"jlfoya-32:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.2","timestamp":"2021-03-24T12:13:29.770643542Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5eFGWGY-DF-Pu3mb0qf1cXe","ver":1},"status":{"status":"write"}}},{"id":"1_1616588009.775508_184.1","section":"bucket.instance","name":"jlfoya-32:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.2","timestamp":"2021-03-24T12:13:29.775508400Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5eFGWGY-DF-Pu3mb0qf1cXe","ver":1},"status":{"status":"complete"}}},{"id":"1_1616588009.777217_185.1","section":"bucket","name":"jlfoya-32","timestamp":"2021-03-24T12:13:29.777217701Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I7yvGD_C7e2S5DtSKDQPn9T","ver":1},"status":{"status":"write"}}},{"id":"1_1616588009.781732_186.1","section":"bucket","name":"jlfoya-32","timestamp":"2021-03-24T12:13:29.781732821Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I7yvGD_C7e2S5DtSKDQPn9T","ver":1},"status":{"status":"complete"}}}] 2021-03-24T12:13:35.162 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '876ba0ea-d5b5-41b8-b270-94bbb5b3c639', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:35.162 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '876ba0ea-d5b5-41b8-b270-94bbb5b3c639', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:35.163 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 876ba0ea-d5b5-41b8-b270-94bbb5b3c639 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:35.241 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:35.242 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:35.423 INFO:teuthology.orchestra.run.smithi161.stdout:[{"id":"1_1616588009.735010_179.1","section":"bucket.instance","name":"jlfoya-31:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.1","timestamp":"2021-03-24T12:13:29.735010969Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4yY4e7C5X-aCuPuYnGMAojZ","ver":1},"status":{"status":"write"}}},{"id":"1_1616588009.740032_180.1","section":"bucket.instance","name":"jlfoya-31:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.1","timestamp":"2021-03-24T12:13:29.740032741Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4yY4e7C5X-aCuPuYnGMAojZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1616588009.741641_181.1","section":"bucket","name":"jlfoya-31","timestamp":"2021-03-24T12:13:29.741641705Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_99oZu-GoG1Rl01z82G7CAHk","ver":1},"status":{"status":"write"}}},{"id":"1_1616588009.745945_182.1","section":"bucket","name":"jlfoya-31","timestamp":"2021-03-24T12:13:29.745945067Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_99oZu-GoG1Rl01z82G7CAHk","ver":1},"status":{"status":"complete"}}},{"id":"1_1616588009.770643_183.1","section":"bucket.instance","name":"jlfoya-32:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.2","timestamp":"2021-03-24T12:13:29.770643542Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5eFGWGY-DF-Pu3mb0qf1cXe","ver":1},"status":{"status":"write"}}},{"id":"1_1616588009.775508_184.1","section":"bucket.instance","name":"jlfoya-32:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.2","timestamp":"2021-03-24T12:13:29.775508400Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5eFGWGY-DF-Pu3mb0qf1cXe","ver":1},"status":{"status":"complete"}}},{"id":"1_1616588009.777217_185.1","section":"bucket","name":"jlfoya-32","timestamp":"2021-03-24T12:13:29.777217701Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I7yvGD_C7e2S5DtSKDQPn9T","ver":1},"status":{"status":"write"}}},{"id":"1_1616588009.781732_186.1","section":"bucket","name":"jlfoya-32","timestamp":"2021-03-24T12:13:29.781732821Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I7yvGD_C7e2S5DtSKDQPn9T","ver":1},"status":{"status":"complete"}}}] 2021-03-24T12:13:35.424 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:13:35.424 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:13:35.425 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:13:35.464 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:35.464 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:35.677 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:13:35.677 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:13:35.678 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:13:35.715 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:35.716 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:36.035 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:13:36.036 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:13:36.037 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:13:36.110 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:36.111 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:36.405 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '5d6d539e-fcb5-4061-8385-16fad563da6c', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:36.405 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '5d6d539e-fcb5-4061-8385-16fad563da6c', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:36.406 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 5d6d539e-fcb5-4061-8385-16fad563da6c --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:36.446 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:36.447 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:36.631 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2021-03-24T12:13:36.632 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '5d6d539e-fcb5-4061-8385-16fad563da6c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:36.632 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '5d6d539e-fcb5-4061-8385-16fad563da6c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:36.633 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 5d6d539e-fcb5-4061-8385-16fad563da6c --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:36.857 INFO:teuthology.orchestra.run.smithi161.stdout:[] 2021-03-24T12:13:36.858 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '5d6d539e-fcb5-4061-8385-16fad563da6c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:36.859 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '5d6d539e-fcb5-4061-8385-16fad563da6c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:36.860 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 5d6d539e-fcb5-4061-8385-16fad563da6c --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:36.938 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:36.939 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:37.116 INFO:teuthology.orchestra.run.smithi161.stdout:[] 2021-03-24T12:13:37.116 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'e06f2557-2a7e-4195-9afd-348b105acc69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:37.117 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'e06f2557-2a7e-4195-9afd-348b105acc69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:37.117 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period e06f2557-2a7e-4195-9afd-348b105acc69 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:37.157 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:37.158 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:37.345 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2021-03-24T12:13:37.346 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'e06f2557-2a7e-4195-9afd-348b105acc69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:37.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'e06f2557-2a7e-4195-9afd-348b105acc69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:37.347 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period e06f2557-2a7e-4195-9afd-348b105acc69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:37.384 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:37.385 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:37.563 INFO:teuthology.orchestra.run.smithi161.stdout:[] 2021-03-24T12:13:37.564 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'e06f2557-2a7e-4195-9afd-348b105acc69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:37.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'e06f2557-2a7e-4195-9afd-348b105acc69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:37.565 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period e06f2557-2a7e-4195-9afd-348b105acc69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:37.641 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:37.641 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:37.835 INFO:teuthology.orchestra.run.smithi161.stdout:[] 2021-03-24T12:13:37.835 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '876ba0ea-d5b5-41b8-b270-94bbb5b3c639', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:37.836 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '876ba0ea-d5b5-41b8-b270-94bbb5b3c639', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:37.837 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 876ba0ea-d5b5-41b8-b270-94bbb5b3c639 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:37.876 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:37.876 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:38.067 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2021-03-24T12:13:38.067 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '876ba0ea-d5b5-41b8-b270-94bbb5b3c639', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:38.068 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '876ba0ea-d5b5-41b8-b270-94bbb5b3c639', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:38.069 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 876ba0ea-d5b5-41b8-b270-94bbb5b3c639 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:38.107 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:38.107 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:38.302 INFO:teuthology.orchestra.run.smithi161.stdout:[] 2021-03-24T12:13:38.302 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '876ba0ea-d5b5-41b8-b270-94bbb5b3c639', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:38.303 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '876ba0ea-d5b5-41b8-b270-94bbb5b3c639', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:38.303 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 876ba0ea-d5b5-41b8-b270-94bbb5b3c639 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:38.382 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:38.383 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:38.562 INFO:teuthology.orchestra.run.smithi161.stdout:[] 2021-03-24T12:13:38.563 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_period_incremental_sync ... ok 2021-03-24T12:13:38.564 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-33 2021-03-24T12:13:38.591 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-34 2021-03-24T12:13:38.735 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:38.735 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:38.736 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:38.778 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:38.778 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:38.977 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587760.936057_36.2","last_update":"2021-03-24T12:09:20.936057Z"},{"marker":"1_1616588018.650384_198.1","last_update":"2021-03-24T12:13:38.650384Z"},{"marker":"1_1616587782.944095_114.1","last_update":"2021-03-24T12:09:42.944095Z"},{"marker":"1_1616587872.123345_109.1","last_update":"2021-03-24T12:11:12.123345Z"}] 2021-03-24T12:13:38.977 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-03-24T12:13:38.978 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:38.979 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:38.979 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:39.021 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:39.022 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:39.209 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616587870.958292_142.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:10.958292Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616587782.944095_114.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:42.944095Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:13:39.210 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=1 master=1_1616588018.650384_198.1 target=1_1616587870.958292_142.2 2021-03-24T12:13:44.211 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:44.212 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:44.212 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:44.255 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:44.255 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:44.439 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616587782.944095_114.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:42.944095Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:13:44.440 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-03-24T12:13:44.441 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:44.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:44.442 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:44.483 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:44.484 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:44.662 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616587760.936057_36.2","last_update":"2021-03-24T12:09:20.936057Z"},{"marker":"1_1616588019.911631_206.1","last_update":"2021-03-24T12:13:39.911631Z"},{"marker":"1_1616587782.944095_114.1","last_update":"2021-03-24T12:09:42.944095Z"},{"marker":"1_1616587872.123345_109.1","last_update":"2021-03-24T12:11:12.123345Z"}] 2021-03-24T12:13:44.662 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-03-24T12:13:44.663 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:44.664 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:44.664 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:44.706 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:44.707 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:44.960 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11510987327438770569},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616587782.944095_114.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:42.944095Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:13:44.961 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-03-24T12:13:44.961 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:44.962 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:44.962 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:45.043 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:45.043 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:45.216 INFO:teuthology.orchestra.run.smithi161.stdout:[{"marker":"1_1616587761.853631_25.2","last_update":"2021-03-24T12:09:21.853631Z"},{"marker":"1_1616588019.992288_208.1","last_update":"2021-03-24T12:13:39.992288Z"},{"marker":"1_1616587783.860722_131.1","last_update":"2021-03-24T12:09:43.860722Z"},{"marker":"1_1616587872.008806_131.1","last_update":"2021-03-24T12:11:12.008806Z"}] 2021-03-24T12:13:45.216 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-03-24T12:13:45.217 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:45.217 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:45.218 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:45.260 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:45.260 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:45.456 INFO:teuthology.orchestra.run.smithi043.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":15157172713664070086},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587761.853631_25.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:21.853631Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.992288_208.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.992288Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616587783.860722_131.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:43.860722Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.008806_131.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.008806Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:13:45.456 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-03-24T12:13:45.457 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:13:45.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:13:45.458 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:13:45.540 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:45.540 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:45.732 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:45.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:45.733 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:45.809 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:46.000 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2021-03-24T12:13:46.001 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:13:46.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:13:46.002 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:13:46.040 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:46.040 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:46.235 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:46.236 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:13:46.237 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:13:46.310 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:46.310 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:46.509 INFO:teuthology.orchestra.run.smithi161.stdout:[] 2021-03-24T12:13:46.510 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_datalog_autotrim ... ok 2021-03-24T12:13:46.511 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:13:46.512 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:13:46.512 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=false --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:13:46.592 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:46.593 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:46.619 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:13:46.613+0000 7f7d09623080 0 failed reading obj info from .rgw.root:zone_info.37e7d5ac-1249-4c4d-9b86-81fc80607142: (2) No such file or directory 2021-03-24T12:13:46.619 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:13:46.613+0000 7f7d09623080 0 WARNING: could not read zone params for zone id=37e7d5ac-1249-4c4d-9b86-81fc80607142 name=test-zone1 2021-03-24T12:13:46.635 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"SS7NZB400H0K0O9S","secret_key":"74rdtoceN30ZdgFImKNThm7gPyMKZRqM"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1"} 2021-03-24T12:13:46.636 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:13:46.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:13:46.637 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:13:46.713 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:13:46.714 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:13:46.909 INFO:teuthology.orchestra.run.smithi161.stderr:Sending period to new master zone 37e7d5ac-1249-4c4d-9b86-81fc80607142 2021-03-24T12:13:47.994 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","epoch":2,"predecessor_uuid":"e06f2557-2a7e-4195-9afd-348b105acc69","sync_status":["","","1_1616587943.566236_586.1",""],"period_map":{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","zones":[{"id":"37e7d5ac-1249-4c4d-9b86-81fc80607142","name":"test-zone1","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","endpoints":["http://smithi161.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"false","sync_from":[],"redirect_zone":""},{"id":"a506567f-5df7-4073-bb4a-f3e68418b9c9","name":"test-zone3","endpoints":["http://smithi161.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"37e7d5ac-1249-4c4d-9b86-81fc80607142","val":3859867623},{"key":"4ed88107-7c59-4fb2-81d2-61fd98250599","val":3203212006},{"key":"a506567f-5df7-4073-bb4a-f3e68418b9c9","val":3546318610}]},"master_zonegroup":"test-zonegroup","master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","realm_name":"test-realm","realm_epoch":4} 2021-03-24T12:13:47.995 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to false 2021-03-24T12:14:47.996 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-35 2021-03-24T12:14:48.079 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:14:48.080 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:14:48.080 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:14:48.122 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:14:48.122 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:14:48.280 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=876ba0ea-d5b5-41b8-b270-94bbb5b3c639 2021-03-24T12:14:48.313 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616588088.027317_229.1","last_update":"2021-03-24T12:14:48.027317Z"},{"marker":"","last_update":"0.000000"}] 2021-03-24T12:14:48.314 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:14:48.315 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:14:48.315 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:14:48.316 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:14:48.358 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:14:48.359 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:14:48.542 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588018.615568_205.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:38.615568Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:14:48.543 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616588088.027317_229.1 target=1_1616588018.615568_205.1 2021-03-24T12:14:53.544 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:14:53.545 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:14:53.545 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:14:53.584 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:14:53.585 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:14:53.766 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588018.615568_205.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:38.615568Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:14:53.767 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616588088.027317_229.1 target=1_1616588018.615568_205.1 2021-03-24T12:14:58.768 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:14:58.769 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:14:58.770 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:14:58.811 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:14:58.811 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:14:58.991 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588018.615568_205.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:38.615568Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:14:58.992 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616588088.027317_229.1 target=1_1616588018.615568_205.1 2021-03-24T12:15:03.993 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:03.993 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:03.994 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:15:04.035 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:15:04.035 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:15:04.239 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588018.615568_205.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:38.615568Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:15:04.240 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616588088.027317_229.1 target=1_1616588018.615568_205.1 2021-03-24T12:15:09.241 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:09.242 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:09.242 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:15:09.287 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:15:09.287 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:15:09.471 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588018.615568_205.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:38.615568Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:15:09.472 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616588088.027317_229.1 target=1_1616588018.615568_205.1 2021-03-24T12:15:14.473 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:14.474 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:14.475 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:15:14.516 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:15:14.517 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:15:14.700 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588018.615568_205.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:38.615568Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:15:14.701 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616588088.027317_229.1 target=1_1616588018.615568_205.1 2021-03-24T12:15:19.702 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:19.703 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:19.703 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:15:19.746 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:15:19.746 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:15:19.935 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588018.615568_205.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:38.615568Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:15:19.935 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616588088.027317_229.1 target=1_1616588018.615568_205.1 2021-03-24T12:15:24.936 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:24.991 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:24.991 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:15:25.033 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:15:25.034 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:15:25.235 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588018.615568_205.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:38.615568Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:15:25.236 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616588088.027317_229.1 target=1_1616588018.615568_205.1 2021-03-24T12:15:30.238 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:30.239 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:30.239 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:15:30.280 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:15:30.280 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:15:30.476 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588018.615568_205.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:38.615568Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:15:30.476 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616588088.027317_229.1 target=1_1616588018.615568_205.1 2021-03-24T12:15:35.478 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:35.478 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:35.479 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:15:35.521 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:15:35.521 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:15:35.709 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588018.615568_205.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:38.615568Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:15:35.710 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616588088.027317_229.1 target=1_1616588018.615568_205.1 2021-03-24T12:15:40.711 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:40.712 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:40.713 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:15:40.754 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:15:40.755 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:15:40.942 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588018.615568_205.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:38.615568Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:15:40.943 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616588088.027317_229.1 target=1_1616588018.615568_205.1 2021-03-24T12:15:45.944 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:45.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:45.946 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:15:45.985 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:15:45.985 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:15:46.166 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588018.615568_205.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:38.615568Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:15:46.167 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616588088.027317_229.1 target=1_1616588018.615568_205.1 2021-03-24T12:15:49.080 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:15:49.079+0000 7f94887f8700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:15:51.168 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:51.169 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:51.170 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:15:51.209 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:15:51.209 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:15:51.403 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588088.027317_229.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:14:48.027317Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:15:51.404 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:15:51.404 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:15:51.405 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:51.405 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:15:51.406 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:15:51.487 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:15:51.487 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:15:51.741 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588088.027317_229.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:14:48.027317Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:15:51.741 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:15:51.758 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=37e7d5ac-1249-4c4d-9b86-81fc80607142', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:15:51.759 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=37e7d5ac-1249-4c4d-9b86-81fc80607142', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:15:51.760 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone=37e7d5ac-1249-4c4d-9b86-81fc80607142 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:15:51.820 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:15:51.821 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:15:51.847 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:15:51.847+0000 7f15089a3080 0 failed reading obj info from .rgw.root:zone_info.37e7d5ac-1249-4c4d-9b86-81fc80607142: (2) No such file or directory 2021-03-24T12:15:51.848 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:15:51.847+0000 7f15089a3080 0 WARNING: could not read zone params for zone id=37e7d5ac-1249-4c4d-9b86-81fc80607142 name=test-zone1 2021-03-24T12:15:51.863 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"SS7NZB400H0K0O9S","secret_key":"74rdtoceN30ZdgFImKNThm7gPyMKZRqM"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1"} 2021-03-24T12:15:51.864 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:15:51.864 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:15:51.865 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:15:51.952 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:15:51.952 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:15:52.141 INFO:teuthology.orchestra.run.smithi161.stderr:Sending period to new master zone 37e7d5ac-1249-4c4d-9b86-81fc80607142 2021-03-24T12:15:53.229 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","epoch":3,"predecessor_uuid":"e06f2557-2a7e-4195-9afd-348b105acc69","sync_status":["","","1_1616587943.566236_586.1",""],"period_map":{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","zones":[{"id":"37e7d5ac-1249-4c4d-9b86-81fc80607142","name":"test-zone1","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","endpoints":["http://smithi161.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"false","sync_from":[],"redirect_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142"},{"id":"a506567f-5df7-4073-bb4a-f3e68418b9c9","name":"test-zone3","endpoints":["http://smithi161.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"37e7d5ac-1249-4c4d-9b86-81fc80607142","val":3859867623},{"key":"4ed88107-7c59-4fb2-81d2-61fd98250599","val":3203212006},{"key":"a506567f-5df7-4073-bb4a-f3e68418b9c9","val":3546318610}]},"master_zonegroup":"test-zonegroup","master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","realm_name":"test-realm","realm_epoch":4} 2021-03-24T12:15:53.230 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "37e7d5ac-1249-4c4d-9b86-81fc80607142" 2021-03-24T12:16:53.555 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:16:53.572 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:16:53.573 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=true --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:16:53.612 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:16:53.613 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:16:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:16:53.634+0000 7f992ed1d080 0 failed reading obj info from .rgw.root:zone_info.37e7d5ac-1249-4c4d-9b86-81fc80607142: (2) No such file or directory 2021-03-24T12:16:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:16:53.634+0000 7f992ed1d080 0 WARNING: could not read zone params for zone id=37e7d5ac-1249-4c4d-9b86-81fc80607142 name=test-zone1 2021-03-24T12:16:53.650 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"SS7NZB400H0K0O9S","secret_key":"74rdtoceN30ZdgFImKNThm7gPyMKZRqM"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1"} 2021-03-24T12:16:53.650 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:16:53.651 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:16:53.651 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:16:53.729 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:16:53.729 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:16:53.917 INFO:teuthology.orchestra.run.smithi161.stderr:Sending period to new master zone 37e7d5ac-1249-4c4d-9b86-81fc80607142 2021-03-24T12:16:55.000 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","epoch":4,"predecessor_uuid":"e06f2557-2a7e-4195-9afd-348b105acc69","sync_status":["","","1_1616587943.566236_586.1",""],"period_map":{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","zones":[{"id":"37e7d5ac-1249-4c4d-9b86-81fc80607142","name":"test-zone1","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","endpoints":["http://smithi161.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142"},{"id":"a506567f-5df7-4073-bb4a-f3e68418b9c9","name":"test-zone3","endpoints":["http://smithi161.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"37e7d5ac-1249-4c4d-9b86-81fc80607142","val":3859867623},{"key":"4ed88107-7c59-4fb2-81d2-61fd98250599","val":3203212006},{"key":"a506567f-5df7-4073-bb4a-f3e68418b9c9","val":3546318610}]},"master_zonegroup":"test-zonegroup","master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","realm_name":"test-realm","realm_epoch":4} 2021-03-24T12:16:55.001 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to true 2021-03-24T12:17:55.003 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:17:55.018 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:17:55.019 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone= --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:17:55.061 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:17:55.061 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:17:55.086 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:17:55.080+0000 7f10855a8080 0 failed reading obj info from .rgw.root:zone_info.37e7d5ac-1249-4c4d-9b86-81fc80607142: (2) No such file or directory 2021-03-24T12:17:55.087 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:17:55.080+0000 7f10855a8080 0 WARNING: could not read zone params for zone id=37e7d5ac-1249-4c4d-9b86-81fc80607142 name=test-zone1 2021-03-24T12:17:55.100 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"SS7NZB400H0K0O9S","secret_key":"74rdtoceN30ZdgFImKNThm7gPyMKZRqM"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1"} 2021-03-24T12:17:55.100 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:17:55.101 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:17:55.101 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:17:55.182 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:17:55.183 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:17:55.364 INFO:teuthology.orchestra.run.smithi161.stderr:Sending period to new master zone 37e7d5ac-1249-4c4d-9b86-81fc80607142 2021-03-24T12:17:56.446 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","epoch":5,"predecessor_uuid":"e06f2557-2a7e-4195-9afd-348b105acc69","sync_status":["","","1_1616587943.566236_586.1",""],"period_map":{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","zones":[{"id":"37e7d5ac-1249-4c4d-9b86-81fc80607142","name":"test-zone1","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","endpoints":["http://smithi161.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"a506567f-5df7-4073-bb4a-f3e68418b9c9","name":"test-zone3","endpoints":["http://smithi161.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"37e7d5ac-1249-4c4d-9b86-81fc80607142","val":3859867623},{"key":"4ed88107-7c59-4fb2-81d2-61fd98250599","val":3203212006},{"key":"a506567f-5df7-4073-bb4a-f3e68418b9c9","val":3546318610}]},"master_zonegroup":"test-zonegroup","master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","realm_name":"test-realm","realm_epoch":4} 2021-03-24T12:17:56.446 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "" 2021-03-24T12:18:56.449 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_zone_redirect ... ok 2021-03-24T12:18:56.452 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:18:56.453 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:18:56.454 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:18:56.495 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:18:56.495 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:18:56.644 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=876ba0ea-d5b5-41b8-b270-94bbb5b3c639 2021-03-24T12:18:56.673 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616588088.027317_229.1","last_update":"2021-03-24T12:14:48.027317Z"},{"marker":"","last_update":"0.000000"}] 2021-03-24T12:18:56.674 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:18:56.674 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:18:56.675 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:18:56.675 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:18:56.715 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:18:56.716 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:18:56.902 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588088.027317_229.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:14:48.027317Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:18:56.903 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:18:56.904 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:18:56.905 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:18:56.905 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:18:56.906 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:18:56.987 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:18:56.988 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:18:57.242 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588088.027317_229.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:14:48.027317Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:18:57.243 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:18:57.244 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'SS7NZB400H0K0O9S', '--secret', '74rdtoceN30ZdgFImKNThm7gPyMKZRqM', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:18:57.245 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'SS7NZB400H0K0O9S', '--secret', '74rdtoceN30ZdgFImKNThm7gPyMKZRqM', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:18:57.246 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key SS7NZB400H0K0O9S --secret 74rdtoceN30ZdgFImKNThm7gPyMKZRqM --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:18:57.323 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:18:57.323 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:18:57.375 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:18:57.371+0000 7f3c74450080 0 failed reading obj info from .rgw.root:zone_info.37e7d5ac-1249-4c4d-9b86-81fc80607142: (2) No such file or directory 2021-03-24T12:18:57.375 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:18:57.371+0000 7f3c74450080 0 WARNING: could not read zone params for zone id=37e7d5ac-1249-4c4d-9b86-81fc80607142 name=test-zone1 2021-03-24T12:18:57.388 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"f846b1da-6e0f-4b93-bd7c-40e85b1ab3a3","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","roles_pool":"remove.rgw.meta:roles","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","system_key":{"access_key":"SS7NZB400H0K0O9S","secret_key":"74rdtoceN30ZdgFImKNThm7gPyMKZRqM"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0}}],"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1"} 2021-03-24T12:18:57.388 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:18:57.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:18:57.390 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:18:57.470 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:18:57.471 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:04.839 INFO:teuthology.orchestra.run.smithi161.stderr:Sending period to new master zone 37e7d5ac-1249-4c4d-9b86-81fc80607142 2021-03-24T12:19:05.919 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","epoch":6,"predecessor_uuid":"e06f2557-2a7e-4195-9afd-348b105acc69","sync_status":["","","1_1616587943.566236_586.1",""],"period_map":{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","zones":[{"id":"37e7d5ac-1249-4c4d-9b86-81fc80607142","name":"test-zone1","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","endpoints":["http://smithi161.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"a506567f-5df7-4073-bb4a-f3e68418b9c9","name":"test-zone3","endpoints":["http://smithi161.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"f846b1da-6e0f-4b93-bd7c-40e85b1ab3a3","name":"remove","endpoints":[],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"37e7d5ac-1249-4c4d-9b86-81fc80607142","val":3859867623},{"key":"4ed88107-7c59-4fb2-81d2-61fd98250599","val":3203212006},{"key":"a506567f-5df7-4073-bb4a-f3e68418b9c9","val":3546318610},{"key":"f846b1da-6e0f-4b93-bd7c-40e85b1ab3a3","val":3436972402}]},"master_zonegroup":"test-zonegroup","master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","realm_name":"test-realm","realm_epoch":4} 2021-03-24T12:19:05.920 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:05.921 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:05.923 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:19:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:05.989 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:19:05.983+0000 7fe721fcd080 0 failed reading obj info from .rgw.root:zone_info.4ed88107-7c59-4fb2-81d2-61fd98250599: (2) No such file or directory 2021-03-24T12:19:05.989 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:19:05.983+0000 7fe721fcd080 0 WARNING: could not read zone params for zone id=4ed88107-7c59-4fb2-81d2-61fd98250599 name=test-zone2 2021-03-24T12:19:05.990 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:19:05.983+0000 7fe721fcd080 0 failed reading obj info from .rgw.root:zone_info.a506567f-5df7-4073-bb4a-f3e68418b9c9: (2) No such file or directory 2021-03-24T12:19:05.990 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:19:05.983+0000 7fe721fcd080 0 WARNING: could not read zone params for zone id=a506567f-5df7-4073-bb4a-f3e68418b9c9 name=test-zone3 2021-03-24T12:19:05.999 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","zones":[{"id":"37e7d5ac-1249-4c4d-9b86-81fc80607142","name":"test-zone1","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","endpoints":["http://smithi161.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"a506567f-5df7-4073-bb4a-f3e68418b9c9","name":"test-zone3","endpoints":["http://smithi161.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","sync_policy":{"groups":[]}} 2021-03-24T12:19:06.000 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:06.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:06.001 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:19:06.078 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:06.078 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:06.098 INFO:teuthology.orchestra.run.smithi043.stderr:zone name remove not found in zonegroup test-zonegroup 2021-03-24T12:19:06.103 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-03-24T12:19:06.104 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:06.104 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:06.105 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone delete --rgw-zone remove --cluster c2 --debug-rgw 0 --debug-ms 0 2021-03-24T12:19:06.141 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:06.141 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:06.182 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:19:06.179+0000 7fc909d1c080 0 failed reading obj info from .rgw.root:zone_info.37e7d5ac-1249-4c4d-9b86-81fc80607142: (2) No such file or directory 2021-03-24T12:19:06.183 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:19:06.179+0000 7fc909d1c080 0 WARNING: could not read zone params for zone id=37e7d5ac-1249-4c4d-9b86-81fc80607142 name=test-zone1 2021-03-24T12:19:06.187 INFO:teuthology.orchestra.run.smithi161.stderr:2021-03-24T12:19:06.183+0000 7fc909d1c080 0 zone id f846b1da-6e0f-4b93-bd7c-40e85b1ab3a3 is not a part of zonegroup default 2021-03-24T12:19:06.199 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:06.200 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:06.200 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:19:06.243 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:06.244 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:06.282 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:19:06.275+0000 7f7800e75080 0 WARNING: can't generate connection for zone f846b1da-6e0f-4b93-bd7c-40e85b1ab3a3 id remove: no endpoints defined 2021-03-24T12:19:06.405 INFO:tasks.rgw.c2.client.0.smithi161.stdout:2021-03-24T12:19:06.403+0000 7f7d58e89700 -1 failed to decode period 2021-03-24T12:19:06.406 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:19:06.403+0000 7f9305fab700 -1 failed to decode period 2021-03-24T12:19:06.426 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","epoch":7,"predecessor_uuid":"e06f2557-2a7e-4195-9afd-348b105acc69","sync_status":["","","1_1616587943.566236_586.1",""],"period_map":{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","zones":[{"id":"37e7d5ac-1249-4c4d-9b86-81fc80607142","name":"test-zone1","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","endpoints":["http://smithi161.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"a506567f-5df7-4073-bb4a-f3e68418b9c9","name":"test-zone3","endpoints":["http://smithi161.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"37e7d5ac-1249-4c4d-9b86-81fc80607142","val":3859867623},{"key":"4ed88107-7c59-4fb2-81d2-61fd98250599","val":3203212006},{"key":"a506567f-5df7-4073-bb4a-f3e68418b9c9","val":3546318610}]},"master_zonegroup":"test-zonegroup","master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","realm_name":"test-realm","realm_epoch":4} 2021-03-24T12:19:06.427 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_zonegroup_remove ... ok 2021-03-24T12:19:06.427 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:06.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:06.429 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup create --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:19:06.507 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:06.507 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:06.538 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"5341c529-9fde-4ed1-9645-1c1cd60583a6","name":"remove_zg","api_name":"remove_zg","is_master":"false","endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[],"default_placement":"","realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","sync_policy":{"groups":[]}} 2021-03-24T12:19:06.539 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:06.539 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:06.540 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:19:06.625 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:06.626 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:06.682 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"866ad937-be95-4656-b33f-4abe8157c234","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","roles_pool":"remove.rgw.meta:roles","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0}}],"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1"} 2021-03-24T12:19:06.683 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:06.683 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:06.684 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:19:06.766 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:06.767 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:07.004 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","epoch":8,"predecessor_uuid":"e06f2557-2a7e-4195-9afd-348b105acc69","sync_status":["","","1_1616587943.566236_586.1",""],"period_map":{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","zonegroups":[{"id":"5341c529-9fde-4ed1-9645-1c1cd60583a6","name":"remove_zg","api_name":"remove_zg","is_master":"false","endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"866ad937-be95-4656-b33f-4abe8157c234","zones":[{"id":"866ad937-be95-4656-b33f-4abe8157c234","name":"remove","endpoints":[],"log_meta":"false","log_data":"false","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","sync_policy":{"groups":[]}},{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","zones":[{"id":"37e7d5ac-1249-4c4d-9b86-81fc80607142","name":"test-zone1","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","endpoints":["http://smithi161.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"a506567f-5df7-4073-bb4a-f3e68418b9c9","name":"test-zone3","endpoints":["http://smithi161.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"37e7d5ac-1249-4c4d-9b86-81fc80607142","val":3859867623},{"key":"4ed88107-7c59-4fb2-81d2-61fd98250599","val":3203212006},{"key":"866ad937-be95-4656-b33f-4abe8157c234","val":3969775457},{"key":"a506567f-5df7-4073-bb4a-f3e68418b9c9","val":3546318610}]},"master_zonegroup":"test-zonegroup","master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","realm_name":"test-realm","realm_epoch":4} 2021-03-24T12:19:07.005 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:07.006 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:07.006 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone delete --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:19:07.090 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:07.090 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:07.092 INFO:tasks.rgw.c2.client.0.smithi161.stdout:2021-03-24T12:19:07.091+0000 7f7d60698700 -1 failed to decode period 2021-03-24T12:19:07.092 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:19:07.091+0000 7f92fcf99700 -1 failed to decode period 2021-03-24T12:19:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:19:07.131+0000 7ff503c5e080 0 zone id 866ad937-be95-4656-b33f-4abe8157c234 is not a part of zonegroup test-zonegroup 2021-03-24T12:19:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:19:07.131+0000 7ff503c5e080 0 zone id 866ad937-be95-4656-b33f-4abe8157c234 is not a part of zonegroup default 2021-03-24T12:19:07.146 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:07.147 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:07.148 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:19:07.232 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:07.233 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:07.269 INFO:teuthology.orchestra.run.smithi043.stderr:2021-03-24T12:19:07.263+0000 7fcf2b93b080 0 ERROR: zonegroup remove_zg has a non existent master zone 2021-03-24T12:19:07.275 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-03-24T12:19:07.276 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:07.276 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:07.277 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup delete --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:19:07.356 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:07.356 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:07.389 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:07.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:07.390 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:19:07.477 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:07.477 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:07.651 INFO:tasks.rgw.c2.client.0.smithi161.stdout:2021-03-24T12:19:07.647+0000 7f7df77c6700 -1 failed to decode period 2021-03-24T12:19:07.652 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:19:07.647+0000 7f92ebf77700 -1 failed to decode period 2021-03-24T12:19:07.677 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","epoch":9,"predecessor_uuid":"e06f2557-2a7e-4195-9afd-348b105acc69","sync_status":["","","1_1616587943.566236_586.1",""],"period_map":{"id":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","zones":[{"id":"37e7d5ac-1249-4c4d-9b86-81fc80607142","name":"test-zone1","endpoints":["http://smithi043.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4ed88107-7c59-4fb2-81d2-61fd98250599","name":"test-zone2","endpoints":["http://smithi161.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"a506567f-5df7-4073-bb4a-f3e68418b9c9","name":"test-zone3","endpoints":["http://smithi161.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"37e7d5ac-1249-4c4d-9b86-81fc80607142","val":3859867623},{"key":"4ed88107-7c59-4fb2-81d2-61fd98250599","val":3203212006},{"key":"a506567f-5df7-4073-bb4a-f3e68418b9c9","val":3546318610}]},"master_zonegroup":"test-zonegroup","master_zone":"37e7d5ac-1249-4c4d-9b86-81fc80607142","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"55c56cc6-aa15-4053-86ae-c780bb8135d1","realm_name":"test-realm","realm_epoch":4} 2021-03-24T12:19:07.678 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_zg_master_zone_delete ... ok 2021-03-24T12:19:07.679 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-36 2021-03-24T12:19:07.914 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-37 2021-03-24T12:19:07.970 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-38 2021-03-24T12:19:07.993 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-39 2021-03-24T12:19:09.398 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_set_bucket_website ... rgw_multi.tests.test_set_bucket_policy ... ok 2021-03-24T12:19:09.399 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-40 2021-03-24T12:19:09.426 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-41 2021-03-24T12:19:09.478 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'jlfoya-40', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:09.479 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'jlfoya-40', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:09.480 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket jlfoya-40 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:19:09.527 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:09.527 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:09.751 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'jlfoya-41', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:09.752 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'jlfoya-41', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:19:09.752 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket jlfoya-41 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:19:09.794 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:09.795 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:10.042 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:10.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:10.043 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 log list --rgw-zone test-zone1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:19:10.118 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:10.118 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:10.328 INFO:teuthology.orchestra.run.smithi043.stdout:["obj_delete_at_hint.0000000078","meta.history","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21:8","obj_delete_at_hint.0000000026","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.13-jlfoya-9","obj_delete_at_hint.0000000028","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.1-jlfoya-1","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4934.4-jlfoya-39","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16:1","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.14-jlfoya-10","obj_delete_at_hint.0000000040","meta.full-sync.index.0","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17:8","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22:8","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.29-jlfoya-25","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11:7","obj_delete_at_hint.0000000024","data.full-sync.index.4ed88107-7c59-4fb2-81d2-61fd98250599.0","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_log.3","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11:8","datalog.sync-status.shard.4ed88107-7c59-4fb2-81d2-61fd98250599.2.retry","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17-jlfoya-13","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.3-jlfoya-33","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.4-jlfoya-4","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-26:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.30:10","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21-jlfoya-17","obj_delete_at_hint.0000000096","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.2-jlfoya-2","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.24-jlfoya-20","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16:3","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4934.5-jlfoya-40","bilog.trim","obj_delete_at_hint.0000000016","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4934.1-jlfoya-36","obj_delete_at_hint.0000000041","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.25-jlfoya-21","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-35:37e7d5ac-1249-4c4d-9b86-81fc80607142.4838.1:5","datalog.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.23-jlfoya-19","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.27-jlfoya-23","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","datalog.sync-status.shard.4ed88107-7c59-4fb2-81d2-61fd98250599.3.retry","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-34:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.4:8","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4838.1-jlfoya-35","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","data_log.1","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12:3","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","meta.full-sync.index.1","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.2-jlfoya-32","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11-jlfoya-7","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-15:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.19:8","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.26-jlfoya-22","mdlog.sync-status.shard.2","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-16:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.20:8","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15:3","obj_delete_at_hint.0000000116","2021-03-24-12-4ed88107-7c59-4fb2-81d2-61fd98250599.5165.2-jlfoya-30","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","mdlog.sync-status.shard.1","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16:5","datalog.sync-status.shard.4ed88107-7c59-4fb2-81d2-61fd98250599.0.retry","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","meta.full-sync.index.3","obj_delete_at_hint.0000000118","data.full-sync.index.4ed88107-7c59-4fb2-81d2-61fd98250599.2","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18-jlfoya-14","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.10-jlfoya-6","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15:1","mdlog.sync-status.shard.0","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-9:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.13:1","obj_delete_at_hint.0000000039","datalog.sync-status.shard.4ed88107-7c59-4fb2-81d2-61fd98250599.3","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12:7","obj_delete_at_hint.0000000100","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16-jlfoya-12","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4934.3-jlfoya-38","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.28-jlfoya-24","data_log.0","2021-03-24-12-4ed88107-7c59-4fb2-81d2-61fd98250599.5165.1-jlfoya-29","obj_delete_at_hint.0000000012","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.4-jlfoya-34","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.32-jlfoya-28","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11:1","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12:8","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","datalog.sync-status.shard.4ed88107-7c59-4fb2-81d2-61fd98250599.0","datalog.sync-status.shard.4ed88107-7c59-4fb2-81d2-61fd98250599.2","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.20-jlfoya-16","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15-jlfoya-11","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.31-jlfoya-27","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12:1","obj_delete_at_hint.0000000108","datalog.sync-status.shard.4ed88107-7c59-4fb2-81d2-61fd98250599.1","obj_delete_at_hint.0000000094","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.3-jlfoya-3","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.9-jlfoya-5","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15:5","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4934.2-jlfoya-37","obj_delete_at_hint.0000000051","data.full-sync.index.4ed88107-7c59-4fb2-81d2-61fd98250599.3","obj_delete_at_hint.0000000106","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-10:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.14:1","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.19-jlfoya-15","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22-jlfoya-18","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","meta.full-sync.index.2","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12-jlfoya-8","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.1-jlfoya-31","data_log.2","obj_delete_at_hint.0000000067","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11:3","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.30-jlfoya-26","obj_delete_at_hint.0000000086","datalog.sync-status.shard.4ed88107-7c59-4fb2-81d2-61fd98250599.1.retry","data.full-sync.index.4ed88107-7c59-4fb2-81d2-61fd98250599.1","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4934.6-jlfoya-41","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-25:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.29:10","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","meta.log.876ba0ea-d5b5-41b8-b270-94bbb5b3c639.2","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18:8","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17:5","bucket.sync-status.4ed88107-7c59-4fb2-81d2-61fd98250599:jlfoya-33:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.3:8","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2021-03-24T12:19:10.356 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:10.356 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:10.357 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 log list --rgw-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:19:10.389 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:10.390 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:10.595 INFO:teuthology.orchestra.run.smithi161.stdout:["obj_delete_at_hint.0000000078","meta.history","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.13-jlfoya-9","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11:3","obj_delete_at_hint.0000000028","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.1-jlfoya-1","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4934.4-jlfoya-39","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.14-jlfoya-10","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17:8","obj_delete_at_hint.0000000040","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-15:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.19:8","meta.full-sync.index.0","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12:3","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11:8","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12:7","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.29-jlfoya-25","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_log.3","datalog.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-25:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.29:10","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21:8","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17-jlfoya-13","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.3-jlfoya-33","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-9:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.13:1","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.4-jlfoya-4","obj_delete_at_hint.0000000088","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15:5","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21-jlfoya-17","obj_delete_at_hint.0000000096","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.2-jlfoya-2","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","data.full-sync.index.37e7d5ac-1249-4c4d-9b86-81fc80607142.1","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.24-jlfoya-20","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bilog.trim","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","datalog.sync-status.shard.37e7d5ac-1249-4c4d-9b86-81fc80607142.0","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16:1","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-26:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.30:10","obj_delete_at_hint.0000000074","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12:8","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4838.1-jlfoya-35","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","data_log.1","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","meta.full-sync.index.1","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.2-jlfoya-32","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11-jlfoya-7","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.26-jlfoya-22","mdlog.sync-status.shard.2","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","2021-03-24-12-4ed88107-7c59-4fb2-81d2-61fd98250599.5165.2-jlfoya-30","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","mdlog.sync-status.shard.1","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-16:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.20:8","obj_delete_at_hint.0000000066","datalog.sync-status.shard.37e7d5ac-1249-4c4d-9b86-81fc80607142.2","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","datalog.sync-status.shard.37e7d5ac-1249-4c4d-9b86-81fc80607142.0.retry","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","meta.full-sync.index.3","obj_delete_at_hint.0000000118","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12:1","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-35:37e7d5ac-1249-4c4d-9b86-81fc80607142.4838.1:5","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18-jlfoya-14","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.10-jlfoya-6","mdlog.sync-status.shard.0","data.full-sync.index.37e7d5ac-1249-4c4d-9b86-81fc80607142.0","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15:1","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11:7","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16-jlfoya-12","data.full-sync.index.37e7d5ac-1249-4c4d-9b86-81fc80607142.3","obj_delete_at_hint.0000000093","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16:5","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17:5","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.28-jlfoya-24","data.full-sync.index.37e7d5ac-1249-4c4d-9b86-81fc80607142.2","data_log.0","2021-03-24-12-4ed88107-7c59-4fb2-81d2-61fd98250599.5165.1-jlfoya-29","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18:8","obj_delete_at_hint.0000000012","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.4-jlfoya-34","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.32-jlfoya-28","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-10:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.14:1","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.20-jlfoya-16","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15-jlfoya-11","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.31-jlfoya-27","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.3-jlfoya-3","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.9-jlfoya-5","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4934.2-jlfoya-37","datalog.sync-status.shard.37e7d5ac-1249-4c4d-9b86-81fc80607142.3","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15:3","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.19-jlfoya-15","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22-jlfoya-18","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","meta.full-sync.index.2","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12-jlfoya-8","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.1-jlfoya-31","data_log.2","obj_delete_at_hint.0000000067","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.30-jlfoya-26","obj_delete_at_hint.0000000086","datalog.sync-status.shard.37e7d5ac-1249-4c4d-9b86-81fc80607142.1.retry","2021-03-24-12-37e7d5ac-1249-4c4d-9b86-81fc80607142.4934.6-jlfoya-41","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","datalog.sync-status.shard.37e7d5ac-1249-4c4d-9b86-81fc80607142.2.retry","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11:1","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-34:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.4:8","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-33:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.3:8","obj_delete_at_hint.0000000126","meta.log.876ba0ea-d5b5-41b8-b270-94bbb5b3c639.2","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","datalog.sync-status.shard.37e7d5ac-1249-4c4d-9b86-81fc80607142.1","datalog.sync-status.shard.37e7d5ac-1249-4c4d-9b86-81fc80607142.3.retry","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22:8","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16:3","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2021-03-24T12:19:10.621 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['log', 'list', '--rgw-zone', 'test-zone3', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:10.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'log', 'list', '--rgw-zone', 'test-zone3', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:10.623 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 log list --rgw-zone test-zone3 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:19:10.698 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:10.699 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:10.890 INFO:teuthology.orchestra.run.smithi161.stdout:["obj_delete_at_hint.0000000078","meta.history","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11:3","obj_delete_at_hint.0000000028","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17:8","obj_delete_at_hint.0000000040","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-15:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.19:8","meta.full-sync.index.0","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12:3","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11:8","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12:7","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","meta.log.5d6d539e-fcb5-4061-8385-16fad563da6c.2","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","datalog.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-25:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.29:10","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-17:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.21:8","meta.log.e06f2557-2a7e-4195-9afd-348b105acc69.2","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-9:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.13:1","obj_delete_at_hint.0000000088","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15:5","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","meta.log.5d6d539e-fcb5-4061-8385-16fad563da6c.3","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","data.full-sync.index.37e7d5ac-1249-4c4d-9b86-81fc80607142.1","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bilog.trim","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","datalog.sync-status.shard.37e7d5ac-1249-4c4d-9b86-81fc80607142.0","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16:1","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-26:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.30:10","obj_delete_at_hint.0000000074","meta.log.5d6d539e-fcb5-4061-8385-16fad563da6c.0","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12:8","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","meta.full-sync.index.1","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","mdlog.sync-status.shard.2","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","mdlog.sync-status.shard.1","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-16:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.20:8","obj_delete_at_hint.0000000066","datalog.sync-status.shard.37e7d5ac-1249-4c4d-9b86-81fc80607142.2","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","datalog.sync-status.shard.37e7d5ac-1249-4c4d-9b86-81fc80607142.0.retry","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","meta.full-sync.index.3","obj_delete_at_hint.0000000118","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-8:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.12:1","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-35:37e7d5ac-1249-4c4d-9b86-81fc80607142.4838.1:5","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","mdlog.sync-status.shard.0","data.full-sync.index.37e7d5ac-1249-4c4d-9b86-81fc80607142.0","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15:1","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11:7","data.full-sync.index.37e7d5ac-1249-4c4d-9b86-81fc80607142.3","obj_delete_at_hint.0000000093","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16:5","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-13:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.17:5","data.full-sync.index.37e7d5ac-1249-4c4d-9b86-81fc80607142.2","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-14:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.18:8","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-10:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.14:1","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","datalog.sync-status.shard.37e7d5ac-1249-4c4d-9b86-81fc80607142.3","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-11:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.15:3","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","meta.full-sync.index.2","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","datalog.sync-status.shard.37e7d5ac-1249-4c4d-9b86-81fc80607142.1.retry","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","datalog.sync-status.shard.37e7d5ac-1249-4c4d-9b86-81fc80607142.2.retry","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-7:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.11:1","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-34:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.4:8","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-33:37e7d5ac-1249-4c4d-9b86-81fc80607142.4756.3:8","obj_delete_at_hint.0000000126","meta.log.876ba0ea-d5b5-41b8-b270-94bbb5b3c639.2","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","datalog.sync-status.shard.37e7d5ac-1249-4c4d-9b86-81fc80607142.1","datalog.sync-status.shard.37e7d5ac-1249-4c4d-9b86-81fc80607142.3.retry","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-18:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.22:8","bucket.sync-status.37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-12:37e7d5ac-1249-4c4d-9b86-81fc80607142.4274.16:3","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2021-03-24T12:19:10.953 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:10.954 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:10.954 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:19:10.995 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:10.995 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:11.186 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616588350.008286_156.2","last_update":"2021-03-24T12:19:10.008286Z"},{"marker":"1_1616588350.008286_346.3","last_update":"2021-03-24T12:19:10.008286Z"},{"marker":"1_1616588350.008286_243.3","last_update":"2021-03-24T12:19:10.008286Z"},{"marker":"1_1616588350.008286_223.3","last_update":"2021-03-24T12:19:10.008286Z"}] 2021-03-24T12:19:11.186 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-03-24T12:19:11.187 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:11.187 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:11.188 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:19:11.231 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:11.231 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:11.424 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:19:11.425 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:19:16.427 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:16.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:16.429 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:19:16.473 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:16.473 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:16.668 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:19:16.668 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:19:21.670 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:21.671 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:21.671 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:19:21.714 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:21.714 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:21.924 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:19:21.924 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:19:26.926 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:26.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:26.927 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:19:26.970 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:26.970 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:27.168 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:19:27.168 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:19:32.169 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:32.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:32.171 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:19:32.215 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:32.216 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:32.417 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:19:32.418 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:19:37.419 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:37.420 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:37.420 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:19:37.463 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:37.463 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:37.648 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:19:37.648 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:19:42.649 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:42.650 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:42.651 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:19:42.693 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:42.693 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:42.886 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:19:42.887 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:19:47.888 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:47.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:47.890 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:19:47.932 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:48.133 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:19:48.134 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:19:53.135 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:53.136 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:53.137 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:19:53.180 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:53.180 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:53.396 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:19:53.396 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:19:58.398 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:58.399 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:19:58.399 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:19:58.438 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:19:58.438 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:19:58.632 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:19:58.633 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:20:03.634 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:03.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:03.636 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:20:03.677 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:20:03.678 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:20:03.897 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:20:03.898 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:20:08.900 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:08.901 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:08.902 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:20:08.944 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:20:08.945 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:20:09.139 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:20:09.140 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:20:14.142 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:14.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:14.143 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:20:14.187 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:20:14.187 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:20:14.383 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616588350.008286_156.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:19:10.008286Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588350.008286_346.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:19:10.008286Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588350.008286_243.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:19:10.008286Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616588350.008286_223.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:19:10.008286Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:20:14.384 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-03-24T12:20:14.385 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:14.385 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:14.386 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:20:14.424 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:20:14.425 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:20:14.605 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616588350.008286_156.2","last_update":"2021-03-24T12:19:10.008286Z"},{"marker":"1_1616588350.008286_346.3","last_update":"2021-03-24T12:19:10.008286Z"},{"marker":"1_1616588350.008286_243.3","last_update":"2021-03-24T12:19:10.008286Z"},{"marker":"1_1616588350.008286_223.3","last_update":"2021-03-24T12:19:10.008286Z"}] 2021-03-24T12:20:14.605 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-03-24T12:20:14.606 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:14.607 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:14.607 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:20:14.647 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:20:14.647 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:20:14.908 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11510987327438770569},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:20:14.909 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:20:19.910 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:19.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:19.912 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:20:19.955 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:20:19.956 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:20:20.215 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11510987327438770569},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:20:20.215 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:20:25.216 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:25.217 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:25.218 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:20:25.262 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:20:25.263 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:20:25.517 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11510987327438770569},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:20:25.518 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:20:30.520 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:30.521 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:30.522 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:20:30.563 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:20:30.563 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:20:30.810 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11510987327438770569},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:20:30.811 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:20:35.812 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:35.813 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:35.814 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:20:35.855 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:20:35.856 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:20:36.111 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11510987327438770569},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:20:36.112 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:20:41.113 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:41.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:41.115 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:20:41.158 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:20:41.158 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:20:41.416 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11510987327438770569},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:20:41.417 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:20:46.418 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:46.418 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:46.419 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:20:46.462 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:20:46.463 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:20:46.717 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11510987327438770569},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:20:46.718 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:20:51.719 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:51.720 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:51.721 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:20:51.762 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:20:51.763 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:20:52.024 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11510987327438770569},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:20:52.025 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:20:57.026 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:57.027 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:20:57.028 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:20:57.071 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:20:57.072 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:20:57.327 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11510987327438770569},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:20:57.328 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:21:02.330 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:02.330 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:02.331 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:02.374 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:02.374 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:02.634 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11510987327438770569},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:21:02.635 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:21:07.636 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:07.637 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:07.638 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:07.681 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:07.682 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:07.935 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11510987327438770569},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616587760.936057_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:09:20.936057Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588019.911631_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:13:39.911631Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588215.119004_204.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:16:55.119004Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616587872.123345_109.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:11:12.123345Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:21:07.935 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1616588350.008286_156.2 target=1_1616587760.936057_36.2, shard=1 master=1_1616588350.008286_346.3 target=1_1616588019.911631_206.1, shard=2 master=1_1616588350.008286_243.3 target=1_1616588215.119004_204.1, shard=3 master=1_1616588350.008286_223.3 target=1_1616587872.123345_109.1 2021-03-24T12:21:12.936 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:12.937 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:12.938 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:12.979 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:12.979 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:13.236 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11510987327438770569},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616588350.008286_156.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:19:10.008286Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588350.008286_346.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:19:10.008286Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588350.008286_243.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:19:10.008286Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616588350.008286_223.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:19:10.008286Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:21:13.237 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-03-24T12:21:13.238 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:13.239 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:13.240 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:13.319 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:13.319 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:13.503 INFO:teuthology.orchestra.run.smithi161.stdout:[{"marker":"1_1616588415.264162_161.2","last_update":"2021-03-24T12:20:15.264162Z"},{"marker":"1_1616588415.264162_353.3","last_update":"2021-03-24T12:20:15.264162Z"},{"marker":"1_1616588415.264162_279.3","last_update":"2021-03-24T12:20:15.264162Z"},{"marker":"1_1616588415.264162_271.3","last_update":"2021-03-24T12:20:15.264162Z"}] 2021-03-24T12:21:13.503 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-03-24T12:21:13.504 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:13.505 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:13.506 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:13.551 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:13.551 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:13.736 INFO:teuthology.orchestra.run.smithi043.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":15157172713664070086},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616588415.264162_161.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:20:15.264162Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588415.264162_353.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:20:15.264162Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588415.264162_279.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:20:15.264162Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616588415.264162_271.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:20:15.264162Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:21:13.736 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-03-24T12:21:13.741 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_disable ... ok 2021-03-24T12:21:13.744 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-42 2021-03-24T12:21:13.776 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-43 2021-03-24T12:21:14.227 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:14.227 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:14.228 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:14.271 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:14.271 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:14.462 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":"00000000001.35.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.37.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.27.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.29.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:21:14.462 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-42 2021-03-24T12:21:14.463 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:14.464 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:14.465 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:14.510 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:14.511 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:14.702 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:21:14.703 WARNING:rgw_multi.tests:bucket jlfoya-42 zone test-zone2 behind zone test-zone1: shard=0 master=00000000001.35.5 target=, shard=2 master=00000000001.37.5 target=, shard=4 master=00000000001.27.5 target=, shard=7 master=00000000001.29.5 target= 2021-03-24T12:21:19.704 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:19.705 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:19.705 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:19.750 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:19.751 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:19.952 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.35.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.37.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.27.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.29.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:21:19.953 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-42 2021-03-24T12:21:19.953 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:19.954 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:19.954 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:19.997 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:19.997 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:20.184 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":"00000000001.35.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.37.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.27.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.29.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:21:20.184 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-42 2021-03-24T12:21:20.185 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:20.186 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:20.186 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:20.230 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:20.231 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:20.483 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.35.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.37.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.27.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.29.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:21:20.483 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-42 2021-03-24T12:21:20.484 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:20.485 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:20.485 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:20.563 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:20.563 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:20.760 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":"00000000001.37.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.39.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.32.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.34.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:21:20.760 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-42 2021-03-24T12:21:20.761 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:20.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:20.762 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:20.809 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:20.809 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:21.018 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.37.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.39.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.32.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.34.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:21:21.019 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-42 2021-03-24T12:21:21.019 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-42 zones={test-zone2, test-zone1} 2021-03-24T12:21:21.042 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:21:21.048 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-03-24T12:21:21.048 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-03-24T12:21:21.049 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-03-24T12:21:21.049 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-03-24T12:21:21.050 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:21:21.055 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-03-24T12:21:21.055 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-03-24T12:21:21.056 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-03-24T12:21:21.056 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-03-24T12:21:21.065 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:21.118 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:21.228 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:21.335 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:21.394 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:21.497 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:21.596 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:21.650 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:21.757 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:21.864 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:21.919 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:22.029 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:22.132 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-42 zones={test-zone2, test-zone1} 2021-03-24T12:21:22.132 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:22.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:22.133 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:22.174 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:22.175 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:22.370 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":"00000000001.22.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.19.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.31.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.44.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:21:22.371 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-43 2021-03-24T12:21:22.371 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:22.372 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:22.372 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:22.417 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:22.417 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:22.615 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.22.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.19.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.31.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.44.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:21:22.616 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-43 2021-03-24T12:21:22.616 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:22.617 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:22.617 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:22.658 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:22.658 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:22.854 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":"00000000001.22.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.19.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.31.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.44.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:21:22.855 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-43 2021-03-24T12:21:22.855 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:22.856 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:22.856 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:22.901 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:22.902 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:23.157 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.22.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.19.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.31.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.44.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:21:23.158 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-43 2021-03-24T12:21:23.159 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:23.160 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:23.161 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:23.240 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:23.240 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:23.421 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":"00000000001.22.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.22.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.27.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.41.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:21:23.422 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-43 2021-03-24T12:21:23.422 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:23.423 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:23.424 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:23.469 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:23.470 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:23.667 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.22.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.22.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.27.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.41.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:21:23.668 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-43 2021-03-24T12:21:23.669 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-43 zones={test-zone2, test-zone1} 2021-03-24T12:21:23.677 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:21:23.683 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-03-24T12:21:23.945 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-03-24T12:21:23.946 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-03-24T12:21:23.946 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-03-24T12:21:23.946 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:21:23.953 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-03-24T12:21:23.953 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-03-24T12:21:23.954 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-03-24T12:21:23.954 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-03-24T12:21:23.965 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:24.018 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:24.121 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:24.223 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:24.279 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:24.385 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:24.488 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:24.542 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:24.654 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:24.764 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:24.819 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:24.921 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:25.020 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-43 zones={test-zone2, test-zone1} 2021-03-24T12:21:25.021 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'jlfoya-42', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:21:25.021 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'jlfoya-42', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:21:25.022 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket jlfoya-42 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:21:25.062 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:25.063 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:25.306 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'jlfoya-42', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:21:25.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'jlfoya-42', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:21:25.307 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket jlfoya-42 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:21:25.388 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:25.389 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:25.612 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'jlfoya-43', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:21:25.613 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'jlfoya-43', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:21:25.614 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket jlfoya-43 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:21:25.695 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:25.696 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:25.931 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'jlfoya-43', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:21:25.932 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'jlfoya-43', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:21:25.933 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket jlfoya-43 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:21:26.016 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:26.124 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:26.667 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:26.744 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:26.745 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:26.786 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:26.786 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:26.970 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":"00000000006.45.5"},{"key":1,"val":"00000000004.48.1"},{"key":2,"val":"00000000006.51.5"},{"key":3,"val":"00000000004.28.1"},{"key":4,"val":"00000000006.45.5"},{"key":5,"val":"00000000004.41.1"},{"key":6,"val":"00000000004.35.1"},{"key":7,"val":"00000000006.47.5"},{"key":8,"val":"00000000004.36.1"},{"key":9,"val":"00000000004.32.1"},{"key":10,"val":"00000000004.43.1"}]} 2021-03-24T12:21:26.971 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-42 2021-03-24T12:21:26.971 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:26.972 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:26.972 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:27.016 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:27.017 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:27.220 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.35.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.37.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.27.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.29.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:21:27.220 WARNING:rgw_multi.tests:bucket jlfoya-42 zone test-zone2 behind zone test-zone1: shard=0 master=00000000006.45.5 target=00000000001.35.5, shard=1 master=00000000004.48.1 target=, shard=2 master=00000000006.51.5 target=00000000001.37.5, shard=3 master=00000000004.28.1 target=, shard=4 master=00000000006.45.5 target=00000000001.27.5, shard=5 master=00000000004.41.1 target=, shard=6 master=00000000004.35.1 target=, shard=7 master=00000000006.47.5 target=00000000001.29.5, shard=8 master=00000000004.36.1 target=, shard=9 master=00000000004.32.1 target=, shard=10 master=00000000004.43.1 target= 2021-03-24T12:21:32.222 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:32.222 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:32.223 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:32.267 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:32.268 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:32.475 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.45.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.51.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.28.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.45.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.47.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.32.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.43.1"}}}] 2021-03-24T12:21:32.475 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-42 2021-03-24T12:21:32.476 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:32.477 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:32.477 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:32.519 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:32.520 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:32.714 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":"00000000006.45.5"},{"key":1,"val":"00000000004.48.1"},{"key":2,"val":"00000000006.51.5"},{"key":3,"val":"00000000004.28.1"},{"key":4,"val":"00000000006.45.5"},{"key":5,"val":"00000000004.41.1"},{"key":6,"val":"00000000004.35.1"},{"key":7,"val":"00000000006.47.5"},{"key":8,"val":"00000000004.36.1"},{"key":9,"val":"00000000004.32.1"},{"key":10,"val":"00000000004.43.1"}]} 2021-03-24T12:21:32.715 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-42 2021-03-24T12:21:32.715 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:32.716 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:32.717 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:32.760 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:32.760 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:33.019 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.45.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.51.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.28.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.45.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.47.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.32.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.43.1"}}}] 2021-03-24T12:21:33.020 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-42 2021-03-24T12:21:33.020 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:33.021 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:33.022 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:33.101 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:33.102 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:33.285 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":"00000000002.39.5"},{"key":1,"val":""},{"key":2,"val":"00000000002.41.5"},{"key":3,"val":""},{"key":4,"val":"00000000002.38.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000002.40.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:21:33.285 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-42 2021-03-24T12:21:33.286 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:33.286 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:33.287 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:33.333 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:33.334 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:33.536 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.39.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.41.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.38.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.40.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:21:33.536 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-42 2021-03-24T12:21:33.537 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-42 zones={test-zone2, test-zone1} 2021-03-24T12:21:33.544 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:21:33.550 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-03-24T12:21:33.550 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-03-24T12:21:33.551 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-03-24T12:21:33.551 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-03-24T12:21:33.552 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-03-24T12:21:33.552 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-03-24T12:21:33.552 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-03-24T12:21:33.553 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-03-24T12:21:33.553 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:21:33.558 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-03-24T12:21:33.559 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-03-24T12:21:33.559 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-03-24T12:21:33.560 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-03-24T12:21:33.560 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-03-24T12:21:33.561 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-03-24T12:21:33.561 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-03-24T12:21:33.562 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-03-24T12:21:33.571 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:33.622 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:33.729 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:33.836 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:33.891 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:33.992 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:34.097 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:34.154 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:34.265 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:34.368 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:34.423 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:34.572 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:34.672 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-03-24T12:21:34.727 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-03-24T12:21:34.834 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-03-24T12:21:34.936 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-03-24T12:21:34.992 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-03-24T12:21:35.105 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-03-24T12:21:35.213 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-03-24T12:21:35.272 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-03-24T12:21:35.387 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-03-24T12:21:35.492 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-03-24T12:21:35.549 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-03-24T12:21:35.659 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-03-24T12:21:35.760 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-42 zones={test-zone2, test-zone1} 2021-03-24T12:21:35.761 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:35.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:35.763 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:35.801 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:35.802 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:35.989 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":"00000000006.32.5"},{"key":1,"val":"00000000004.48.1"},{"key":2,"val":"00000000006.25.5"},{"key":3,"val":"00000000004.69.1"},{"key":4,"val":"00000000006.49.5"},{"key":5,"val":"00000000004.40.1"},{"key":6,"val":"00000000004.32.1"},{"key":7,"val":"00000000006.54.5"},{"key":8,"val":"00000000004.49.1"},{"key":9,"val":"00000000004.39.1"},{"key":10,"val":"00000000004.30.1"}]} 2021-03-24T12:21:35.989 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-43 2021-03-24T12:21:35.990 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:35.990 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:35.991 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:36.036 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:36.036 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:36.237 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.32.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.25.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.69.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.49.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.32.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.54.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.49.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.39.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.30.1"}}}] 2021-03-24T12:21:36.238 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-43 2021-03-24T12:21:36.238 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:36.239 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:36.239 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:36.283 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:36.283 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:36.474 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":"00000000006.32.5"},{"key":1,"val":"00000000004.48.1"},{"key":2,"val":"00000000006.25.5"},{"key":3,"val":"00000000004.69.1"},{"key":4,"val":"00000000006.49.5"},{"key":5,"val":"00000000004.40.1"},{"key":6,"val":"00000000004.32.1"},{"key":7,"val":"00000000006.54.5"},{"key":8,"val":"00000000004.49.1"},{"key":9,"val":"00000000004.39.1"},{"key":10,"val":"00000000004.30.1"}]} 2021-03-24T12:21:36.475 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-43 2021-03-24T12:21:36.475 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:36.476 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:36.477 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:36.521 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:36.521 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:36.765 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.32.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.25.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.69.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.49.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.32.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.54.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.49.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.39.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.30.1"}}}] 2021-03-24T12:21:36.765 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-43 2021-03-24T12:21:36.766 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:36.767 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:36.767 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:36.847 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:36.847 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:37.039 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":"00000000002.26.5"},{"key":1,"val":""},{"key":2,"val":"00000000002.25.5"},{"key":3,"val":""},{"key":4,"val":"00000000002.36.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000002.45.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:21:37.039 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-43 2021-03-24T12:21:37.040 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:37.040 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:37.041 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:37.087 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:37.088 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:37.301 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.26.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.25.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.36.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.45.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:21:37.301 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-43 2021-03-24T12:21:37.302 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-43 zones={test-zone2, test-zone1} 2021-03-24T12:21:37.310 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:21:37.316 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-03-24T12:21:37.316 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-03-24T12:21:37.316 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-03-24T12:21:37.317 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-03-24T12:21:37.317 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-03-24T12:21:37.318 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-03-24T12:21:37.318 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-03-24T12:21:37.319 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-03-24T12:21:37.319 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:21:37.325 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-03-24T12:21:37.326 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-03-24T12:21:37.326 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-03-24T12:21:37.327 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-03-24T12:21:37.327 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-03-24T12:21:37.328 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-03-24T12:21:37.328 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-03-24T12:21:37.328 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-03-24T12:21:37.339 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:37.391 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:37.497 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:37.600 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:37.654 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:37.761 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:37.860 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:37.915 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:38.025 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:38.128 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:38.182 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:38.289 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:38.392 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-03-24T12:21:38.450 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-03-24T12:21:38.560 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-03-24T12:21:38.664 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-03-24T12:21:38.723 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-03-24T12:21:38.833 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-03-24T12:21:38.936 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-03-24T12:21:38.990 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-03-24T12:21:39.095 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-03-24T12:21:39.196 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-03-24T12:21:39.267 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-03-24T12:21:39.390 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-03-24T12:21:39.496 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-43 zones={test-zone2, test-zone1} 2021-03-24T12:21:39.497 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:39.497 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:39.498 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:39.729 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616588486.228516_170.2","last_update":"2021-03-24T12:21:26.228516Z"},{"marker":"1_1616588486.228516_476.3","last_update":"2021-03-24T12:21:26.228516Z"},{"marker":"1_1616588486.228516_277.3","last_update":"2021-03-24T12:21:26.228516Z"},{"marker":"1_1616588486.228516_257.3","last_update":"2021-03-24T12:21:26.228516Z"}] 2021-03-24T12:21:39.730 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-03-24T12:21:39.730 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:39.731 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:39.731 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:39.774 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:39.774 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:39.968 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616588486.228516_170.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:21:26.228516Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588486.228516_476.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:21:26.228516Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588486.228516_277.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:21:26.228516Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616588486.228516_257.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:21:26.228516Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:21:39.969 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-03-24T12:21:39.969 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:39.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:39.971 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:40.010 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:40.011 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:40.194 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616588486.228516_170.2","last_update":"2021-03-24T12:21:26.228516Z"},{"marker":"1_1616588486.228516_476.3","last_update":"2021-03-24T12:21:26.228516Z"},{"marker":"1_1616588486.228516_277.3","last_update":"2021-03-24T12:21:26.228516Z"},{"marker":"1_1616588486.228516_257.3","last_update":"2021-03-24T12:21:26.228516Z"}] 2021-03-24T12:21:40.195 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-03-24T12:21:40.195 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:40.196 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:40.196 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:40.239 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:40.239 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:40.493 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11510987327438770569},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616588486.228516_170.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:21:26.228516Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588486.228516_476.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:21:26.228516Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588486.228516_277.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:21:26.228516Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616588486.228516_257.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:21:26.228516Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:21:40.494 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-03-24T12:21:40.495 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:40.495 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:40.496 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:40.573 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:40.573 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:40.747 INFO:teuthology.orchestra.run.smithi161.stdout:[{"marker":"1_1616588476.071957_163.1","last_update":"2021-03-24T12:21:16.071957Z"},{"marker":"1_1616588475.120430_369.1","last_update":"2021-03-24T12:21:15.120430Z"},{"marker":"1_1616588415.264162_279.3","last_update":"2021-03-24T12:20:15.264162Z"},{"marker":"1_1616588475.115869_275.1","last_update":"2021-03-24T12:21:15.115869Z"}] 2021-03-24T12:21:40.748 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-03-24T12:21:40.749 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:40.749 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:40.750 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:40.793 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:40.794 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:40.996 INFO:teuthology.orchestra.run.smithi043.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":15157172713664070086},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616588476.071957_163.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:21:16.071957Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588475.120430_369.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:21:15.120430Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588415.264162_279.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:20:15.264162Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616588475.115869_275.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:21:15.115869Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:21:40.997 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-03-24T12:21:40.997 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_enable_right_after_disable ... ok 2021-03-24T12:21:40.998 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-44 2021-03-24T12:21:41.024 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-45 2021-03-24T12:21:41.461 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:41.462 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:41.462 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:41.509 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:41.509 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:41.658 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=876ba0ea-d5b5-41b8-b270-94bbb5b3c639 2021-03-24T12:21:41.688 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616588501.046698_405.1","last_update":"2021-03-24T12:21:41.046698Z"},{"marker":"","last_update":"0.000000"}] 2021-03-24T12:21:41.689 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:21:41.690 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:41.690 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:41.691 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:41.734 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:41.734 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:41.922 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588486.219277_388.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:21:26.219277Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:21:41.924 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616588501.046698_405.1 target=1_1616588486.219277_388.1 2021-03-24T12:21:42.180 INFO:tasks.rgw.c2.client.0.smithi161.stdout:2021-03-24T12:21:42.176+0000 7f7f0dffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:21:42.181 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:21:42.176+0000 7f94807e8700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:21:42.181 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:21:42.176+0000 7f9489ffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:21:42.182 INFO:tasks.rgw.c2.client.0.smithi161.stdout:2021-03-24T12:21:42.176+0000 7f7f2d7fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:21:42.187 INFO:tasks.rgw.c2.client.0.smithi161.stdout:2021-03-24T12:21:42.180+0000 7f7f067ec700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:21:42.188 INFO:tasks.rgw.c2.client.0.smithi161.stdout:2021-03-24T12:21:42.180+0000 7f7f14ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:21:42.190 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:21:42.184+0000 7f9480fe9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:21:42.190 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:21:42.184+0000 7f9491ffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:21:42.190 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:21:42.184+0000 7f9490ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:21:42.191 INFO:tasks.rgw.c2.client.0.smithi161.stdout:2021-03-24T12:21:42.180+0000 7f7f167fc700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:21:46.925 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:46.925 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:46.926 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:47.154 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588501.046698_405.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:21:41.046698Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:21:47.155 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:21:47.155 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:21:47.156 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:47.156 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:47.157 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:47.236 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:47.237 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:47.491 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588501.046698_405.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:21:41.046698Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:21:47.492 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:21:47.493 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:47.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:47.494 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:47.536 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:47.536 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:47.731 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":"00000000001.56.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.39.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.35.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.41.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:21:47.731 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-44 2021-03-24T12:21:47.732 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:47.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:47.733 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:47.983 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.56.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.39.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.35.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.41.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:21:47.983 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-44 2021-03-24T12:21:47.984 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:47.984 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:47.985 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:48.028 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:48.028 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:48.217 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":"00000000001.56.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.39.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.35.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.41.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:21:48.218 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-44 2021-03-24T12:21:48.219 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:48.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:48.220 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:48.264 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:48.265 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:48.515 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.56.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.39.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.35.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.41.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:21:48.515 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-44 2021-03-24T12:21:48.516 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:48.516 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:48.517 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:48.598 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:48.598 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:48.785 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":"00000000001.50.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.53.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.41.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.55.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:21:48.786 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-44 2021-03-24T12:21:48.787 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:48.787 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:48.788 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:48.832 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:48.832 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:49.043 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.50.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.53.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.41.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.55.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:21:49.044 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-44 2021-03-24T12:21:49.044 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-44 zones={test-zone2, test-zone1} 2021-03-24T12:21:49.053 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:21:49.058 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-03-24T12:21:49.059 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-03-24T12:21:49.059 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-03-24T12:21:49.059 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-03-24T12:21:49.060 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:21:49.065 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-03-24T12:21:49.066 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-03-24T12:21:49.066 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-03-24T12:21:49.067 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-03-24T12:21:49.076 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:49.130 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:49.233 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:49.337 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:49.390 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:49.501 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:49.604 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:49.662 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:49.769 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:49.875 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:49.930 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:50.034 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:50.132 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-44 zones={test-zone2, test-zone1} 2021-03-24T12:21:50.133 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:50.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:50.134 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:50.175 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:50.176 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:50.376 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":"00000000001.44.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.30.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.44.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.35.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:21:50.376 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-45 2021-03-24T12:21:50.377 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:50.377 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:50.378 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:50.421 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:50.421 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:50.619 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.44.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.30.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.44.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.35.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:21:50.619 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-45 2021-03-24T12:21:50.620 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:50.620 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:50.621 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:50.664 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:50.664 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:50.861 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":"00000000001.44.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.30.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.44.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.35.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:21:50.862 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-45 2021-03-24T12:21:50.862 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:50.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:50.864 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:50.907 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:50.908 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:51.159 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.44.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.30.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.44.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.35.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:21:51.160 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-45 2021-03-24T12:21:51.160 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:51.161 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:51.162 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:51.243 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:51.244 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:51.435 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":"00000000001.44.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.35.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.56.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.33.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:21:51.436 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-45 2021-03-24T12:21:51.436 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:51.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:51.437 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:51.483 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:51.483 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:51.685 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.44.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.35.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.56.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.33.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:21:51.685 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-45 2021-03-24T12:21:51.686 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-45 zones={test-zone2, test-zone1} 2021-03-24T12:21:51.693 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:21:51.924 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-03-24T12:21:51.925 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-03-24T12:21:51.926 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-03-24T12:21:51.926 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-03-24T12:21:51.926 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:21:51.932 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-03-24T12:21:51.932 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-03-24T12:21:51.933 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-03-24T12:21:51.933 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-03-24T12:21:51.943 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:51.998 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:52.105 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:21:52.204 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:52.259 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:52.365 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:21:52.468 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:52.524 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:52.634 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:21:52.732 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:52.786 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:52.894 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:21:52.992 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-45 zones={test-zone2, test-zone1} 2021-03-24T12:21:52.992 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'jlfoya-44', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:21:52.993 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'jlfoya-44', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:21:52.994 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket jlfoya-44 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:21:53.033 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:53.033 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:53.282 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'jlfoya-45', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:21:53.283 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'jlfoya-45', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:21:53.283 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket jlfoya-45 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:21:53.364 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:53.364 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:53.605 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:53.638 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:53.639 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:53.684 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:53.684 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:53.855 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=876ba0ea-d5b5-41b8-b270-94bbb5b3c639 2021-03-24T12:21:53.887 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616588513.559679_418.1","last_update":"2021-03-24T12:21:53.559679Z"},{"marker":"","last_update":"0.000000"}] 2021-03-24T12:21:53.888 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:21:53.888 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:53.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:53.890 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:53.929 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:53.929 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:54.121 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588501.046698_405.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:21:41.046698Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:21:54.122 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616588513.559679_418.1 target=1_1616588501.046698_405.1 2021-03-24T12:21:59.123 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:59.124 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:59.125 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:59.165 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:59.166 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:59.354 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588513.559679_418.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:21:53.559679Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:21:59.354 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:21:59.355 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:21:59.356 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:59.356 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:21:59.357 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:21:59.432 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:21:59.432 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:21:59.690 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588513.559679_418.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:21:53.559679Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:21:59.691 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:22:00.082 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'jlfoya-44', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:22:00.083 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'jlfoya-44', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:22:00.084 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket jlfoya-44 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:22:00.124 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:22:00.124 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:22:00.374 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'jlfoya-45', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:22:00.374 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'jlfoya-45', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:22:00.375 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket jlfoya-45 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:22:00.458 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:22:00.458 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:22:00.699 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:00.700 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:00.701 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:22:00.787 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:22:00.788 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:22:00.956 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":"00000000006.64.1"},{"key":1,"val":"00000000004.44.1"},{"key":2,"val":"00000000006.52.1"},{"key":3,"val":"00000000004.56.1"},{"key":4,"val":"00000000006.41.1"},{"key":5,"val":"00000000004.29.1"},{"key":6,"val":"00000000004.78.1"},{"key":7,"val":"00000000006.53.1"},{"key":8,"val":"00000000004.79.1"},{"key":9,"val":"00000000004.45.1"},{"key":10,"val":"00000000004.35.1"}]} 2021-03-24T12:22:00.956 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-44 2021-03-24T12:22:00.957 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:00.957 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:00.958 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:22:01.000 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:22:01.001 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:22:01.173 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.64.1"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.52.1"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.41.1"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:22:01.174 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone2 behind zone test-zone1: shard=1 master=00000000004.44.1 target=, shard=3 master=00000000004.56.1 target=, shard=5 master=00000000004.29.1 target=, shard=7 master=00000000006.53.1 target=, shard=9 master=00000000004.45.1 target= 2021-03-24T12:22:06.175 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:06.176 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:06.177 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:22:06.223 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:22:06.223 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:22:06.408 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.64.1"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.52.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.41.1"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.53.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:22:06.408 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone2 behind zone test-zone1: shard=1 master=00000000004.44.1 target=, shard=5 master=00000000004.29.1 target=, shard=9 master=00000000004.45.1 target= 2021-03-24T12:22:11.410 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:11.411 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:11.412 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:22:11.456 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:22:11.807 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:22:11.808 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.64.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.52.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.41.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.53.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:22:11.809 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-44 2021-03-24T12:22:11.810 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:11.810 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:11.811 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:22:11.855 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:22:11.855 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:22:12.060 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":"00000000006.64.1"},{"key":1,"val":"00000000004.44.1"},{"key":2,"val":"00000000006.52.1"},{"key":3,"val":"00000000004.56.1"},{"key":4,"val":"00000000006.41.1"},{"key":5,"val":"00000000004.29.1"},{"key":6,"val":"00000000004.78.1"},{"key":7,"val":"00000000006.53.1"},{"key":8,"val":"00000000004.79.1"},{"key":9,"val":"00000000004.45.1"},{"key":10,"val":"00000000004.35.1"}]} 2021-03-24T12:22:12.060 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-44 2021-03-24T12:22:12.061 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:12.061 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:12.062 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:22:12.108 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:22:12.108 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:22:12.365 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:22:12.366 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:22:17.366 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:17.367 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:17.368 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:22:17.411 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:22:17.412 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:22:17.665 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:22:17.665 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:22:22.669 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:22.669 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:22.670 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:22:22.713 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:22:22.714 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:22:22.967 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:22:22.967 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:22:27.969 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:27.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:27.970 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:22:28.014 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:22:28.014 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:22:28.267 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:22:28.268 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:22:33.270 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:33.270 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:33.271 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:22:33.315 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:22:33.316 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:22:33.571 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:22:33.572 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:22:38.573 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:38.576 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:38.576 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:22:38.620 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:22:38.621 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:22:38.873 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:22:38.873 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:22:43.874 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:43.875 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:43.876 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:22:43.920 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:22:43.920 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:22:44.178 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:22:44.179 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:22:49.180 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:49.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:49.182 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:22:49.226 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:22:49.227 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:22:49.481 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:22:49.525 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:22:54.526 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:54.527 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:54.528 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:22:54.577 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:22:54.577 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:22:54.927 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:22:54.928 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:22:59.930 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:59.931 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:22:59.932 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:22:59.978 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:22:59.978 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:23:00.235 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:23:00.236 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:23:05.237 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:05.238 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:05.238 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:23:05.284 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:23:05.285 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:23:05.538 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:23:05.538 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:23:10.540 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:10.541 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:10.541 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:23:10.585 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:23:10.586 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:23:10.835 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:23:10.836 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:23:15.837 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:15.838 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:15.839 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:23:15.884 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:23:15.885 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:23:16.140 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:23:16.141 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:23:21.142 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:21.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:21.144 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:23:21.190 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:23:21.191 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:23:21.449 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:23:21.449 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:23:26.451 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:26.452 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:26.453 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:23:26.495 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:23:26.496 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:23:26.752 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:23:26.752 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:23:31.753 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:31.754 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:31.755 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:23:31.800 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:23:31.801 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:23:32.057 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:23:32.058 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:23:37.059 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:37.059 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:37.060 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:23:37.103 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:23:37.104 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:23:37.364 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:23:37.365 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:23:42.366 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:42.367 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:42.367 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:23:42.409 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:23:42.409 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:23:42.661 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:23:42.661 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:23:47.663 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:47.664 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:47.664 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:23:47.708 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:23:47.708 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:23:47.964 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:23:47.965 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:23:52.966 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:52.967 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:52.968 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:23:53.011 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:23:53.012 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:23:53.266 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:23:53.266 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:23:58.268 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:58.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:23:58.272 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:23:58.316 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:23:58.317 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:23:58.573 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:23:58.574 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:24:03.575 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:03.576 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:03.576 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:03.617 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:03.618 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:03.873 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:24:03.874 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:24:08.875 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:08.876 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:08.876 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:08.921 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:08.922 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:09.178 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:24:09.179 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:24:14.180 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:14.189 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:14.189 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:14.234 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:14.234 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:14.488 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:24:14.489 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:24:19.490 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:19.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:19.492 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:19.543 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:19.543 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:19.785 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:24:19.786 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:24:24.788 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:24.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:24.789 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:24.831 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:24.832 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:25.088 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:24:25.089 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:24:30.090 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:30.091 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:30.091 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:30.135 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:30.135 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:30.393 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:24:30.394 WARNING:rgw_multi.tests:bucket jlfoya-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.64.1 target=00000000002.57.1, shard=2 master=00000000006.52.1 target=00000000002.42.1, shard=4 master=00000000006.41.1 target=00000000002.36.1, shard=7 master=00000000006.53.1 target=00000000002.43.1 2021-03-24T12:24:35.396 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:35.396 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:35.397 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:35.442 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:35.442 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:35.697 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.64.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.52.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.41.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.53.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.35.1"}}}] 2021-03-24T12:24:35.698 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-44 2021-03-24T12:24:35.698 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:35.699 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:35.699 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:35.778 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:35.778 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:35.987 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":"00000000004.58.1"},{"key":1,"val":"00000000002.47.1"},{"key":2,"val":"00000000004.64.1"},{"key":3,"val":"00000000002.55.1"},{"key":4,"val":"00000000004.46.1"},{"key":5,"val":"00000000002.31.1"},{"key":6,"val":"00000000002.91.1"},{"key":7,"val":"00000000004.65.1"},{"key":8,"val":"00000000002.94.1"},{"key":9,"val":"00000000002.50.1"},{"key":10,"val":"00000000002.43.1"}]} 2021-03-24T12:24:35.988 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-44 2021-03-24T12:24:35.989 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:35.989 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:35.990 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:36.036 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:36.037 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:36.263 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.58.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.47.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.64.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.55.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.46.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.91.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.65.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.94.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.50.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}}] 2021-03-24T12:24:36.263 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-44 2021-03-24T12:24:36.264 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-44 zones={test-zone2, test-zone1} 2021-03-24T12:24:36.291 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:24:36.297 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-03-24T12:24:36.298 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-03-24T12:24:36.299 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-03-24T12:24:36.299 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-03-24T12:24:36.299 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-03-24T12:24:36.300 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-03-24T12:24:36.300 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-03-24T12:24:36.301 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-03-24T12:24:36.301 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:24:36.308 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-03-24T12:24:36.308 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-03-24T12:24:36.309 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-03-24T12:24:36.309 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-03-24T12:24:36.310 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-03-24T12:24:36.310 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-03-24T12:24:36.311 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-03-24T12:24:36.311 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-03-24T12:24:36.322 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:24:36.374 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:24:36.477 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:24:36.575 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:24:36.626 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:24:36.729 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:24:36.832 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:24:36.886 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:24:36.989 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:24:37.092 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:24:37.146 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:24:37.254 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:24:37.356 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-03-24T12:24:37.415 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-03-24T12:24:37.525 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-03-24T12:24:37.624 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-03-24T12:24:37.678 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-03-24T12:24:37.785 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-03-24T12:24:37.884 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-03-24T12:24:37.938 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-03-24T12:24:38.050 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-03-24T12:24:38.152 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-03-24T12:24:38.210 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-03-24T12:24:38.318 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-03-24T12:24:38.420 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-44 zones={test-zone2, test-zone1} 2021-03-24T12:24:38.421 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:38.421 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:38.422 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:38.463 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:38.464 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:38.667 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":"00000000006.50.5"},{"key":1,"val":"00000000004.59.1"},{"key":2,"val":"00000000006.36.5"},{"key":3,"val":"00000000004.29.1"},{"key":4,"val":"00000000006.50.5"},{"key":5,"val":"00000000004.66.1"},{"key":6,"val":"00000000004.53.1"},{"key":7,"val":"00000000006.41.5"},{"key":8,"val":"00000000004.49.1"},{"key":9,"val":"00000000004.30.1"},{"key":10,"val":"00000000004.18.1"}]} 2021-03-24T12:24:38.667 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-45 2021-03-24T12:24:38.668 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:38.668 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:38.669 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:38.715 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:38.715 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:38.926 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000006.50.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.59.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000006.36.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000006.50.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.66.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.53.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000006.41.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.49.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.30.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.18.1"}}}] 2021-03-24T12:24:38.927 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-45 2021-03-24T12:24:38.928 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:38.928 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:38.929 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:38.970 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:38.970 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:39.181 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":"00000000006.50.5"},{"key":1,"val":"00000000004.59.1"},{"key":2,"val":"00000000006.36.5"},{"key":3,"val":"00000000004.29.1"},{"key":4,"val":"00000000006.50.5"},{"key":5,"val":"00000000004.66.1"},{"key":6,"val":"00000000004.53.1"},{"key":7,"val":"00000000006.41.5"},{"key":8,"val":"00000000004.49.1"},{"key":9,"val":"00000000004.30.1"},{"key":10,"val":"00000000004.18.1"}]} 2021-03-24T12:24:39.182 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-45 2021-03-24T12:24:39.182 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:39.183 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:39.183 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:39.230 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:39.230 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:39.489 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.50.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.59.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.36.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.50.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.66.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.53.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.41.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.49.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.30.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.18.1"}}}] 2021-03-24T12:24:39.490 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-45 2021-03-24T12:24:39.490 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:39.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:39.491 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:39.572 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:39.572 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:39.763 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":"00000000004.50.1"},{"key":1,"val":"00000000002.53.1"},{"key":2,"val":"00000000004.41.1"},{"key":3,"val":"00000000002.31.1"},{"key":4,"val":"00000000004.62.1"},{"key":5,"val":"00000000002.57.1"},{"key":6,"val":"00000000002.48.1"},{"key":7,"val":"00000000004.39.1"},{"key":8,"val":"00000000002.55.1"},{"key":9,"val":"00000000002.31.1"},{"key":10,"val":"00000000002.14.1"}]} 2021-03-24T12:24:39.764 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-45 2021-03-24T12:24:39.764 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:39.765 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:39.766 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:39.811 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:39.812 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:40.035 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.50.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.53.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.62.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.57.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.48.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.39.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.55.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.14.1"}}}] 2021-03-24T12:24:40.036 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-45 2021-03-24T12:24:40.037 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-45 zones={test-zone2, test-zone1} 2021-03-24T12:24:40.045 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:24:40.051 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-03-24T12:24:40.052 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-03-24T12:24:40.052 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-03-24T12:24:40.053 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-03-24T12:24:40.053 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-03-24T12:24:40.054 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-03-24T12:24:40.054 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-03-24T12:24:40.055 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-03-24T12:24:40.056 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:24:40.062 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-03-24T12:24:40.062 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-03-24T12:24:40.063 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-03-24T12:24:40.063 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-03-24T12:24:40.064 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-03-24T12:24:40.064 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-03-24T12:24:40.065 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-03-24T12:24:40.065 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-03-24T12:24:40.076 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:24:40.131 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:24:40.236 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-03-24T12:24:40.344 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:24:40.403 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:24:40.513 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-03-24T12:24:40.615 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:24:40.671 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:24:40.773 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-03-24T12:24:40.872 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:24:40.926 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:24:41.029 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-03-24T12:24:41.132 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-03-24T12:24:41.187 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-03-24T12:24:41.497 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-03-24T12:24:41.600 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-03-24T12:24:41.654 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-03-24T12:24:41.766 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-03-24T12:24:41.864 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-03-24T12:24:41.923 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-03-24T12:24:42.041 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-03-24T12:24:42.144 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-03-24T12:24:42.203 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-03-24T12:24:42.317 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-03-24T12:24:42.424 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-45 zones={test-zone2, test-zone1} 2021-03-24T12:24:42.424 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:42.425 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:42.426 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:42.462 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:42.462 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:42.661 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616588545.808516_187.1","last_update":"2021-03-24T12:22:25.808516Z"},{"marker":"1_1616588545.808516_705.2","last_update":"2021-03-24T12:22:25.808516Z"},{"marker":"1_1616588520.666789_322.3","last_update":"2021-03-24T12:22:00.666789Z"},{"marker":"1_1616588545.808516_317.1","last_update":"2021-03-24T12:22:25.808516Z"}] 2021-03-24T12:24:42.661 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-03-24T12:24:42.662 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:42.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:42.663 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:42.705 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:42.706 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:42.895 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9928552850960996384},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616588545.808516_187.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:22:25.808516Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588545.808516_705.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:22:25.808516Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588520.666789_322.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:22:00.666789Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616588545.808516_317.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:22:25.808516Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:24:42.896 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-03-24T12:24:42.897 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:42.898 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:42.899 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:42.952 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:42.953 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:43.151 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"1_1616588545.808516_187.1","last_update":"2021-03-24T12:22:25.808516Z"},{"marker":"1_1616588545.808516_705.2","last_update":"2021-03-24T12:22:25.808516Z"},{"marker":"1_1616588520.666789_322.3","last_update":"2021-03-24T12:22:00.666789Z"},{"marker":"1_1616588545.808516_317.1","last_update":"2021-03-24T12:22:25.808516Z"}] 2021-03-24T12:24:43.152 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-03-24T12:24:43.152 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:43.153 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:43.153 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:43.198 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:43.198 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:43.456 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":11510987327438770569},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616588545.808516_187.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:22:25.808516Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588545.808516_705.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:22:25.808516Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588520.666789_322.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:22:00.666789Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616588545.808516_317.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:22:25.808516Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:24:43.456 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-03-24T12:24:43.457 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:43.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:43.458 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:43.541 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:43.541 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:43.726 INFO:teuthology.orchestra.run.smithi161.stdout:[{"marker":"1_1616588525.284686_169.4","last_update":"2021-03-24T12:22:05.284686Z"},{"marker":"1_1616588525.284686_645.6","last_update":"2021-03-24T12:22:05.284686Z"},{"marker":"1_1616588525.284686_310.6","last_update":"2021-03-24T12:22:05.284686Z"},{"marker":"1_1616588525.284686_310.6","last_update":"2021-03-24T12:22:05.284686Z"}] 2021-03-24T12:24:43.727 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-03-24T12:24:43.728 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:43.728 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:43.729 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:43.771 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:43.771 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:43.972 INFO:teuthology.orchestra.run.smithi043.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":15157172713664070086},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1616588525.284686_169.4","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:22:05.284686Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1616588525.284686_645.6","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:22:05.284686Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1616588525.284686_310.6","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:22:05.284686Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1616588525.284686_310.6","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:22:05.284686Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-03-24T12:24:43.973 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-03-24T12:24:43.974 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_disable_enable ... ok 2021-03-24T12:24:43.975 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-46 2021-03-24T12:24:44.004 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=jlfoya-47 2021-03-24T12:24:45.755 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:45.758 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:45.759 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-46 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:45.801 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:45.801 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:46.013 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000011.50.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:24:46.014 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-46 2021-03-24T12:24:46.014 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:46.015 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:46.015 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-46 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:46.059 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:46.059 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:46.282 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:24:46.283 WARNING:rgw_multi.tests:bucket jlfoya-46 zone test-zone2 behind zone test-zone1: shard=5 master=00000000011.50.5 target= 2021-03-24T12:24:51.284 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:51.285 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:51.287 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-46 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:51.332 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:51.333 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:51.547 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"MULTIPART","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000011.50.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:24:51.547 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-46 2021-03-24T12:24:51.548 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:51.549 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:51.549 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-46 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:51.590 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:51.591 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:51.795 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000011.50.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:24:51.796 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-46 2021-03-24T12:24:51.797 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:51.797 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:51.798 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-46 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:52.097 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000011.50.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:24:52.098 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-46 2021-03-24T12:24:52.099 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:52.099 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:52.101 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-46 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:52.143 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:52.143 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:52.332 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.48.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:24:52.333 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-46 2021-03-24T12:24:52.333 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:52.334 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:52.335 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-46 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:52.381 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:52.381 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:52.590 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"MULTIPART","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.48.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:24:52.591 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-46 2021-03-24T12:24:52.592 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-46 zones={test-zone2, test-zone1} 2021-03-24T12:24:52.609 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:24:52.655 DEBUG:tasks.rgw_multi.zone_rados:o=MULTIPART 2021-03-24T12:24:52.655 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:24:52.660 DEBUG:tasks.rgw_multi.zone_rados:o=MULTIPART 2021-03-24T12:24:52.715 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2021-03-24T12:24:53.051 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2021-03-24T12:24:53.396 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2021-03-24T12:24:53.698 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-46 zones={test-zone2, test-zone1} 2021-03-24T12:24:53.699 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multipart_object_sync ... ok 2021-03-24T12:24:53.702 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-48 2021-03-24T12:24:53.819 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:53.819 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:53.820 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:53.859 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:53.859 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:54.027 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=876ba0ea-d5b5-41b8-b270-94bbb5b3c639 2021-03-24T12:24:54.059 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616588693.724680_459.1","last_update":"2021-03-24T12:24:53.724680Z"},{"marker":"","last_update":"0.000000"}] 2021-03-24T12:24:54.059 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:24:54.060 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:54.060 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:54.061 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:54.108 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:54.108 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:54.315 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588684.030526_452.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:24:44.030526Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:24:54.316 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616588693.724680_459.1 target=1_1616588684.030526_452.1 2021-03-24T12:24:59.317 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:59.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:59.319 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:59.359 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:59.359 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:59.556 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588693.724680_459.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:24:53.724680Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:24:59.557 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:24:59.558 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:24:59.558 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:59.559 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:59.559 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:59.638 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:59.638 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:24:59.893 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588693.724680_459.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:24:53.724680Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:24:59.894 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:24:59.894 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-48', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:59.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-48', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:24:59.896 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-48 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:24:59.937 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:24:59.938 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:00.121 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.44.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.32.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-03-24T12:25:00.122 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-48 2021-03-24T12:25:00.122 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-48', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:00.123 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-48', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:00.124 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-48 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:00.166 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:00.166 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:00.371 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"testobj-sse-c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.44.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"testobj-sse-kms","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.32.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-03-24T12:25:00.372 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-48 2021-03-24T12:25:00.470 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_encrypted_object_sync ... ok 2021-03-24T12:25:00.472 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-49 2021-03-24T12:25:00.695 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:00.695 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:00.696 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:00.736 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:00.737 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:00.911 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=876ba0ea-d5b5-41b8-b270-94bbb5b3c639 2021-03-24T12:25:00.942 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616588700.495209_465.1","last_update":"2021-03-24T12:25:00.495209Z"},{"marker":"","last_update":"0.000000"}] 2021-03-24T12:25:00.943 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:25:00.944 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:00.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:00.946 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:00.989 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:00.989 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:01.191 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588693.724680_459.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:24:53.724680Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:25:01.191 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616588700.495209_465.1 target=1_1616588693.724680_459.1 2021-03-24T12:25:01.524 INFO:tasks.rgw.c2.client.0.smithi161.stdout:2021-03-24T12:25:01.520+0000 7f7f08ff1700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:25:01.524 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:25:01.520+0000 7f94817ea700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:25:01.525 INFO:tasks.rgw.c2.client.0.smithi161.stdout:2021-03-24T12:25:01.520+0000 7f7f04fe9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:25:01.525 INFO:tasks.rgw.c2.client.0.smithi161.stdout:2021-03-24T12:25:01.520+0000 7f7f0cff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:25:01.526 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:25:01.520+0000 7f9486ff5700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:25:01.526 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:25:01.520+0000 7f94837ee700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:25:06.193 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:06.197 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:06.198 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:06.239 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:06.239 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:06.431 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588700.495209_465.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:25:00.495209Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:25:06.432 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:25:06.432 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:25:06.433 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:06.433 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:06.434 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:06.516 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:06.517 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:06.774 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588700.495209_465.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:25:00.495209Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:25:06.775 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:25:06.775 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:06.776 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:06.776 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:06.820 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:06.820 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:07.019 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.26.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.63.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.31.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.49.5"}]} 2021-03-24T12:25:07.019 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-49 2021-03-24T12:25:07.020 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:07.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:07.021 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-49 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:07.063 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:07.064 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:07.273 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"a","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.26.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.63.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.31.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"b","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.49.5"}}}] 2021-03-24T12:25:07.274 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-49 2021-03-24T12:25:07.274 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:07.275 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:07.276 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:07.319 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:07.319 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:07.515 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.26.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.63.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.31.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.49.5"}]} 2021-03-24T12:25:07.515 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-49 2021-03-24T12:25:07.516 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:07.516 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:07.517 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-49 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:07.563 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:07.563 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:07.810 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.26.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.63.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.31.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.49.5"}}}] 2021-03-24T12:25:07.811 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-49 2021-03-24T12:25:07.811 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:07.812 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:07.812 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-49 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:07.852 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:07.852 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:08.060 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.28.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.70.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.33.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.59.5"}]} 2021-03-24T12:25:08.061 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-49 2021-03-24T12:25:08.061 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:08.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:08.062 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:08.105 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:08.106 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:08.328 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"a","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.28.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.70.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.33.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"b","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.59.5"}}}] 2021-03-24T12:25:08.329 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-49 2021-03-24T12:25:08.329 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-49 zones={test-zone2, test-zone1} 2021-03-24T12:25:08.352 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:25:08.399 DEBUG:tasks.rgw_multi.zone_rados:o=a 2021-03-24T12:25:08.399 DEBUG:tasks.rgw_multi.zone_rados:o=b 2021-03-24T12:25:08.400 DEBUG:tasks.rgw_multi.zone_rados:o=c 2021-03-24T12:25:08.400 DEBUG:tasks.rgw_multi.zone_rados:o=d 2021-03-24T12:25:08.401 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:25:08.406 DEBUG:tasks.rgw_multi.zone_rados:o=a 2021-03-24T12:25:08.407 DEBUG:tasks.rgw_multi.zone_rados:o=b 2021-03-24T12:25:08.407 DEBUG:tasks.rgw_multi.zone_rados:o=c 2021-03-24T12:25:08.408 DEBUG:tasks.rgw_multi.zone_rados:o=d 2021-03-24T12:25:08.417 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-03-24T12:25:08.470 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-03-24T12:25:08.576 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-03-24T12:25:08.679 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-03-24T12:25:08.734 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-03-24T12:25:08.848 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-03-24T12:25:08.991 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-03-24T12:25:09.044 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-03-24T12:25:09.157 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-03-24T12:25:09.260 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-03-24T12:25:09.315 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-03-24T12:25:09.460 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-03-24T12:25:09.559 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-49 zones={test-zone2, test-zone1} 2021-03-24T12:25:09.560 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:25:09.560 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:25:09.561 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 0 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:25:09.596 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:09.597 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:09.806 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=jlfoya-50 2021-03-24T12:25:10.023 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:10.023 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:10.024 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:10.064 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:10.065 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:10.240 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=876ba0ea-d5b5-41b8-b270-94bbb5b3c639 2021-03-24T12:25:10.269 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616588709.826300_474.1","last_update":"2021-03-24T12:25:09.826300Z"},{"marker":"","last_update":"0.000000"}] 2021-03-24T12:25:10.270 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:25:10.270 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:10.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:10.272 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:10.313 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:10.313 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:10.414 INFO:tasks.rgw.c2.client.0.smithi161.stdout:2021-03-24T12:25:10.408+0000 7f7f167fc700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:25:10.414 INFO:tasks.rgw.c2.client.0.smithi161.stdout:2021-03-24T12:25:10.408+0000 7f7f0c7f8700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:25:10.490 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588700.495209_465.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:25:00.495209Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:25:10.491 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1616588709.826300_474.1 target=1_1616588700.495209_465.1 2021-03-24T12:25:10.744 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:25:10.740+0000 7f9493fff700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:25:10.749 INFO:tasks.rgw.c2.client.1.smithi161.stdout:2021-03-24T12:25:10.744+0000 7f9486ff5700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-03-24T12:25:15.493 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:15.498 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:15.499 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:15.545 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:15.545 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:15.722 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588709.826300_474.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:25:09.826300Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:25:15.723 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:25:15.724 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:25:15.724 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:15.725 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:15.725 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:15.803 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:15.804 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:16.064 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588709.826300_474.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:25:09.826300Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:25:16.064 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-03-24T12:25:16.065 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:16.065 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:16.066 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-50 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:16.107 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:16.107 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:16.309 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.42.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.36.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.35.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.35.5"}]} 2021-03-24T12:25:16.310 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-50 2021-03-24T12:25:16.310 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:16.311 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:16.311 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-50 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:16.355 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:16.355 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:16.564 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"a","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.42.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.36.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.35.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"b","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.35.5"}}}] 2021-03-24T12:25:16.564 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=jlfoya-50 2021-03-24T12:25:16.565 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:16.565 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:16.566 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-50 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:16.606 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:16.607 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:16.806 INFO:teuthology.orchestra.run.smithi043.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.42.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.36.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.35.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.35.5"}]} 2021-03-24T12:25:16.807 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-50 2021-03-24T12:25:16.808 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:16.808 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'jlfoya-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:16.809 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket jlfoya-50 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:16.852 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:16.852 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:17.107 INFO:teuthology.orchestra.run.smithi161.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.42.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.36.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.35.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.35.5"}}}] 2021-03-24T12:25:17.108 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=jlfoya-50 2021-03-24T12:25:17.108 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:17.109 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'jlfoya-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:17.110 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket jlfoya-50 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:17.188 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:17.189 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:17.382 INFO:teuthology.orchestra.run.smithi161.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.53.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.50.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.40.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.35.5"}]} 2021-03-24T12:25:17.382 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-50 2021-03-24T12:25:17.383 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:17.384 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'jlfoya-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:17.385 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket jlfoya-50 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:17.431 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:17.431 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:17.629 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"a","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.53.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.50.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.40.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"b","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.35.5"}}}] 2021-03-24T12:25:17.629 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=jlfoya-50 2021-03-24T12:25:17.630 INFO:tasks.rgw_multi.zone_rados:comparing bucket=jlfoya-50 zones={test-zone2, test-zone1} 2021-03-24T12:25:17.648 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-03-24T12:25:17.695 DEBUG:tasks.rgw_multi.zone_rados:o=a 2021-03-24T12:25:17.695 DEBUG:tasks.rgw_multi.zone_rados:o=b 2021-03-24T12:25:17.696 DEBUG:tasks.rgw_multi.zone_rados:o=c 2021-03-24T12:25:17.696 DEBUG:tasks.rgw_multi.zone_rados:o=d 2021-03-24T12:25:17.697 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-03-24T12:25:17.702 DEBUG:tasks.rgw_multi.zone_rados:o=a 2021-03-24T12:25:17.703 DEBUG:tasks.rgw_multi.zone_rados:o=b 2021-03-24T12:25:17.703 DEBUG:tasks.rgw_multi.zone_rados:o=c 2021-03-24T12:25:17.703 DEBUG:tasks.rgw_multi.zone_rados:o=d 2021-03-24T12:25:17.759 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-03-24T12:25:17.817 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-03-24T12:25:17.926 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-03-24T12:25:18.028 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-03-24T12:25:18.084 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-03-24T12:25:18.194 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-03-24T12:25:18.297 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-03-24T12:25:18.351 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-03-24T12:25:18.462 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-03-24T12:25:18.563 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-03-24T12:25:18.620 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-03-24T12:25:18.725 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-03-24T12:25:18.824 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=jlfoya-50 zones={test-zone2, test-zone1} 2021-03-24T12:25:18.824 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '1', '--rgw-sync-log-trim-min-cold-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:25:18.825 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '1', '--rgw-sync-log-trim-min-cold-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:25:18.826 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 1 --rgw-sync-log-trim-min-cold-buckets 0 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:25:18.863 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:18.863 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:19.086 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'jlfoya-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:19.087 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'jlfoya-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:19.088 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket jlfoya-50 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:19.165 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:19.165 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:19.364 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2021-03-24T12:25:19.365 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'jlfoya-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:19.365 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'jlfoya-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:19.366 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket jlfoya-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:19.443 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:19.444 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:19.629 INFO:teuthology.orchestra.run.smithi043.stdout:[{"op_id":"1#00000000001.26.5","op_tag":"37e7d5ac-1249-4c4d-9b86-81fc80607142.4932.1938","op":"write","object":"a","instance":"","state":"complete","index_ver":1,"timestamp":"2021-03-24T12:25:00.503609321Z","ver":{"pool":9,"epoch":2},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-49:37e7d5ac-1249-4c4d-9b86-81fc80607142.4934.14"}]},{"op_id":"5#00000000001.63.5","op_tag":"37e7d5ac-1249-4c4d-9b86-81fc80607142.4932.1944","op":"write","object":"d","instance":"","state":"complete","index_ver":1,"timestamp":"2021-03-24T12:25:00.649918653Z","ver":{"pool":9,"epoch":1},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-49:37e7d5ac-1249-4c4d-9b86-81fc80607142.4934.14"}]},{"op_id":"8#00000000001.31.5","op_tag":"37e7d5ac-1249-4c4d-9b86-81fc80607142.4932.1942","op":"write","object":"c","instance":"","state":"complete","index_ver":1,"timestamp":"2021-03-24T12:25:00.597057611Z","ver":{"pool":9,"epoch":3},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-49:37e7d5ac-1249-4c4d-9b86-81fc80607142.4934.14"}]},{"op_id":"10#00000000001.49.5","op_tag":"37e7d5ac-1249-4c4d-9b86-81fc80607142.4932.1940","op":"write","object":"b","instance":"","state":"complete","index_ver":1,"timestamp":"2021-03-24T12:25:00.549209001Z","ver":{"pool":9,"epoch":5},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"37e7d5ac-1249-4c4d-9b86-81fc80607142:jlfoya-49:37e7d5ac-1249-4c4d-9b86-81fc80607142.4934.14"}]}] 2021-03-24T12:25:19.630 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '999', '--rgw-sync-log-trim-min-cold-buckets', '999', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:25:19.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '999', '--rgw-sync-log-trim-min-cold-buckets', '999', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-03-24T12:25:19.631 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 999 --rgw-sync-log-trim-min-cold-buckets 999 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-03-24T12:25:19.708 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:19.708 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:20.706 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'jlfoya-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:20.707 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'jlfoya-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:20.708 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket jlfoya-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:20.789 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:20.789 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:21.000 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2021-03-24T12:25:21.001 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_index_log_trim ... ok 2021-03-24T12:25:21.014 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_creation_time ... ok 2021-03-24T12:25:21.015 INFO:tasks.rgw_multisite_tests:log information for manual testing ... ok 2021-03-24T12:25:21.016 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:21.021 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:21.022 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:21.081 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:21.082 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:21.249 INFO:teuthology.orchestra.run.smithi043.stderr:No --period given, using current period=876ba0ea-d5b5-41b8-b270-94bbb5b3c639 2021-03-24T12:25:21.281 INFO:teuthology.orchestra.run.smithi043.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1616588709.826300_474.1","last_update":"2021-03-24T12:25:09.826300Z"},{"marker":"","last_update":"0.000000"}] 2021-03-24T12:25:21.281 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-03-24T12:25:21.282 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:21.282 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:21.283 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:21.324 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:21.324 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T12:25:21.512 INFO:teuthology.orchestra.run.smithi161.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"876ba0ea-d5b5-41b8-b270-94bbb5b3c639","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1616587550.682762_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-03-24T12:05:50.682762Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1616588709.826300_474.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:25:09.826300Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1616587716.665846_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-03-24T12:08:36.665846Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-03-24T12:25:21.512 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-03-24T12:25:21.513 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-03-24T12:25:21.513 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:21.514 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-03-24T12:25:21.514 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-03-24T12:25:21.595 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2021-03-24T12:25:21.595 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2021-03-24T23:55:13.782 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-03-24T23:55:13.818 DEBUG:teuthology.task.console_log:Killing console logger for smithi043 2021-03-24T23:55:13.820 DEBUG:teuthology.task.console_log:Killing console logger for smithi161 2021-03-24T23:55:13.820 DEBUG:teuthology.exit:Finished running handlers