2021-09-15T21:58:35.691 INFO:root:teuthology version: 1.1.0-b135a4f8 2021-09-15T21:58:35.693 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --verbose --name teuthology-2021-09-15_21:37:43-upgrade:octopus-x-master-distro-basic-smithi --description upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} --archive /home/teuthworker/archive/teuthology-2021-09-15_21:37:43-upgrade:octopus-x-master-distro-basic-smithi/6391763 -- /home/teuthworker/archive/teuthology-2021-09-15_21:37:43-upgrade:octopus-x-master-distro-basic-smithi/6391763/orig.config.yaml 2021-09-15T21:58:35.732 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-09-15T21:58:35.784 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2021-09-15_21:37:43-upgrade:octopus-x-master-distro-basic-smithi/6391763 branch: master description: upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} email: ceph-qa@ceph.com first_in_suite: false job_id: '6391763' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2021-09-15_21:37:43-upgrade:octopus-x-master-distro-basic-smithi nuke-on-error: true overrides: admin_socket: branch: master ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= rgw curl low speed time: 300 rgw data log num shards: 4 rgw md log max shards: 4 rgw sync log trim interval: 0 rgw sync obj etag verify: true setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon_warn_on_insecure_global_id_reclaim: false mon_warn_on_insecure_global_id_reclaim_allowed: false osd: debug ms: 1 debug osd: 20 log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b70647e8796c78a4f551a1edd9ebceb06255dced wait-for-scrub: false ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: branch: octopus sha1: b70647e8796c78a4f551a1edd9ebceb06255dced rgw: compression type: random frontend: beast rgw-multisite: realm: is default: true name: test-realm zonegroups: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zonegroup zones: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zone1 - endpoints: - c2.client.0 is_default: true name: test-zone2 - endpoints: - c2.client.1 is_pubsub: true name: test-zone3 rgw-multisite-tests: args: - tests.py - tests_ps.py branch: octopus repo: https://github.com/ceph/ceph.git workunit: branch: master sha1: b70647e8796c78a4f551a1edd9ebceb06255dced owner: scheduled_teuthology@teuthology priority: 70 repo: git://git.ceph.com/ceph.git roles: - - c1.mon.a - c1.mgr.x - c1.osd.0 - c1.osd.1 - c1.osd.2 - c1.client.0 - - c2.mon.a - c2.mgr.x - c2.osd.0 - c2.osd.1 - c2.osd.2 - c2.client.0 - c2.client.1 sha1: b70647e8796c78a4f551a1edd9ebceb06255dced sleep_before_teardown: 0 suite: upgrade:octopus-x suite_branch: master suite_path: /home/teuthworker/src/git.ceph.com_ceph_b70647e8796c78a4f551a1edd9ebceb06255dced/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph.git suite_sha1: b70647e8796c78a4f551a1edd9ebceb06255dced targets: smithi180.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWPvLgA4ep3bwkX4Qg0xlvLShAXjOjtFjDSW1pdclYZl20cXcJyjXEi+aA66hlscTJ2c5zUtPvN+ipMQ8KkCDwr4LGOrMW8OQArlErgF26hq8FKeCEIX6UjbSpiYs+7vG9hrNJY3b7Hf1KTVFXWOkwH6iqVPIWy8mcUmOzMLUqNOfniKWa4qGVGx0KplrOwdAg2Hw6O5tV0+j6aFMmKDb6ozo8bwMzVlk0lD97K1eaPR2RPzyeVN6G9nxKHTU7ka6IDTWaSU5ncTTV4l4n2sjoDeDjJYc39YrrXh/hSAbxC365XgeSLa9Mre/fE+m75pnVIWMbYAmVElUMoYOo+8xt0u5RIO4XdDBVGTdCp4PkBWONNSAD4t+//avEM02xuaTDlbhUSeGKNkAg1t1m8XsbHG5JDd9fX/e3rzbhUIsFWhJe2BNuhm60fdOxjaVxQ8PfgncmNyu2zN8tYrxYLPvwmv6YVbY1B+C59q6+GMlp6X1iV45QMuZ4ms9HZTCyQ2s= smithi184.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMTAxZZG2AEqYXX4LK0VKCAcmcB8fDDlh6kP/ibDpbWHdKaOnqZXkBYEQr9z5JmYb+FhrarWD6jxmQfFgHNu4OQkpGHRls1t/0CZ8VkskjU7BsgycggFMxNUjfci3ebGZ/sCZryWGkN/PvXzoprwXHqksTdMbDZGKXbM7QeA6AQZNPsE81stH6Q0++LKJOGy5Tg53E6yPyhUjJVinqczET1EAlDUSxnFEDyJUm2/MOor5bQucEt+mdKgSShWU9fhn6FN9blcur1qZMsxthr1THTBCLZyFEaREMDpc1Wvjudor/hJNLGnqxYAsS+0Y+zN50GfzqO0N5aur7sTwVreX5dFdzty15yxPJdBCvBB6w3cm6jWyKbgIb3AfTaS8OHsMlmXcG8FDpV/Xez+x+atWH8Tt3hvX3DgrptKYM/HsccrDET76txc/j0Fk2/GKEb5xWmB2knyGQZUON798zLSJeZe10rskQjoRwk2nOr3Idj4fDX26sn3GgQ/VX+tqttn8= tasks: - install: null - ceph: cluster: c1 - ceph: cluster: c2 - parallel: - upgrade-task - rgw: c1.client.0: port: 8000 c2.client.0: port: 8000 c2.client.1: port: 8001 - rgw-multisite: null - rgw-multisite-tests: config: reconfigure_delay: 60 teuthology_branch: master teuthology_sha1: b135a4f82b02b966053efba0501e6a47c9d2d793 timestamp: 2021-09-15_21:37:43 tube: smithi upgrade-task: - install.upgrade: c2.client.0: null c2.client.1: null c2.mgr.x: null c2.mon.a: null c2.osd.0: null c2.osd.1: null c2.osd.2: null user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.30581 2021-09-15T21:58:35.784 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b70647e8796c78a4f551a1edd9ebceb06255dced/qa; will attempt to use it 2021-09-15T21:58:35.785 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b70647e8796c78a4f551a1edd9ebceb06255dced/qa/tasks 2021-09-15T21:58:35.785 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-09-15T21:58:35.788 INFO:teuthology.task.internal:Checking packages... 2021-09-15T21:58:35.788 INFO:teuthology.task.internal:Checking packages skipped, missing os_type 'None' or ceph hash 'b70647e8796c78a4f551a1edd9ebceb06255dced' 2021-09-15T21:58:35.788 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-09-15T21:58:35.799 INFO:teuthology.task.internal:no buildpackages task found 2021-09-15T21:58:35.800 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-09-15T21:58:35.838 INFO:teuthology.task.internal:Saving configuration 2021-09-15T21:58:35.852 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-09-15T21:58:35.866 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-09-15T21:58:35.883 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-09-15 21:53:13.864102', 'description': '/home/teuthworker/archive/teuthology-2021-09-15_21:37:43-upgrade:octopus-x-master-distro-basic-smithi/6391763', 'locked_by': 'scheduled_teuthology@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFNB7/X646AqRKtqYws5cCkuLqOkFu8m+fucFKHhCBBH', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi180.front.sepia.ceph.com'} 2021-09-15T21:58:35.899 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-09-15 21:53:13.864082', 'description': '/home/teuthworker/archive/teuthology-2021-09-15_21:37:43-upgrade:octopus-x-master-distro-basic-smithi/6391763', 'locked_by': 'scheduled_teuthology@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDgubmyU2dUTF1S45L4lKv8zojd9mHEE08e01EASbAFR', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi184.front.sepia.ceph.com'} 2021-09-15T21:58:35.900 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-09-15T21:58:35.911 INFO:teuthology.task.internal:roles: ubuntu@smithi180.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'] 2021-09-15T21:58:35.911 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2021-09-15T21:58:35.911 INFO:teuthology.run_tasks:Running task console_log... 2021-09-15T21:58:35.989 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7bc1e1ee18>, signals=[15]) 2021-09-15T21:58:35.990 INFO:teuthology.run_tasks:Running task internal.connect... 2021-09-15T21:58:36.001 INFO:teuthology.task.internal:Opening connections... 2021-09-15T21:58:36.001 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi180.front.sepia.ceph.com 2021-09-15T21:58:36.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-09-15T21:58:36.054 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2021-09-15T21:58:36.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-09-15T21:58:36.108 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-09-15T21:58:36.118 DEBUG:teuthology.orchestra.run.smithi180:> uname -m 2021-09-15T21:58:36.132 INFO:teuthology.orchestra.run.smithi180.stdout:x86_64 2021-09-15T21:58:36.133 DEBUG:teuthology.orchestra.run.smithi180:> cat /etc/os-release 2021-09-15T21:58:36.179 INFO:teuthology.orchestra.run.smithi180.stdout:NAME="Ubuntu" 2021-09-15T21:58:36.179 INFO:teuthology.orchestra.run.smithi180.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-09-15T21:58:36.179 INFO:teuthology.orchestra.run.smithi180.stdout:ID=ubuntu 2021-09-15T21:58:36.180 INFO:teuthology.orchestra.run.smithi180.stdout:ID_LIKE=debian 2021-09-15T21:58:36.180 INFO:teuthology.orchestra.run.smithi180.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-09-15T21:58:36.180 INFO:teuthology.orchestra.run.smithi180.stdout:VERSION_ID="20.04" 2021-09-15T21:58:36.180 INFO:teuthology.orchestra.run.smithi180.stdout:HOME_URL="https://www.ubuntu.com/" 2021-09-15T21:58:36.181 INFO:teuthology.orchestra.run.smithi180.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-09-15T21:58:36.181 INFO:teuthology.orchestra.run.smithi180.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-09-15T21:58:36.181 INFO:teuthology.orchestra.run.smithi180.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-09-15T21:58:36.181 INFO:teuthology.orchestra.run.smithi180.stdout:VERSION_CODENAME=focal 2021-09-15T21:58:36.182 INFO:teuthology.orchestra.run.smithi180.stdout:UBUNTU_CODENAME=focal 2021-09-15T21:58:36.183 INFO:teuthology.lock.ops:Updating smithi180.front.sepia.ceph.com on lock server 2021-09-15T21:58:36.199 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2021-09-15T21:58:36.207 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2021-09-15T21:58:36.207 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2021-09-15T21:58:36.257 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu" 2021-09-15T21:58:36.258 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-09-15T21:58:36.258 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu 2021-09-15T21:58:36.259 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian 2021-09-15T21:58:36.259 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-09-15T21:58:36.260 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="20.04" 2021-09-15T21:58:36.260 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/" 2021-09-15T21:58:36.261 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-09-15T21:58:36.261 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-09-15T21:58:36.262 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-09-15T21:58:36.262 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=focal 2021-09-15T21:58:36.262 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=focal 2021-09-15T21:58:36.263 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2021-09-15T21:58:36.278 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-09-15T21:58:36.292 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-09-15T21:58:36.313 INFO:teuthology.task.internal:Checking for old test directory... 2021-09-15T21:58:36.314 DEBUG:teuthology.orchestra.run.smithi180:> test '!' -e /home/ubuntu/cephtest 2021-09-15T21:58:36.317 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2021-09-15T21:58:36.322 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-09-15T21:58:36.338 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-09-15T21:58:36.338 DEBUG:teuthology.orchestra.run.smithi180:> test -z $(ls -A /var/lib/ceph) 2021-09-15T21:58:36.362 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2021-09-15T21:58:36.378 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-09-15T21:58:36.426 INFO:teuthology.run_tasks:Running task kernel... 2021-09-15T21:58:36.446 DEBUG:teuthology.task.kernel:normalized config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c1.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.0': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.1': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.2': {'kdb': True, 'sha1': 'distro'}, 'c1.client.0': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.0': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.1': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.2': {'kdb': True, 'sha1': 'distro'}, 'c2.client.0': {'kdb': True, 'sha1': 'distro'}, 'c2.client.1': {'kdb': True, 'sha1': 'distro'}} 2021-09-15T21:58:36.447 INFO:teuthology.task.kernel:config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-09-15T21:58:36.447 DEBUG:teuthology.orchestra.run.smithi180:> uname -r 2021-09-15T21:58:36.454 INFO:teuthology.orchestra.run.smithi180.stdout:5.4.0-66-generic 2021-09-15T21:58:36.454 INFO:teuthology.task.kernel:Running kernel on smithi180: 5.4.0-66-generic 2021-09-15T21:58:36.454 DEBUG:teuthology.orchestra.run.smithi180:> sudo apt-get clean 2021-09-15T21:58:36.555 DEBUG:teuthology.orchestra.run.smithi180:> sudo apt-get update 2021-09-15T21:58:36.789 INFO:teuthology.orchestra.run.smithi180.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-09-15T21:58:36.837 INFO:teuthology.orchestra.run.smithi180.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-09-15T21:58:36.919 INFO:teuthology.orchestra.run.smithi180.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-09-15T21:58:37.048 INFO:teuthology.orchestra.run.smithi180.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [866 kB] 2021-09-15T21:58:37.131 INFO:teuthology.orchestra.run.smithi180.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [282 kB] 2021-09-15T21:58:37.135 INFO:teuthology.orchestra.run.smithi180.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [167 kB] 2021-09-15T21:58:37.138 INFO:teuthology.orchestra.run.smithi180.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,684 B] 2021-09-15T21:58:37.138 INFO:teuthology.orchestra.run.smithi180.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [18.0 kB] 2021-09-15T21:58:37.139 INFO:teuthology.orchestra.run.smithi180.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [406 kB] 2021-09-15T21:58:37.142 INFO:teuthology.orchestra.run.smithi180.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [58.3 kB] 2021-09-15T21:58:37.143 INFO:teuthology.orchestra.run.smithi180.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [508 B] 2021-09-15T21:58:37.143 INFO:teuthology.orchestra.run.smithi180.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [507 kB] 2021-09-15T21:58:37.153 INFO:teuthology.orchestra.run.smithi180.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [638 kB] 2021-09-15T21:58:37.161 INFO:teuthology.orchestra.run.smithi180.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [101 kB] 2021-09-15T21:58:37.162 INFO:teuthology.orchestra.run.smithi180.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.4 kB] 2021-09-15T21:58:37.171 INFO:teuthology.orchestra.run.smithi180.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-09-15T21:58:37.172 INFO:teuthology.orchestra.run.smithi180.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,948 B] 2021-09-15T21:58:37.172 INFO:teuthology.orchestra.run.smithi180.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-09-15T21:58:37.250 INFO:teuthology.orchestra.run.smithi180.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-09-15T21:58:37.373 INFO:teuthology.orchestra.run.smithi180.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [535 kB] 2021-09-15T21:58:37.626 INFO:teuthology.orchestra.run.smithi180.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,213 kB] 2021-09-15T21:58:37.756 INFO:teuthology.orchestra.run.smithi180.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [259 kB] 2021-09-15T21:58:37.774 INFO:teuthology.orchestra.run.smithi180.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.2 kB] 2021-09-15T21:58:37.775 INFO:teuthology.orchestra.run.smithi180.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [443 kB] 2021-09-15T21:58:37.799 INFO:teuthology.orchestra.run.smithi180.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [19.3 kB] 2021-09-15T21:58:37.800 INFO:teuthology.orchestra.run.smithi180.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [63.5 kB] 2021-09-15T21:58:37.802 INFO:teuthology.orchestra.run.smithi180.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [504 B] 2021-09-15T21:58:37.803 INFO:teuthology.orchestra.run.smithi180.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [633 kB] 2021-09-15T21:58:37.830 INFO:teuthology.orchestra.run.smithi180.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [855 kB] 2021-09-15T21:58:37.861 INFO:teuthology.orchestra.run.smithi180.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [182 kB] 2021-09-15T21:58:37.866 INFO:teuthology.orchestra.run.smithi180.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [18.9 kB] 2021-09-15T21:58:37.885 INFO:teuthology.orchestra.run.smithi180.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,232 B] 2021-09-15T21:58:37.885 INFO:teuthology.orchestra.run.smithi180.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.6 kB] 2021-09-15T21:58:37.886 INFO:teuthology.orchestra.run.smithi180.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,776 B] 2021-09-15T21:58:37.887 INFO:teuthology.orchestra.run.smithi180.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2021-09-15T21:58:37.887 INFO:teuthology.orchestra.run.smithi180.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [4,736 B] 2021-09-15T21:58:37.922 INFO:teuthology.orchestra.run.smithi180.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [5,800 B] 2021-09-15T21:58:37.922 INFO:teuthology.orchestra.run.smithi180.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [276 B] 2021-09-15T21:58:41.070 INFO:teuthology.orchestra.run.smithi180.stdout:Fetched 7,709 kB in 2s (4,963 kB/s) 2021-09-15T21:58:42.205 INFO:teuthology.orchestra.run.smithi180.stdout:Reading package lists... 2021-09-15T21:58:42.226 DEBUG:teuthology.orchestra.run.smithi180:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-09-15T21:58:42.291 INFO:teuthology.orchestra.run.smithi180.stdout:Reading package lists... 2021-09-15T21:58:42.459 INFO:teuthology.orchestra.run.smithi180.stdout:Building dependency tree... 2021-09-15T21:58:42.459 INFO:teuthology.orchestra.run.smithi180.stdout:Reading state information... 2021-09-15T21:58:42.482 INFO:teuthology.orchestra.run.smithi180.stderr:E: Unable to locate package linux-image-current-generic 2021-09-15T21:58:42.483 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-09-15T21:58:42.484 DEBUG:teuthology.orchestra.run.smithi180:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-09-15T21:58:42.547 INFO:teuthology.orchestra.run.smithi180.stdout:Reading package lists... 2021-09-15T21:58:42.694 INFO:teuthology.orchestra.run.smithi180.stdout:Building dependency tree... 2021-09-15T21:58:42.695 INFO:teuthology.orchestra.run.smithi180.stdout:Reading state information... 2021-09-15T21:58:42.822 INFO:teuthology.orchestra.run.smithi180.stdout:The following additional packages will be installed: 2021-09-15T21:58:42.822 INFO:teuthology.orchestra.run.smithi180.stdout: linux-generic linux-headers-5.4.0-84 linux-headers-5.4.0-84-generic 2021-09-15T21:58:42.822 INFO:teuthology.orchestra.run.smithi180.stdout: linux-headers-generic linux-image-5.4.0-84-generic 2021-09-15T21:58:42.822 INFO:teuthology.orchestra.run.smithi180.stdout: linux-modules-5.4.0-84-generic linux-modules-extra-5.4.0-84-generic 2021-09-15T21:58:42.823 INFO:teuthology.orchestra.run.smithi180.stdout:Suggested packages: 2021-09-15T21:58:42.823 INFO:teuthology.orchestra.run.smithi180.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-09-15T21:58:42.823 INFO:teuthology.orchestra.run.smithi180.stdout:Recommended packages: 2021-09-15T21:58:42.824 INFO:teuthology.orchestra.run.smithi180.stdout: thermald 2021-09-15T21:58:42.849 INFO:teuthology.orchestra.run.smithi180.stdout:The following NEW packages will be installed: 2021-09-15T21:58:42.849 INFO:teuthology.orchestra.run.smithi180.stdout: linux-headers-5.4.0-84 linux-headers-5.4.0-84-generic 2021-09-15T21:58:42.849 INFO:teuthology.orchestra.run.smithi180.stdout: linux-image-5.4.0-84-generic linux-modules-5.4.0-84-generic 2021-09-15T21:58:42.850 INFO:teuthology.orchestra.run.smithi180.stdout: linux-modules-extra-5.4.0-84-generic 2021-09-15T21:58:42.850 INFO:teuthology.orchestra.run.smithi180.stdout:The following packages will be upgraded: 2021-09-15T21:58:42.851 INFO:teuthology.orchestra.run.smithi180.stdout: linux-generic linux-headers-generic linux-image-generic 2021-09-15T21:58:43.144 INFO:teuthology.orchestra.run.smithi180.stdout:3 upgraded, 5 newly installed, 0 to remove and 176 not upgraded. 2021-09-15T21:58:43.144 INFO:teuthology.orchestra.run.smithi180.stdout:Need to get 75.6 MB of archives. 2021-09-15T21:58:43.144 INFO:teuthology.orchestra.run.smithi180.stdout:After this operation, 378 MB of additional disk space will be used. 2021-09-15T21:58:43.145 INFO:teuthology.orchestra.run.smithi180.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-84-generic amd64 5.4.0-84.94 [14.8 MB] 2021-09-15T21:58:44.374 INFO:teuthology.orchestra.run.smithi180.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-84-generic amd64 5.4.0-84.94 [8,992 kB] 2021-09-15T21:58:44.589 INFO:teuthology.orchestra.run.smithi180.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-84-generic amd64 5.4.0-84.94 [39.4 MB] 2021-09-15T21:58:45.933 INFO:teuthology.orchestra.run.smithi180.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.84.88 [1,896 B] 2021-09-15T21:58:45.934 INFO:teuthology.orchestra.run.smithi180.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.84.88 [2,568 B] 2021-09-15T21:58:45.934 INFO:teuthology.orchestra.run.smithi180.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-84 all 5.4.0-84.94 [11.0 MB] 2021-09-15T21:58:46.215 INFO:teuthology.orchestra.run.smithi180.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-84-generic amd64 5.4.0-84.94 [1,396 kB] 2021-09-15T21:58:46.247 INFO:teuthology.orchestra.run.smithi180.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.84.88 [2,436 B] 2021-09-15T21:58:46.670 INFO:teuthology.orchestra.run.smithi180.stdout:Fetched 75.6 MB in 3s (22.3 MB/s) 2021-09-15T21:58:46.842 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package linux-modules-5.4.0-84-generic. 2021-09-15T21:58:48.341 INFO:teuthology.orchestra.run.smithi180.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101688 files and directories currently installed.) 2021-09-15T21:58:48.346 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../0-linux-modules-5.4.0-84-generic_5.4.0-84.94_amd64.deb ... 2021-09-15T21:58:48.453 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking linux-modules-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T21:58:50.809 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package linux-image-5.4.0-84-generic. 2021-09-15T21:58:50.824 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../1-linux-image-5.4.0-84-generic_5.4.0-84.94_amd64.deb ... 2021-09-15T21:58:50.926 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking linux-image-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T21:58:51.968 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-84-generic. 2021-09-15T21:58:51.983 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-84-generic_5.4.0-84.94_amd64.deb ... 2021-09-15T21:58:52.026 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking linux-modules-extra-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T21:58:57.095 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../3-linux-generic_5.4.0.84.88_amd64.deb ... 2021-09-15T21:58:57.203 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking linux-generic (5.4.0.84.88) over (5.4.0.66.69) ... 2021-09-15T21:58:57.527 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.84.88_amd64.deb ... 2021-09-15T21:58:57.683 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking linux-image-generic (5.4.0.84.88) over (5.4.0.66.69) ... 2021-09-15T21:58:58.019 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package linux-headers-5.4.0-84. 2021-09-15T21:58:58.034 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../5-linux-headers-5.4.0-84_5.4.0-84.94_all.deb ... 2021-09-15T21:58:58.095 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking linux-headers-5.4.0-84 (5.4.0-84.94) ... 2021-09-15T21:59:04.228 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package linux-headers-5.4.0-84-generic. 2021-09-15T21:59:04.249 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../6-linux-headers-5.4.0-84-generic_5.4.0-84.94_amd64.deb ... 2021-09-15T21:59:04.286 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking linux-headers-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T21:59:07.057 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.84.88_amd64.deb ... 2021-09-15T21:59:07.186 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking linux-headers-generic (5.4.0.84.88) over (5.4.0.66.69) ... 2021-09-15T21:59:07.515 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up linux-headers-5.4.0-84 (5.4.0-84.94) ... 2021-09-15T21:59:07.640 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up linux-modules-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T21:59:08.885 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up linux-headers-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T21:59:09.011 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up linux-headers-generic (5.4.0.84.88) ... 2021-09-15T21:59:09.137 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up linux-image-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T21:59:10.247 INFO:teuthology.orchestra.run.smithi180.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-84-generic 2021-09-15T21:59:10.247 INFO:teuthology.orchestra.run.smithi180.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-84-generic 2021-09-15T21:59:10.380 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up linux-modules-extra-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T21:59:11.799 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up linux-image-generic (5.4.0.84.88) ... 2021-09-15T21:59:11.916 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up linux-generic (5.4.0.84.88) ... 2021-09-15T21:59:12.018 INFO:teuthology.orchestra.run.smithi180.stdout:Processing triggers for linux-image-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T21:59:12.198 INFO:teuthology.orchestra.run.smithi180.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-09-15T21:59:12.198 INFO:teuthology.orchestra.run.smithi180.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-84-generic 2021-09-15T21:59:33.728 INFO:teuthology.orchestra.run.smithi180.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-09-15T21:59:33.728 INFO:teuthology.orchestra.run.smithi180.stdout:Sourcing file `/etc/default/grub' 2021-09-15T21:59:33.734 INFO:teuthology.orchestra.run.smithi180.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-09-15T21:59:33.749 INFO:teuthology.orchestra.run.smithi180.stdout:Generating grub configuration file ... 2021-09-15T21:59:34.075 INFO:teuthology.orchestra.run.smithi180.stdout:Found linux image: /boot/vmlinuz-5.4.0-84-generic 2021-09-15T21:59:34.105 INFO:teuthology.orchestra.run.smithi180.stdout:Found initrd image: /boot/initrd.img-5.4.0-84-generic 2021-09-15T21:59:34.499 INFO:teuthology.orchestra.run.smithi180.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-09-15T21:59:34.510 INFO:teuthology.orchestra.run.smithi180.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-09-15T21:59:37.101 INFO:teuthology.orchestra.run.smithi180.stdout:done 2021-09-15T21:59:37.462 DEBUG:teuthology.orchestra.run.smithi180:> dpkg -s linux-image-generic 2021-09-15T21:59:37.610 INFO:teuthology.orchestra.run.smithi180.stdout:Package: linux-image-generic 2021-09-15T21:59:37.610 INFO:teuthology.orchestra.run.smithi180.stdout:Status: install ok installed 2021-09-15T21:59:37.611 INFO:teuthology.orchestra.run.smithi180.stdout:Priority: optional 2021-09-15T21:59:37.611 INFO:teuthology.orchestra.run.smithi180.stdout:Section: kernel 2021-09-15T21:59:37.611 INFO:teuthology.orchestra.run.smithi180.stdout:Installed-Size: 18 2021-09-15T21:59:37.611 INFO:teuthology.orchestra.run.smithi180.stdout:Maintainer: Ubuntu Kernel Team 2021-09-15T21:59:37.612 INFO:teuthology.orchestra.run.smithi180.stdout:Architecture: amd64 2021-09-15T21:59:37.612 INFO:teuthology.orchestra.run.smithi180.stdout:Source: linux-meta 2021-09-15T21:59:37.612 INFO:teuthology.orchestra.run.smithi180.stdout:Version: 5.4.0.84.88 2021-09-15T21:59:37.612 INFO:teuthology.orchestra.run.smithi180.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-09-15T21:59:37.613 INFO:teuthology.orchestra.run.smithi180.stdout:Depends: linux-image-5.4.0-84-generic, linux-modules-extra-5.4.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2021-09-15T21:59:37.613 INFO:teuthology.orchestra.run.smithi180.stdout:Recommends: thermald 2021-09-15T21:59:37.613 INFO:teuthology.orchestra.run.smithi180.stdout:Description: Generic Linux kernel image 2021-09-15T21:59:37.613 INFO:teuthology.orchestra.run.smithi180.stdout: This package will always depend on the latest generic kernel image 2021-09-15T21:59:37.613 INFO:teuthology.orchestra.run.smithi180.stdout: available. 2021-09-15T21:59:37.614 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-66-generic Expected: 5.4.0-84-generic 2021-09-15T21:59:37.614 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2021-09-15T21:59:37.621 INFO:teuthology.orchestra.run.smithi184.stdout:5.4.0-66-generic 2021-09-15T21:59:37.622 INFO:teuthology.task.kernel:Running kernel on smithi184: 5.4.0-66-generic 2021-09-15T21:59:37.622 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get clean 2021-09-15T21:59:37.732 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get update 2021-09-15T21:59:37.898 INFO:teuthology.orchestra.run.smithi184.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-09-15T21:59:38.010 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-09-15T21:59:38.092 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-09-15T21:59:38.211 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [866 kB] 2021-09-15T21:59:38.386 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [282 kB] 2021-09-15T21:59:38.402 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [167 kB] 2021-09-15T21:59:38.411 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,684 B] 2021-09-15T21:59:38.412 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [406 kB] 2021-09-15T21:59:38.430 INFO:teuthology.orchestra.run.smithi184.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-09-15T21:59:38.436 INFO:teuthology.orchestra.run.smithi184.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [18.0 kB] 2021-09-15T21:59:38.436 INFO:teuthology.orchestra.run.smithi184.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [58.3 kB] 2021-09-15T21:59:38.440 INFO:teuthology.orchestra.run.smithi184.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [508 B] 2021-09-15T21:59:38.441 INFO:teuthology.orchestra.run.smithi184.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [507 kB] 2021-09-15T21:59:38.471 INFO:teuthology.orchestra.run.smithi184.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [638 kB] 2021-09-15T21:59:38.500 INFO:teuthology.orchestra.run.smithi184.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [101 kB] 2021-09-15T21:59:38.507 INFO:teuthology.orchestra.run.smithi184.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.4 kB] 2021-09-15T21:59:38.507 INFO:teuthology.orchestra.run.smithi184.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-09-15T21:59:38.509 INFO:teuthology.orchestra.run.smithi184.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,948 B] 2021-09-15T21:59:38.509 INFO:teuthology.orchestra.run.smithi184.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-09-15T21:59:38.554 INFO:teuthology.orchestra.run.smithi184.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,213 kB] 2021-09-15T21:59:38.890 INFO:teuthology.orchestra.run.smithi184.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [535 kB] 2021-09-15T21:59:38.920 INFO:teuthology.orchestra.run.smithi184.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [259 kB] 2021-09-15T21:59:38.927 INFO:teuthology.orchestra.run.smithi184.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.2 kB] 2021-09-15T21:59:38.927 INFO:teuthology.orchestra.run.smithi184.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [19.3 kB] 2021-09-15T21:59:38.928 INFO:teuthology.orchestra.run.smithi184.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [443 kB] 2021-09-15T21:59:38.949 INFO:teuthology.orchestra.run.smithi184.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [63.5 kB] 2021-09-15T21:59:38.973 INFO:teuthology.orchestra.run.smithi184.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [504 B] 2021-09-15T21:59:38.974 INFO:teuthology.orchestra.run.smithi184.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [633 kB] 2021-09-15T21:59:39.001 INFO:teuthology.orchestra.run.smithi184.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [855 kB] 2021-09-15T21:59:39.036 INFO:teuthology.orchestra.run.smithi184.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [182 kB] 2021-09-15T21:59:39.039 INFO:teuthology.orchestra.run.smithi184.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [18.9 kB] 2021-09-15T21:59:39.059 INFO:teuthology.orchestra.run.smithi184.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.6 kB] 2021-09-15T21:59:39.060 INFO:teuthology.orchestra.run.smithi184.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,232 B] 2021-09-15T21:59:39.061 INFO:teuthology.orchestra.run.smithi184.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,776 B] 2021-09-15T21:59:39.061 INFO:teuthology.orchestra.run.smithi184.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2021-09-15T21:59:39.062 INFO:teuthology.orchestra.run.smithi184.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [4,736 B] 2021-09-15T21:59:39.089 INFO:teuthology.orchestra.run.smithi184.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [5,800 B] 2021-09-15T21:59:39.089 INFO:teuthology.orchestra.run.smithi184.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [276 B] 2021-09-15T21:59:42.317 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 7,709 kB in 1s (5,285 kB/s) 2021-09-15T21:59:43.506 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2021-09-15T21:59:43.528 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-09-15T21:59:43.594 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2021-09-15T21:59:43.758 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2021-09-15T21:59:43.758 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2021-09-15T21:59:43.779 INFO:teuthology.orchestra.run.smithi184.stderr:E: Unable to locate package linux-image-current-generic 2021-09-15T21:59:43.780 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-09-15T21:59:43.781 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-09-15T21:59:43.848 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2021-09-15T21:59:44.008 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2021-09-15T21:59:44.009 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2021-09-15T21:59:44.139 INFO:teuthology.orchestra.run.smithi184.stdout:The following additional packages will be installed: 2021-09-15T21:59:44.140 INFO:teuthology.orchestra.run.smithi184.stdout: linux-generic linux-headers-5.4.0-84 linux-headers-5.4.0-84-generic 2021-09-15T21:59:44.140 INFO:teuthology.orchestra.run.smithi184.stdout: linux-headers-generic linux-image-5.4.0-84-generic 2021-09-15T21:59:44.140 INFO:teuthology.orchestra.run.smithi184.stdout: linux-modules-5.4.0-84-generic linux-modules-extra-5.4.0-84-generic 2021-09-15T21:59:44.141 INFO:teuthology.orchestra.run.smithi184.stdout:Suggested packages: 2021-09-15T21:59:44.141 INFO:teuthology.orchestra.run.smithi184.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-09-15T21:59:44.141 INFO:teuthology.orchestra.run.smithi184.stdout:Recommended packages: 2021-09-15T21:59:44.141 INFO:teuthology.orchestra.run.smithi184.stdout: thermald 2021-09-15T21:59:44.169 INFO:teuthology.orchestra.run.smithi184.stdout:The following NEW packages will be installed: 2021-09-15T21:59:44.169 INFO:teuthology.orchestra.run.smithi184.stdout: linux-headers-5.4.0-84 linux-headers-5.4.0-84-generic 2021-09-15T21:59:44.169 INFO:teuthology.orchestra.run.smithi184.stdout: linux-image-5.4.0-84-generic linux-modules-5.4.0-84-generic 2021-09-15T21:59:44.169 INFO:teuthology.orchestra.run.smithi184.stdout: linux-modules-extra-5.4.0-84-generic 2021-09-15T21:59:44.170 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages will be upgraded: 2021-09-15T21:59:44.170 INFO:teuthology.orchestra.run.smithi184.stdout: linux-generic linux-headers-generic linux-image-generic 2021-09-15T21:59:44.351 INFO:teuthology.orchestra.run.smithi184.stdout:3 upgraded, 5 newly installed, 0 to remove and 176 not upgraded. 2021-09-15T21:59:44.351 INFO:teuthology.orchestra.run.smithi184.stdout:Need to get 75.6 MB of archives. 2021-09-15T21:59:44.351 INFO:teuthology.orchestra.run.smithi184.stdout:After this operation, 378 MB of additional disk space will be used. 2021-09-15T21:59:44.352 INFO:teuthology.orchestra.run.smithi184.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-84-generic amd64 5.4.0-84.94 [14.8 MB] 2021-09-15T21:59:45.470 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-84-generic amd64 5.4.0-84.94 [8,992 kB] 2021-09-15T21:59:45.681 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-84-generic amd64 5.4.0-84.94 [39.4 MB] 2021-09-15T21:59:46.996 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.84.88 [1,896 B] 2021-09-15T21:59:46.997 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.84.88 [2,568 B] 2021-09-15T21:59:46.997 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-84 all 5.4.0-84.94 [11.0 MB] 2021-09-15T21:59:47.346 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-84-generic amd64 5.4.0-84.94 [1,396 kB] 2021-09-15T21:59:47.363 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.84.88 [2,436 B] 2021-09-15T21:59:47.760 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 75.6 MB in 3s (23.7 MB/s) 2021-09-15T21:59:47.953 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-modules-5.4.0-84-generic. 2021-09-15T21:59:49.456 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101688 files and directories currently installed.) 2021-09-15T21:59:49.461 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../0-linux-modules-5.4.0-84-generic_5.4.0-84.94_amd64.deb ... 2021-09-15T21:59:49.567 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-modules-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T21:59:51.687 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-image-5.4.0-84-generic. 2021-09-15T21:59:51.701 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../1-linux-image-5.4.0-84-generic_5.4.0-84.94_amd64.deb ... 2021-09-15T21:59:51.809 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-image-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T21:59:52.793 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-84-generic. 2021-09-15T21:59:52.805 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-84-generic_5.4.0-84.94_amd64.deb ... 2021-09-15T21:59:52.843 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-modules-extra-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T21:59:57.862 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../3-linux-generic_5.4.0.84.88_amd64.deb ... 2021-09-15T21:59:58.004 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-generic (5.4.0.84.88) over (5.4.0.66.69) ... 2021-09-15T21:59:58.347 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.84.88_amd64.deb ... 2021-09-15T21:59:58.474 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-image-generic (5.4.0.84.88) over (5.4.0.66.69) ... 2021-09-15T21:59:58.829 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-headers-5.4.0-84. 2021-09-15T21:59:58.843 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../5-linux-headers-5.4.0-84_5.4.0-84.94_all.deb ... 2021-09-15T21:59:58.881 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-headers-5.4.0-84 (5.4.0-84.94) ... 2021-09-15T22:00:05.874 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-headers-5.4.0-84-generic. 2021-09-15T22:00:05.895 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../6-linux-headers-5.4.0-84-generic_5.4.0-84.94_amd64.deb ... 2021-09-15T22:00:05.932 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-headers-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T22:00:08.682 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.84.88_amd64.deb ... 2021-09-15T22:00:08.834 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-headers-generic (5.4.0.84.88) over (5.4.0.66.69) ... 2021-09-15T22:00:09.159 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-headers-5.4.0-84 (5.4.0-84.94) ... 2021-09-15T22:00:09.280 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-modules-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T22:00:10.457 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-headers-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T22:00:10.583 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-headers-generic (5.4.0.84.88) ... 2021-09-15T22:00:10.708 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-image-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T22:00:11.848 INFO:teuthology.orchestra.run.smithi184.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-84-generic 2021-09-15T22:00:11.848 INFO:teuthology.orchestra.run.smithi184.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-84-generic 2021-09-15T22:00:12.002 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-modules-extra-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T22:00:13.296 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-image-generic (5.4.0.84.88) ... 2021-09-15T22:00:13.397 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-generic (5.4.0.84.88) ... 2021-09-15T22:00:13.531 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for linux-image-5.4.0-84-generic (5.4.0-84.94) ... 2021-09-15T22:00:13.713 INFO:teuthology.orchestra.run.smithi184.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-09-15T22:00:13.714 INFO:teuthology.orchestra.run.smithi184.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-84-generic 2021-09-15T22:00:35.738 INFO:teuthology.orchestra.run.smithi184.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-09-15T22:00:35.739 INFO:teuthology.orchestra.run.smithi184.stdout:Sourcing file `/etc/default/grub' 2021-09-15T22:00:35.761 INFO:teuthology.orchestra.run.smithi184.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-09-15T22:00:35.785 INFO:teuthology.orchestra.run.smithi184.stdout:Generating grub configuration file ... 2021-09-15T22:00:36.092 INFO:teuthology.orchestra.run.smithi184.stdout:Found linux image: /boot/vmlinuz-5.4.0-84-generic 2021-09-15T22:00:36.124 INFO:teuthology.orchestra.run.smithi184.stdout:Found initrd image: /boot/initrd.img-5.4.0-84-generic 2021-09-15T22:00:36.513 INFO:teuthology.orchestra.run.smithi184.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-09-15T22:00:36.524 INFO:teuthology.orchestra.run.smithi184.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-09-15T22:00:39.045 INFO:teuthology.orchestra.run.smithi184.stdout:done 2021-09-15T22:00:39.432 DEBUG:teuthology.orchestra.run.smithi184:> dpkg -s linux-image-generic 2021-09-15T22:00:39.465 INFO:teuthology.orchestra.run.smithi184.stdout:Package: linux-image-generic 2021-09-15T22:00:39.465 INFO:teuthology.orchestra.run.smithi184.stdout:Status: install ok installed 2021-09-15T22:00:39.466 INFO:teuthology.orchestra.run.smithi184.stdout:Priority: optional 2021-09-15T22:00:39.466 INFO:teuthology.orchestra.run.smithi184.stdout:Section: kernel 2021-09-15T22:00:39.466 INFO:teuthology.orchestra.run.smithi184.stdout:Installed-Size: 18 2021-09-15T22:00:39.466 INFO:teuthology.orchestra.run.smithi184.stdout:Maintainer: Ubuntu Kernel Team 2021-09-15T22:00:39.467 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: amd64 2021-09-15T22:00:39.467 INFO:teuthology.orchestra.run.smithi184.stdout:Source: linux-meta 2021-09-15T22:00:39.467 INFO:teuthology.orchestra.run.smithi184.stdout:Version: 5.4.0.84.88 2021-09-15T22:00:39.467 INFO:teuthology.orchestra.run.smithi184.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-09-15T22:00:39.468 INFO:teuthology.orchestra.run.smithi184.stdout:Depends: linux-image-5.4.0-84-generic, linux-modules-extra-5.4.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2021-09-15T22:00:39.468 INFO:teuthology.orchestra.run.smithi184.stdout:Recommends: thermald 2021-09-15T22:00:39.468 INFO:teuthology.orchestra.run.smithi184.stdout:Description: Generic Linux kernel image 2021-09-15T22:00:39.468 INFO:teuthology.orchestra.run.smithi184.stdout: This package will always depend on the latest generic kernel image 2021-09-15T22:00:39.468 INFO:teuthology.orchestra.run.smithi184.stdout: available. 2021-09-15T22:00:39.469 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-66-generic Expected: 5.4.0-84-generic 2021-09-15T22:00:39.469 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-09-15T22:00:39.470 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-09-15T22:00:39.470 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-09-15T22:00:39.470 INFO:teuthology.task.kernel:Installing distro kernel on c1.mon.a... 2021-09-15T22:00:39.470 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi180.front.sepia.ceph.com, path=None, version=distro) 2021-09-15T22:00:39.471 DEBUG:teuthology.orchestra.run.smithi180:> sudo apt-get clean 2021-09-15T22:00:39.600 DEBUG:teuthology.orchestra.run.smithi180:> sudo apt-get update 2021-09-15T22:00:39.767 INFO:teuthology.orchestra.run.smithi180.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-09-15T22:00:39.873 INFO:teuthology.orchestra.run.smithi180.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-09-15T22:00:39.955 INFO:teuthology.orchestra.run.smithi180.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-09-15T22:00:40.038 INFO:teuthology.orchestra.run.smithi180.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-09-15T22:00:41.262 INFO:teuthology.orchestra.run.smithi180.stdout:Reading package lists... 2021-09-15T22:00:41.285 DEBUG:teuthology.orchestra.run.smithi180:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-09-15T22:00:41.349 INFO:teuthology.orchestra.run.smithi180.stdout:Reading package lists... 2021-09-15T22:00:41.511 INFO:teuthology.orchestra.run.smithi180.stdout:Building dependency tree... 2021-09-15T22:00:41.512 INFO:teuthology.orchestra.run.smithi180.stdout:Reading state information... 2021-09-15T22:00:41.533 INFO:teuthology.orchestra.run.smithi180.stderr:E: Unable to locate package linux-image-current-generic 2021-09-15T22:00:41.535 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-09-15T22:00:41.536 DEBUG:teuthology.orchestra.run.smithi180:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-09-15T22:00:41.601 INFO:teuthology.orchestra.run.smithi180.stdout:Reading package lists... 2021-09-15T22:00:41.748 INFO:teuthology.orchestra.run.smithi180.stdout:Building dependency tree... 2021-09-15T22:00:41.749 INFO:teuthology.orchestra.run.smithi180.stdout:Reading state information... 2021-09-15T22:00:41.889 INFO:teuthology.orchestra.run.smithi180.stdout:linux-image-generic is already the newest version (5.4.0.84.88). 2021-09-15T22:00:41.890 INFO:teuthology.orchestra.run.smithi180.stdout:0 upgraded, 0 newly installed, 0 to remove and 176 not upgraded. 2021-09-15T22:00:41.891 DEBUG:teuthology.orchestra.run.smithi180:> dpkg -s linux-image-generic 2021-09-15T22:00:41.910 INFO:teuthology.orchestra.run.smithi180.stdout:Package: linux-image-generic 2021-09-15T22:00:41.911 INFO:teuthology.orchestra.run.smithi180.stdout:Status: install ok installed 2021-09-15T22:00:41.911 INFO:teuthology.orchestra.run.smithi180.stdout:Priority: optional 2021-09-15T22:00:41.911 INFO:teuthology.orchestra.run.smithi180.stdout:Section: kernel 2021-09-15T22:00:41.912 INFO:teuthology.orchestra.run.smithi180.stdout:Installed-Size: 18 2021-09-15T22:00:41.912 INFO:teuthology.orchestra.run.smithi180.stdout:Maintainer: Ubuntu Kernel Team 2021-09-15T22:00:41.912 INFO:teuthology.orchestra.run.smithi180.stdout:Architecture: amd64 2021-09-15T22:00:41.912 INFO:teuthology.orchestra.run.smithi180.stdout:Source: linux-meta 2021-09-15T22:00:41.912 INFO:teuthology.orchestra.run.smithi180.stdout:Version: 5.4.0.84.88 2021-09-15T22:00:41.913 INFO:teuthology.orchestra.run.smithi180.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-09-15T22:00:41.913 INFO:teuthology.orchestra.run.smithi180.stdout:Depends: linux-image-5.4.0-84-generic, linux-modules-extra-5.4.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2021-09-15T22:00:41.913 INFO:teuthology.orchestra.run.smithi180.stdout:Recommends: thermald 2021-09-15T22:00:41.914 INFO:teuthology.orchestra.run.smithi180.stdout:Description: Generic Linux kernel image 2021-09-15T22:00:41.914 INFO:teuthology.orchestra.run.smithi180.stdout: This package will always depend on the latest generic kernel image 2021-09-15T22:00:41.914 INFO:teuthology.orchestra.run.smithi180.stdout: available. 2021-09-15T22:00:41.915 DEBUG:teuthology.orchestra.run.smithi180:> mktemp 2021-09-15T22:00:41.920 INFO:teuthology.orchestra.run.smithi180.stdout:/tmp/tmp.yk670kjjMH 2021-09-15T22:00:41.920 DEBUG:teuthology.orchestra.run.smithi180:> sudo cp /boot/grub/grub.cfg /tmp/tmp.yk670kjjMH 2021-09-15T22:00:41.978 DEBUG:teuthology.orchestra.run.smithi180:> sudo chmod 0666 /tmp/tmp.yk670kjjMH 2021-09-15T22:00:42.013 DEBUG:teuthology.orchestra.remote:smithi180:/tmp/tmp.yk670kjjMH is 8KB 2021-09-15T22:00:42.028 DEBUG:teuthology.orchestra.run.smithi180:> rm -fr /tmp/tmp.yk670kjjMH 2021-09-15T22:00:42.035 DEBUG:teuthology.orchestra.run.smithi180:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-09-15T22:00:42.093 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:00:42.093 DEBUG:teuthology.orchestra.run.smithi180:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-09-15T22:00:42.094 DEBUG:teuthology.orchestra.run.smithi180:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-09-15T22:00:42.141 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-84-generic 2021-09-15T22:00:42.141 DEBUG:teuthology.orchestra.run.smithi180:> sudo update-grub 2021-09-15T22:00:43.254 INFO:teuthology.orchestra.run.smithi180.stderr:Sourcing file `/etc/default/grub' 2021-09-15T22:00:43.255 INFO:teuthology.orchestra.run.smithi180.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-09-15T22:00:43.273 INFO:teuthology.orchestra.run.smithi180.stderr:Generating grub configuration file ... 2021-09-15T22:00:43.501 INFO:teuthology.orchestra.run.smithi180.stderr:Found linux image: /boot/vmlinuz-5.4.0-84-generic 2021-09-15T22:00:43.512 INFO:teuthology.orchestra.run.smithi180.stderr:Found initrd image: /boot/initrd.img-5.4.0-84-generic 2021-09-15T22:00:43.888 INFO:teuthology.orchestra.run.smithi180.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-09-15T22:00:43.899 INFO:teuthology.orchestra.run.smithi180.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-09-15T22:00:45.527 INFO:teuthology.orchestra.run.smithi180.stderr:done 2021-09-15T22:00:45.528 DEBUG:teuthology.orchestra.run.smithi180:> sudo shutdown -r now 2021-09-15T22:00:45.531 INFO:teuthology.task.kernel:Installing distro kernel on c2.mon.a... 2021-09-15T22:00:45.531 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi184.front.sepia.ceph.com, path=None, version=distro) 2021-09-15T22:00:45.532 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get clean 2021-09-15T22:00:45.602 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get update 2021-09-15T22:00:45.735 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-09-15T22:00:45.853 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-09-15T22:00:45.940 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-09-15T22:00:46.027 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-09-15T22:00:47.203 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2021-09-15T22:00:47.226 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-09-15T22:00:47.292 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2021-09-15T22:00:47.447 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2021-09-15T22:00:47.448 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2021-09-15T22:00:47.467 INFO:teuthology.orchestra.run.smithi184.stderr:E: Unable to locate package linux-image-current-generic 2021-09-15T22:00:47.468 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-09-15T22:00:47.469 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-09-15T22:00:47.538 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2021-09-15T22:00:47.705 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2021-09-15T22:00:47.705 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2021-09-15T22:00:47.862 INFO:teuthology.orchestra.run.smithi184.stdout:linux-image-generic is already the newest version (5.4.0.84.88). 2021-09-15T22:00:47.863 INFO:teuthology.orchestra.run.smithi184.stdout:0 upgraded, 0 newly installed, 0 to remove and 176 not upgraded. 2021-09-15T22:00:47.865 DEBUG:teuthology.orchestra.run.smithi184:> dpkg -s linux-image-generic 2021-09-15T22:00:47.878 INFO:teuthology.orchestra.run.smithi184.stdout:Package: linux-image-generic 2021-09-15T22:00:47.879 INFO:teuthology.orchestra.run.smithi184.stdout:Status: install ok installed 2021-09-15T22:00:47.879 INFO:teuthology.orchestra.run.smithi184.stdout:Priority: optional 2021-09-15T22:00:47.879 INFO:teuthology.orchestra.run.smithi184.stdout:Section: kernel 2021-09-15T22:00:47.879 INFO:teuthology.orchestra.run.smithi184.stdout:Installed-Size: 18 2021-09-15T22:00:47.880 INFO:teuthology.orchestra.run.smithi184.stdout:Maintainer: Ubuntu Kernel Team 2021-09-15T22:00:47.880 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: amd64 2021-09-15T22:00:47.880 INFO:teuthology.orchestra.run.smithi184.stdout:Source: linux-meta 2021-09-15T22:00:47.880 INFO:teuthology.orchestra.run.smithi184.stdout:Version: 5.4.0.84.88 2021-09-15T22:00:47.881 INFO:teuthology.orchestra.run.smithi184.stdout:Provides: virtualbox-guest-modules (= 6.1.22-dfsg-2~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-09-15T22:00:47.881 INFO:teuthology.orchestra.run.smithi184.stdout:Depends: linux-image-5.4.0-84-generic, linux-modules-extra-5.4.0-84-generic, linux-firmware, intel-microcode, amd64-microcode 2021-09-15T22:00:47.881 INFO:teuthology.orchestra.run.smithi184.stdout:Recommends: thermald 2021-09-15T22:00:47.881 INFO:teuthology.orchestra.run.smithi184.stdout:Description: Generic Linux kernel image 2021-09-15T22:00:47.882 INFO:teuthology.orchestra.run.smithi184.stdout: This package will always depend on the latest generic kernel image 2021-09-15T22:00:47.882 INFO:teuthology.orchestra.run.smithi184.stdout: available. 2021-09-15T22:00:47.882 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2021-09-15T22:00:47.887 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.FkgGk8eyEY 2021-09-15T22:00:47.887 DEBUG:teuthology.orchestra.run.smithi184:> sudo cp /boot/grub/grub.cfg /tmp/tmp.FkgGk8eyEY 2021-09-15T22:00:47.944 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.FkgGk8eyEY 2021-09-15T22:00:47.975 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.FkgGk8eyEY is 8KB 2021-09-15T22:00:47.989 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.FkgGk8eyEY 2021-09-15T22:00:47.996 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-09-15T22:00:48.050 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:00:48.051 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-09-15T22:00:48.051 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-09-15T22:00:48.101 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-84-generic 2021-09-15T22:00:48.102 DEBUG:teuthology.orchestra.run.smithi184:> sudo update-grub 2021-09-15T22:00:49.349 INFO:teuthology.orchestra.run.smithi184.stderr:Sourcing file `/etc/default/grub' 2021-09-15T22:00:49.359 INFO:teuthology.orchestra.run.smithi184.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-09-15T22:00:49.375 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2021-09-15T22:00:49.626 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-5.4.0-84-generic 2021-09-15T22:00:49.637 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-5.4.0-84-generic 2021-09-15T22:00:49.974 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-09-15T22:00:49.986 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-09-15T22:00:51.601 INFO:teuthology.orchestra.run.smithi184.stderr:done 2021-09-15T22:00:51.603 DEBUG:teuthology.orchestra.run.smithi184:> sudo shutdown -r now 2021-09-15T22:01:21.637 INFO:teuthology.misc:Re-opening connections... 2021-09-15T22:01:21.637 INFO:teuthology.misc:trying to connect to ubuntu@smithi180.front.sepia.ceph.com 2021-09-15T22:01:21.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-09-15T22:01:21.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-09-15T22:01:40.043 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.180 2021-09-15T22:01:40.044 INFO:teuthology.misc:trying to connect to ubuntu@smithi184.front.sepia.ceph.com 2021-09-15T22:01:40.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-09-15T22:01:40.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-09-15T22:02:40.107 DEBUG:teuthology.orchestra.remote:timed out 2021-09-15T22:02:40.109 DEBUG:teuthology.misc:waited 78.47119116783142 2021-09-15T22:02:41.110 INFO:teuthology.misc:trying to connect to ubuntu@smithi180.front.sepia.ceph.com 2021-09-15T22:02:41.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-09-15T22:02:41.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-09-15T22:02:41.364 DEBUG:teuthology.orchestra.run.smithi180:> true 2021-09-15T22:02:41.937 DEBUG:teuthology.misc:waited 80.299880027771 2021-09-15T22:02:42.939 INFO:teuthology.misc:trying to connect to ubuntu@smithi184.front.sepia.ceph.com 2021-09-15T22:02:42.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-09-15T22:02:42.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-09-15T22:02:43.142 DEBUG:teuthology.orchestra.run.smithi184:> true 2021-09-15T22:02:43.692 DEBUG:teuthology.misc:waited 82.05438995361328 2021-09-15T22:02:44.693 INFO:teuthology.task.kernel:Checking client c1.mon.a for new kernel version... 2021-09-15T22:02:44.694 INFO:teuthology.task.kernel:Checking kernel version of c1.mon.a, want "5.4.0-84-generic"... 2021-09-15T22:02:44.694 DEBUG:teuthology.orchestra.run.smithi180:> uname -r 2021-09-15T22:02:44.702 INFO:teuthology.orchestra.run.smithi180.stdout:5.4.0-84-generic 2021-09-15T22:02:44.703 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-84-generic vs 5.4.0-84-generic 2021-09-15T22:02:44.703 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-09-15T22:02:44.703 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-09-15T22:02:44.704 INFO:teuthology.task.kernel:Checking client c2.mon.a for new kernel version... 2021-09-15T22:02:44.704 INFO:teuthology.task.kernel:Checking kernel version of c2.mon.a, want "5.4.0-84-generic"... 2021-09-15T22:02:44.704 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2021-09-15T22:02:44.711 INFO:teuthology.orchestra.run.smithi184.stdout:5.4.0-84-generic 2021-09-15T22:02:44.711 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-84-generic vs 5.4.0-84-generic 2021-09-15T22:02:44.711 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-09-15T22:02:44.712 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-09-15T22:02:45.713 INFO:teuthology.task.kernel:Enabling kdb on c1.mon.a... 2021-09-15T22:02:45.713 DEBUG:teuthology.orchestra.run.smithi180:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-09-15T22:02:45.800 INFO:teuthology.orchestra.run.smithi180.stdout:ttyS1 2021-09-15T22:02:45.823 INFO:teuthology.task.kernel:Enabling kdb on c2.mon.a... 2021-09-15T22:02:45.823 DEBUG:teuthology.orchestra.run.smithi184:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-09-15T22:02:45.890 INFO:teuthology.orchestra.run.smithi184.stdout:ttyS1 2021-09-15T22:02:45.922 INFO:teuthology.run_tasks:Running task internal.base... 2021-09-15T22:02:45.932 INFO:teuthology.task.internal:Creating test directory... 2021-09-15T22:02:45.933 DEBUG:teuthology.orchestra.run.smithi180:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-09-15T22:02:45.935 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-09-15T22:02:45.943 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-09-15T22:02:45.982 INFO:teuthology.run_tasks:Running task internal.archive... 2021-09-15T22:02:46.014 INFO:teuthology.task.internal:Creating archive directory... 2021-09-15T22:02:46.014 DEBUG:teuthology.orchestra.run.smithi180:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-09-15T22:02:46.017 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-09-15T22:02:46.044 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-09-15T22:02:46.054 INFO:teuthology.task.internal:Enabling coredump saving... 2021-09-15T22:02:46.054 DEBUG:teuthology.orchestra.run.smithi180:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-09-15T22:02:46.074 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-09-15T22:02:46.095 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-09-15T22:02:46.101 INFO:teuthology.orchestra.run.smithi180.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-09-15T22:02:46.106 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-09-15T22:02:46.112 INFO:teuthology.orchestra.run.smithi180.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-09-15T22:02:46.114 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-09-15T22:02:46.123 INFO:teuthology.task.internal:Configuring sudo... 2021-09-15T22:02:46.124 DEBUG:teuthology.orchestra.run.smithi180:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-09-15T22:02:46.126 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-09-15T22:02:46.141 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-09-15T22:02:46.151 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-09-15T22:02:46.152 DEBUG:teuthology.orchestra.run.smithi180:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-09-15T22:02:46.178 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-09-15T22:02:46.189 DEBUG:teuthology.orchestra.run.smithi180:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-09-15T22:02:46.195 DEBUG:teuthology.orchestra.run.smithi180:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-09-15T22:02:46.202 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:02:46.203 DEBUG:teuthology.orchestra.run.smithi180:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-09-15T22:02:46.280 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-09-15T22:02:46.287 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-09-15T22:02:46.294 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:02:46.295 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-09-15T22:02:46.354 DEBUG:teuthology.orchestra.run.smithi180:> sudo service rsyslog restart 2021-09-15T22:02:46.357 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2021-09-15T22:02:46.407 INFO:teuthology.run_tasks:Running task internal.timer... 2021-09-15T22:02:46.417 INFO:teuthology.task.internal:Starting timer... 2021-09-15T22:02:46.417 INFO:teuthology.run_tasks:Running task pcp... 2021-09-15T22:02:46.467 INFO:teuthology.run_tasks:Running task selinux... 2021-09-15T22:02:46.499 DEBUG:teuthology.task.selinux:Excluding smithi180: OS 'ubuntu' does not support SELinux 2021-09-15T22:02:46.500 DEBUG:teuthology.task.selinux:Excluding smithi184: OS 'ubuntu' does not support SELinux 2021-09-15T22:02:46.500 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-09-15T22:02:46.501 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-09-15T22:02:46.501 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-09-15T22:02:46.501 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-09-15T22:02:46.533 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-09-15T22:02:46.534 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-09-15T22:02:46.553 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-09-15T22:02:46.555 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi180.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-09-15T22:02:46.922 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-09-15T22:02:47.712 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-09-15T22:02:50.516 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-09-15T22:02:50.540 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:50 +0000 (0:00:00.041) 0:00:00.041 *** 2021-09-15T22:02:50.554 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:50 +0000 (0:00:00.014) 0:00:00.055 *** 2021-09-15T22:02:52.852 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-09-15T22:02:52.854 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi180.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi180.front.sepia.ceph.com] 2021-09-15T22:02:52.905 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:52 +0000 (0:00:02.350) 0:00:02.406 *** 2021-09-15T22:02:52.930 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi184.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi184.front.sepia.ceph.com] 2021-09-15T22:02:52.982 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:52 +0000 (0:00:00.077) 0:00:02.484 *** 2021-09-15T22:02:53.123 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-09-15T22:02:53.125 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-09-15T22:02:53.147 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:53 +0000 (0:00:00.164) 0:00:02.648 *** 2021-09-15T22:02:53.166 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:53 +0000 (0:00:00.019) 0:00:02.668 *** 2021-09-15T22:02:53.627 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-09-15T22:02:53.629 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} ok: [smithi180.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-09-15T22:02:53.652 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:53 +0000 (0:00:00.485) 0:00:03.153 *** 2021-09-15T22:02:53.672 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:53 +0000 (0:00:00.020) 0:00:03.174 *** 2021-09-15T22:02:53.720 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-09-15T22:02:53.722 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:02:53.744 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:53 +0000 (0:00:00.071) 0:00:03.245 *** 2021-09-15T22:02:53.751 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:02:53.777 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:53 +0000 (0:00:00.032) 0:00:03.278 *** 2021-09-15T22:02:53.948 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-09-15T22:02:53.950 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-09-15T22:02:53.973 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:53 +0000 (0:00:00.195) 0:00:03.474 *** 2021-09-15T22:02:53.979 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-09-15T22:02:54.004 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:53 +0000 (0:00:00.031) 0:00:03.506 *** 2021-09-15T22:02:54.548 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-09-15T22:02:54.550 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-09-15T22:02:54.572 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:54 +0000 (0:00:00.567) 0:00:04.073 *** 2021-09-15T22:02:54.592 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:54 +0000 (0:00:00.020) 0:00:04.094 *** 2021-09-15T22:02:54.909 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-09-15T22:02:54.911 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-09-15T22:02:54.913 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-09-15T22:02:54.937 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-09-15T22:02:54.939 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-09-15T22:02:55.015 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-09-15T22:02:55.016 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-09-15T22:02:55.031 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Wednesday 15 September 2021 22:02:55 +0000 (0:00:00.438) 0:00:04.532 *** 2021-09-15T22:02:55.717 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] 2021-09-15T22:02:55.748 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] 2021-09-15T22:02:55.768 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** 2021-09-15T22:02:55.770 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:55 +0000 (0:00:00.737) 0:00:05.270 *** 2021-09-15T22:02:55.795 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-09-15T22:02:55.806 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-09-15T22:02:55.811 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-09-15T22:02:55.966 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:55 +0000 (0:00:00.197) 0:00:05.467 *** 2021-09-15T22:02:55.988 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:55 +0000 (0:00:00.021) 0:00:05.489 *** 2021-09-15T22:02:56.841 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi180.front.sepia.ceph.com] 2021-09-15T22:02:56.875 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] 2021-09-15T22:02:56.908 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-09-15T22:02:56.910 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:56 +0000 (0:00:00.920) 0:00:06.409 *** 2021-09-15T22:02:56.958 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:56 +0000 (0:00:00.049) 0:00:06.459 *** 2021-09-15T22:02:57.537 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi184.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.186420", "end": "2021-09-15 22:02:57.515673", "rc": 0, "start": "2021-09-15 22:02:57.329253", "stderr": "", "stderr_lines": [], "stdout": "39f530053dd0894c844c464d403644cc64956570", "stdout_lines": ["39f530053dd0894c844c464d403644cc64956570"]} 2021-09-15T22:02:57.538 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.186325", "end": "2021-09-15 22:02:57.515740", "rc": 0, "start": "2021-09-15 22:02:57.329415", "stderr": "", "stderr_lines": [], "stdout": "39f530053dd0894c844c464d403644cc64956570", "stdout_lines": ["39f530053dd0894c844c464d403644cc64956570"]} 2021-09-15T22:02:57.562 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:57 +0000 (0:00:00.603) 0:00:07.063 *** 2021-09-15T22:02:57.588 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:57 +0000 (0:00:00.025) 0:00:07.089 *** 2021-09-15T22:02:57.709 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-09-15T22:02:57.711 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011794", "end": "2021-09-15 22:02:57.599394", "failed_when_result": false, "rc": 0, "start": "2021-09-15 22:02:57.587600", "stderr": "", "stderr_lines": [], "stdout": "c29274177b79f72740fc714fa28b55400cd0737f", "stdout_lines": ["c29274177b79f72740fc714fa28b55400cd0737f"]} 2021-09-15T22:02:57.735 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:57 +0000 (0:00:00.147) 0:00:07.236 *** 2021-09-15T22:02:57.742 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013540", "end": "2021-09-15 22:02:57.331856", "failed_when_result": false, "rc": 0, "start": "2021-09-15 22:02:57.318316", "stderr": "", "stderr_lines": [], "stdout": "c29274177b79f72740fc714fa28b55400cd0737f", "stdout_lines": ["c29274177b79f72740fc714fa28b55400cd0737f"]} 2021-09-15T22:02:57.767 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:57 +0000 (0:00:00.032) 0:00:07.269 *** 2021-09-15T22:02:57.794 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-09-15T22:02:57.796 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:02:57.820 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:57 +0000 (0:00:00.052) 0:00:07.321 *** 2021-09-15T22:02:57.837 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:02:57.862 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:57 +0000 (0:00:00.042) 0:00:07.363 *** 2021-09-15T22:02:57.888 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-09-15T22:02:57.890 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:02:57.914 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:57 +0000 (0:00:00.051) 0:00:07.415 *** 2021-09-15T22:02:57.930 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:02:57.955 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:57 +0000 (0:00:00.041) 0:00:07.457 *** 2021-09-15T22:02:57.982 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-09-15T22:02:57.984 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:02:58.007 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:58 +0000 (0:00:00.052) 0:00:07.509 *** 2021-09-15T22:02:58.024 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:02:58.049 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:58 +0000 (0:00:00.041) 0:00:07.550 *** 2021-09-15T22:02:58.076 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-09-15T22:02:58.078 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:02:58.100 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:58 +0000 (0:00:00.050) 0:00:07.601 *** 2021-09-15T22:02:58.126 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:02:58.150 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:58 +0000 (0:00:00.050) 0:00:07.652 *** 2021-09-15T22:02:58.167 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-09-15T22:02:58.168 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:02:58.193 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:58 +0000 (0:00:00.041) 0:00:07.693 *** 2021-09-15T22:02:58.230 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:02:58.258 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:58 +0000 (0:00:00.065) 0:00:07.759 *** 2021-09-15T22:02:58.378 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-09-15T22:02:58.380 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-09-15T22:02:58.403 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:58 +0000 (0:00:00.145) 0:00:07.904 *** 2021-09-15T22:02:58.431 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-09-15T22:02:58.456 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:02:58 +0000 (0:00:00.052) 0:00:07.957 *** 2021-09-15T22:02:58.638 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-09-15T22:02:58.701 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-09-15T22:02:58.776 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-09-15T22:02:58.850 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-09-15T22:02:58.923 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-09-15T22:02:58.997 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-09-15T22:02:59.060 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-09-15T22:02:59.134 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-09-15T22:02:59.197 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-09-15T22:02:59.280 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-09-15T22:02:59.343 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-09-15T22:02:59.428 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-09-15T22:02:59.491 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-09-15T22:02:59.565 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-09-15T22:02:59.628 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-09-15T22:02:59.712 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-09-15T22:02:59.765 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-09-15T22:02:59.860 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-09-15T22:02:59.913 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-09-15T22:02:59.997 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-09-15T22:03:00.051 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-09-15T22:03:00.145 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-09-15T22:03:00.198 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-09-15T22:03:00.282 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-09-15T22:03:00.335 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-09-15T22:03:00.430 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-09-15T22:03:00.472 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-09-15T22:03:00.557 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-09-15T22:03:00.620 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-09-15T22:03:00.705 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-09-15T22:03:00.758 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-09-15T22:03:00.853 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-09-15T22:03:00.906 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-09-15T22:03:01.001 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-09-15T22:03:01.054 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-09-15T22:03:01.138 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-09-15T22:03:01.192 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-09-15T22:03:01.286 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-09-15T22:03:01.328 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-09-15T22:03:01.422 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-09-15T22:03:01.465 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-09-15T22:03:01.570 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-09-15T22:03:01.612 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-09-15T22:03:01.709 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-09-15T22:03:01.763 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-09-15T22:03:01.857 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-09-15T22:03:01.899 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-09-15T22:03:01.994 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-09-15T22:03:02.047 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-09-15T22:03:02.143 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-09-15T22:03:02.186 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-09-15T22:03:02.280 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-09-15T22:03:02.334 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-09-15T22:03:02.429 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-09-15T22:03:02.484 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-09-15T22:03:02.568 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-09-15T22:03:02.642 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-09-15T22:03:02.726 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-09-15T22:03:02.789 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-09-15T22:03:02.862 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-09-15T22:03:02.925 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-09-15T22:03:03.003 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-09-15T22:03:03.077 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-09-15T22:03:03.150 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-09-15T22:03:03.213 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-09-15T22:03:03.298 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-09-15T22:03:03.361 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-09-15T22:03:03.435 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-09-15T22:03:03.509 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-09-15T22:03:03.582 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-09-15T22:03:03.657 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-09-15T22:03:03.720 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-09-15T22:03:03.794 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-09-15T22:03:03.868 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-09-15T22:03:03.941 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-09-15T22:03:04.015 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-09-15T22:03:04.089 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-09-15T22:03:04.162 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-09-15T22:03:04.226 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-09-15T22:03:04.313 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-09-15T22:03:04.367 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-09-15T22:03:04.452 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-09-15T22:03:04.515 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-09-15T22:03:04.599 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-09-15T22:03:04.666 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-09-15T22:03:04.749 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-09-15T22:03:04.803 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-09-15T22:03:04.888 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-09-15T22:03:04.941 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-09-15T22:03:05.032 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-09-15T22:03:05.085 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-09-15T22:03:05.179 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-09-15T22:03:05.222 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-09-15T22:03:05.326 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-09-15T22:03:05.369 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-09-15T22:03:05.474 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-09-15T22:03:05.516 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-09-15T22:03:05.621 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-09-15T22:03:05.654 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-09-15T22:03:05.768 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-09-15T22:03:05.801 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-09-15T22:03:05.916 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-09-15T22:03:05.947 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-09-15T22:03:06.052 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-09-15T22:03:06.094 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-09-15T22:03:06.188 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-09-15T22:03:06.231 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-09-15T22:03:06.335 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-09-15T22:03:06.378 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-09-15T22:03:06.485 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-09-15T22:03:06.517 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-09-15T22:03:06.625 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-09-15T22:03:06.668 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-09-15T22:03:06.773 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-09-15T22:03:06.806 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-09-15T22:03:06.911 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-09-15T22:03:06.954 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-09-15T22:03:07.059 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-09-15T22:03:07.092 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-09-15T22:03:07.208 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-09-15T22:03:07.241 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-09-15T22:03:07.347 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-09-15T22:03:07.468 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-09-15T22:03:07.495 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-09-15T22:03:07.538 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-09-15T22:03:07.643 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-09-15T22:03:07.685 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-09-15T22:03:07.780 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-09-15T22:03:07.823 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-09-15T22:03:07.917 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-09-15T22:03:07.969 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-09-15T22:03:08.064 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-09-15T22:03:08.107 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-09-15T22:03:08.211 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-09-15T22:03:08.254 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-09-15T22:03:08.348 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-09-15T22:03:08.402 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-09-15T22:03:08.496 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-09-15T22:03:08.538 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-09-15T22:03:08.633 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-09-15T22:03:08.686 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-09-15T22:03:08.781 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-09-15T22:03:08.844 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-09-15T22:03:08.928 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-09-15T22:03:08.992 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-09-15T22:03:09.077 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-09-15T22:03:09.140 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-09-15T22:03:09.214 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-09-15T22:03:09.278 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-09-15T22:03:09.364 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-09-15T22:03:09.428 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-09-15T22:03:09.501 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-09-15T22:03:09.574 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-09-15T22:03:09.648 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-09-15T22:03:09.711 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-09-15T22:03:09.795 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-09-15T22:03:09.860 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-09-15T22:03:09.936 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-09-15T22:03:10.002 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-09-15T22:03:10.077 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-09-15T22:03:10.141 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-09-15T22:03:10.226 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-09-15T22:03:10.291 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-09-15T22:03:10.365 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-09-15T22:03:10.420 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-09-15T22:03:10.505 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-09-15T22:03:10.568 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-09-15T22:03:10.652 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-09-15T22:03:10.717 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-09-15T22:03:10.801 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-09-15T22:03:10.854 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-09-15T22:03:10.939 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-09-15T22:03:11.002 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-09-15T22:03:11.087 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-09-15T22:03:11.140 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-09-15T22:03:11.235 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-09-15T22:03:11.277 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-09-15T22:03:11.372 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-09-15T22:03:11.425 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-09-15T22:03:11.519 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-09-15T22:03:11.572 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-09-15T22:03:11.656 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-09-15T22:03:11.708 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-09-15T22:03:11.802 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-09-15T22:03:11.855 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-09-15T22:03:11.949 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-09-15T22:03:12.002 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-09-15T22:03:12.096 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-09-15T22:03:12.149 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-09-15T22:03:12.243 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-09-15T22:03:12.296 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-09-15T22:03:12.390 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-09-15T22:03:12.445 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-09-15T22:03:12.529 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-09-15T22:03:12.583 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-09-15T22:03:12.678 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-09-15T22:03:12.721 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-09-15T22:03:12.816 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-09-15T22:03:12.869 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-09-15T22:03:12.964 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-09-15T22:03:13.017 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-09-15T22:03:13.114 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-09-15T22:03:13.157 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-09-15T22:03:13.262 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-09-15T22:03:13.295 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-09-15T22:03:13.400 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-09-15T22:03:13.442 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-09-15T22:03:13.547 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-09-15T22:03:13.580 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-09-15T22:03:13.695 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-09-15T22:03:13.727 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-09-15T22:03:13.833 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-09-15T22:03:13.866 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-09-15T22:03:13.972 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-09-15T22:03:14.015 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-09-15T22:03:14.120 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-09-15T22:03:14.162 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-09-15T22:03:14.267 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-09-15T22:03:14.299 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-09-15T22:03:14.426 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-09-15T22:03:14.448 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-09-15T22:03:14.564 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-09-15T22:03:14.599 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-09-15T22:03:14.716 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-09-15T22:03:14.738 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-09-15T22:03:14.854 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-09-15T22:03:14.887 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-09-15T22:03:15.003 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-09-15T22:03:15.035 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-09-15T22:03:15.141 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-09-15T22:03:15.173 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-09-15T22:03:15.288 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-09-15T22:03:15.320 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-09-15T22:03:15.425 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-09-15T22:03:15.458 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-09-15T22:03:15.573 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-09-15T22:03:15.606 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-09-15T22:03:15.711 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-09-15T22:03:15.743 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-09-15T22:03:15.858 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-09-15T22:03:15.890 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-09-15T22:03:16.006 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-09-15T22:03:16.028 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-09-15T22:03:16.152 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-09-15T22:03:16.164 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-09-15T22:03:16.289 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-09-15T22:03:16.311 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-09-15T22:03:16.435 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-09-15T22:03:16.457 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-09-15T22:03:16.583 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-09-15T22:03:16.595 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-09-15T22:03:16.720 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-09-15T22:03:16.731 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-09-15T22:03:16.867 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-09-15T22:03:16.879 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-09-15T22:03:17.004 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-09-15T22:03:17.015 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-09-15T22:03:17.151 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-09-15T22:03:17.162 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-09-15T22:03:17.290 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-09-15T22:03:17.301 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-09-15T22:03:17.437 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-09-15T22:03:17.449 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-09-15T22:03:17.578 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-09-15T22:03:17.590 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-09-15T22:03:17.725 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-09-15T22:03:17.737 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-09-15T22:03:17.862 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-09-15T22:03:17.873 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-09-15T22:03:18.002 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-09-15T22:03:18.026 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-09-15T22:03:18.152 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-09-15T22:03:18.164 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-09-15T22:03:18.290 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-09-15T22:03:18.302 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-09-15T22:03:18.438 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-09-15T22:03:18.450 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-09-15T22:03:18.576 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-09-15T22:03:18.587 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-09-15T22:03:18.724 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-09-15T22:03:18.735 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-09-15T22:03:18.861 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-09-15T22:03:18.884 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-09-15T22:03:19.010 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-09-15T22:03:19.022 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-09-15T22:03:19.152 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-09-15T22:03:19.164 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-09-15T22:03:19.290 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-09-15T22:03:19.312 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-09-15T22:03:19.438 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-09-15T22:03:19.449 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-09-15T22:03:19.586 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-09-15T22:03:19.597 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-09-15T22:03:19.723 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-09-15T22:03:19.746 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-09-15T22:03:19.871 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-09-15T22:03:19.882 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-09-15T22:03:20.018 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-09-15T22:03:20.552 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10119} 2021-09-15T22:03:20.638 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10119} 2021-09-15T22:03:21.023 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10120} 2021-09-15T22:03:21.108 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10120} 2021-09-15T22:03:21.566 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "name": "xuwang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10121} 2021-09-15T22:03:21.640 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "name": "xuwang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10121} 2021-09-15T22:03:22.120 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "name": "blaine", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10122} 2021-09-15T22:03:22.356 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "name": "blaine", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10122} 2021-09-15T22:03:22.460 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:22 +0000 (0:00:24.004) 0:00:31.961 *** 2021-09-15T22:03:22.482 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:22 +0000 (0:00:00.021) 0:00:31.983 *** 2021-09-15T22:03:22.526 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-09-15T22:03:22.551 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:22 +0000 (0:00:00.068) 0:00:32.052 *** 2021-09-15T22:03:22.583 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:22 +0000 (0:00:00.032) 0:00:32.085 *** 2021-09-15T22:03:22.633 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-09-15T22:03:22.635 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-09-15T22:03:22.637 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-09-15T22:03:22.638 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-09-15T22:03:22.640 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-09-15T22:03:22.641 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-09-15T22:03:22.643 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDe 2021-09-15T22:03:22.645 INFO:teuthology.task.ansible.out:vAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBM 2021-09-15T22:03:22.648 INFO:teuthology.task.ansible.out:gw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmeri 2021-09-15T22:03:22.650 INFO:teuthology.task.ansible.out:cp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361 2021-09-15T22:03:22.651 INFO:teuthology.task.ansible.out:f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9 2021-09-15T22:03:22.653 INFO:teuthology.task.ansible.out:JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa15674 2021-09-15T22:03:22.654 INFO:teuthology.task.ansible.out:32aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": " 2021-09-15T22:03:22.655 INFO:teuthology.task.ansible.out:shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6 2021-09-15T22:03:22.657 INFO:teuthology.task.ansible.out:878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovp 2021-09-15T22:03:22.659 INFO:teuthology.task.ansible.out:n": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-09-15T22:03:22.684 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:22 +0000 (0:00:00.100) 0:00:32.185 *** 2021-09-15T22:03:22.695 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-09-15T22:03:22.697 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-09-15T22:03:22.699 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-09-15T22:03:22.701 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-09-15T22:03:22.703 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-09-15T22:03:22.704 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDe 2021-09-15T22:03:22.706 INFO:teuthology.task.ansible.out:vAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A 2021-09-15T22:03:22.707 INFO:teuthology.task.ansible.out:a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBM 2021-09-15T22:03:22.709 INFO:teuthology.task.ansible.out:gw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmeri 2021-09-15T22:03:22.710 INFO:teuthology.task.ansible.out:cp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361 2021-09-15T22:03:22.712 INFO:teuthology.task.ansible.out:f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9 2021-09-15T22:03:22.714 INFO:teuthology.task.ansible.out:JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67" 2021-09-15T22:03:22.715 INFO:teuthology.task.ansible.out:}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": " 2021-09-15T22:03:22.717 INFO:teuthology.task.ansible.out:shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6 2021-09-15T22:03:22.719 INFO:teuthology.task.ansible.out:878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovp 2021-09-15T22:03:22.721 INFO:teuthology.task.ansible.out:n": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}]}, "changed": false} 2021-09-15T22:03:22.744 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:22 +0000 (0:00:00.060) 0:00:32.246 *** 2021-09-15T22:03:23.424 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-09-15T22:03:23.426 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"after": "39f530053dd0894c844c464d403644cc64956570", "attempts": 1, "before": "39f530053dd0894c844c464d403644cc64956570", "changed": false, "remote_url_changed": false} 2021-09-15T22:03:23.449 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:23 +0000 (0:00:00.704) 0:00:32.950 *** 2021-09-15T22:03:23.695 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-09-15T22:03:23.697 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-09-15T22:03:23.843 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-09-15T22:03:23.896 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi184.front.sepia.ceph.com] => {"after": "39f530053dd0894c844c464d403644cc64956570", "attempts": 1, "before": "39f530053dd0894c844c464d403644cc64956570", "changed": false, "remote_url_changed": false} 2021-09-15T22:03:23.922 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:23 +0000 (0:00:00.472) 0:00:33.423 *** 2021-09-15T22:03:23.971 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-09-15T22:03:23.972 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-09-15T22:03:24.108 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-09-15T22:03:24.110 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-09-15T22:03:24.160 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-09-15T22:03:24.256 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-09-15T22:03:24.298 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-09-15T22:03:24.394 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-09-15T22:03:24.396 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-09-15T22:03:24.447 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-09-15T22:03:24.522 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-09-15T22:03:24.585 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-09-15T22:03:24.587 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-09-15T22:03:24.669 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-09-15T22:03:24.732 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-09-15T22:03:24.795 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-09-15T22:03:24.806 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:24.859 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-09-15T22:03:24.861 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-09-15T22:03:24.933 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-09-15T22:03:24.935 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-09-15T22:03:24.997 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-09-15T22:03:25.072 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-09-15T22:03:25.074 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-09-15T22:03:25.084 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:25.085 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:25.138 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-09-15T22:03:25.222 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-09-15T22:03:25.276 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-09-15T22:03:25.277 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:25.361 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-09-15T22:03:25.363 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-09-15T22:03:25.414 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-09-15T22:03:25.415 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-09-15T22:03:25.497 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-09-15T22:03:25.540 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-09-15T22:03:25.542 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-09-15T22:03:25.551 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:25.552 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:25.626 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-09-15T22:03:25.680 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-09-15T22:03:25.763 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-09-15T22:03:25.827 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-09-15T22:03:25.829 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-09-15T22:03:25.900 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-09-15T22:03:25.902 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-09-15T22:03:25.942 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-09-15T22:03:26.027 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-09-15T22:03:26.029 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-09-15T22:03:26.079 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-09-15T22:03:26.162 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-09-15T22:03:26.205 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-09-15T22:03:26.299 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-09-15T22:03:26.341 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-09-15T22:03:26.343 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-09-15T22:03:26.435 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-09-15T22:03:26.436 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-09-15T22:03:26.477 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-09-15T22:03:26.479 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-09-15T22:03:26.571 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-09-15T22:03:26.603 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-09-15T22:03:26.697 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-09-15T22:03:26.740 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-09-15T22:03:26.833 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-09-15T22:03:26.896 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-09-15T22:03:26.898 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-09-15T22:03:26.970 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-09-15T22:03:27.033 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-09-15T22:03:27.096 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-09-15T22:03:27.190 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-09-15T22:03:27.233 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-09-15T22:03:27.234 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-09-15T22:03:27.327 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-09-15T22:03:27.369 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-09-15T22:03:27.473 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-09-15T22:03:27.495 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-09-15T22:03:27.600 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-09-15T22:03:27.633 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-09-15T22:03:27.739 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-09-15T22:03:27.741 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-09-15T22:03:27.761 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-09-15T22:03:27.887 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-09-15T22:03:27.985 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-09-15T22:03:28.025 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-09-15T22:03:28.027 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-09-15T22:03:28.161 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-09-15T22:03:28.162 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-09-15T22:03:28.308 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-09-15T22:03:28.309 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-09-15T22:03:28.434 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-09-15T22:03:28.436 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-09-15T22:03:28.437 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-09-15T22:03:28.571 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-09-15T22:03:28.583 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-09-15T22:03:28.700 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-09-15T22:03:28.711 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-09-15T22:03:28.836 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-09-15T22:03:28.838 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-09-15T22:03:28.847 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-09-15T22:03:28.973 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-09-15T22:03:28.975 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-09-15T22:03:28.995 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-09-15T22:03:28.997 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-09-15T22:03:29.100 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-09-15T22:03:29.133 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-09-15T22:03:29.134 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-09-15T22:03:29.136 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-09-15T22:03:29.230 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-09-15T22:03:29.262 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-09-15T22:03:29.367 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-09-15T22:03:29.399 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-09-15T22:03:29.514 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-09-15T22:03:29.516 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-09-15T22:03:29.536 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-09-15T22:03:29.650 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-09-15T22:03:29.652 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-09-15T22:03:29.653 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-09-15T22:03:29.661 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-09-15T22:03:29.786 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-09-15T22:03:29.797 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-09-15T22:03:29.912 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-09-15T22:03:29.933 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-09-15T22:03:29.935 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-09-15T22:03:30.041 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-09-15T22:03:30.073 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-09-15T22:03:30.178 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-09-15T22:03:30.199 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-09-15T22:03:30.304 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-09-15T22:03:30.336 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-09-15T22:03:30.338 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-09-15T22:03:30.442 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-09-15T22:03:30.444 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-09-15T22:03:30.464 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-09-15T22:03:30.570 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-09-15T22:03:30.601 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-09-15T22:03:30.706 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-09-15T22:03:30.738 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-09-15T22:03:30.740 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-09-15T22:03:30.833 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-09-15T22:03:30.835 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-09-15T22:03:30.865 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-09-15T22:03:30.962 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-09-15T22:03:30.994 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-09-15T22:03:31.100 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-09-15T22:03:31.121 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-09-15T22:03:31.226 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-09-15T22:03:31.228 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-09-15T22:03:31.259 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-09-15T22:03:31.364 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-09-15T22:03:31.406 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-09-15T22:03:31.490 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-09-15T22:03:31.542 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-09-15T22:03:31.626 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-09-15T22:03:31.669 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-09-15T22:03:31.764 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-09-15T22:03:31.807 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-09-15T22:03:31.932 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-09-15T22:03:31.943 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-09-15T22:03:32.080 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-09-15T22:03:32.082 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-09-15T22:03:32.210 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-09-15T22:03:32.212 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-09-15T22:03:32.346 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-09-15T22:03:32.348 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-09-15T22:03:32.475 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-09-15T22:03:32.612 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-09-15T22:03:32.613 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-09-15T22:03:32.739 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-09-15T22:03:32.761 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-09-15T22:03:32.877 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-09-15T22:03:32.898 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-09-15T22:03:33.003 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-09-15T22:03:33.024 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-09-15T22:03:33.129 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-09-15T22:03:33.171 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-09-15T22:03:33.271 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-09-15T22:03:33.310 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-09-15T22:03:33.404 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-09-15T22:03:33.436 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-09-15T22:03:33.540 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-09-15T22:03:33.573 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-09-15T22:03:33.574 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-09-15T22:03:33.667 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-09-15T22:03:33.710 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-09-15T22:03:33.803 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-09-15T22:03:33.835 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-09-15T22:03:33.930 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-09-15T22:03:33.972 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-09-15T22:03:34.067 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-09-15T22:03:34.069 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-09-15T22:03:34.099 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-09-15T22:03:34.102 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-09-15T22:03:34.193 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-09-15T22:03:34.236 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-09-15T22:03:34.330 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-09-15T22:03:34.372 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-09-15T22:03:34.456 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-09-15T22:03:34.499 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-09-15T22:03:34.594 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-09-15T22:03:34.596 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-09-15T22:03:34.636 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-09-15T22:03:34.720 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-09-15T22:03:34.763 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-09-15T22:03:34.858 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-09-15T22:03:34.901 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-09-15T22:03:34.985 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-09-15T22:03:35.027 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-09-15T22:03:35.121 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-09-15T22:03:35.163 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-09-15T22:03:35.165 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-09-15T22:03:35.252 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-09-15T22:03:35.293 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-09-15T22:03:35.386 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-09-15T22:03:35.428 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-09-15T22:03:35.512 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-09-15T22:03:35.565 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-09-15T22:03:35.650 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-09-15T22:03:35.651 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-09-15T22:03:35.692 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-09-15T22:03:35.786 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-09-15T22:03:35.818 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-09-15T22:03:35.912 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-09-15T22:03:35.954 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-09-15T22:03:36.048 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-09-15T22:03:36.091 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-09-15T22:03:36.092 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-09-15T22:03:36.185 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-09-15T22:03:36.216 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-09-15T22:03:36.311 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-09-15T22:03:36.354 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-09-15T22:03:36.448 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-09-15T22:03:36.480 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-09-15T22:03:36.574 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-09-15T22:03:36.576 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-09-15T22:03:36.607 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-09-15T22:03:36.711 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-09-15T22:03:36.743 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-09-15T22:03:36.837 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-09-15T22:03:36.879 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-09-15T22:03:36.973 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-09-15T22:03:37.005 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-09-15T22:03:37.099 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-09-15T22:03:37.152 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-09-15T22:03:37.246 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-09-15T22:03:37.290 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-09-15T22:03:37.384 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-09-15T22:03:37.416 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-09-15T22:03:37.520 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-09-15T22:03:37.552 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-09-15T22:03:37.647 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-09-15T22:03:37.689 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-09-15T22:03:37.783 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-09-15T22:03:37.815 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-09-15T22:03:37.909 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-09-15T22:03:37.951 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-09-15T22:03:38.045 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-09-15T22:03:38.078 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-09-15T22:03:38.172 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-09-15T22:03:38.216 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-09-15T22:03:38.301 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-09-15T22:03:38.344 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-09-15T22:03:38.438 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-09-15T22:03:38.481 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-09-15T22:03:38.565 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-09-15T22:03:38.618 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-09-15T22:03:38.620 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-09-15T22:03:38.701 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-09-15T22:03:38.743 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-09-15T22:03:38.828 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-09-15T22:03:38.880 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-09-15T22:03:38.964 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-09-15T22:03:39.017 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-09-15T22:03:39.091 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-09-15T22:03:39.093 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-09-15T22:03:39.154 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-09-15T22:03:39.228 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-09-15T22:03:39.295 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-09-15T22:03:39.358 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-09-15T22:03:39.442 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-09-15T22:03:39.494 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-09-15T22:03:39.578 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-09-15T22:03:39.631 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-09-15T22:03:39.705 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-09-15T22:03:39.769 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-09-15T22:03:39.842 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-09-15T22:03:39.906 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-09-15T22:03:39.970 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-09-15T22:03:40.043 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-09-15T22:03:40.107 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-09-15T22:03:40.170 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-09-15T22:03:40.233 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-09-15T22:03:40.306 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-09-15T22:03:40.360 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-09-15T22:03:40.434 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-09-15T22:03:40.497 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-09-15T22:03:40.571 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-09-15T22:03:40.634 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-09-15T22:03:40.696 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-09-15T22:03:40.780 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-09-15T22:03:40.782 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-09-15T22:03:40.832 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-09-15T22:03:40.907 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-09-15T22:03:40.960 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-09-15T22:03:41.064 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-09-15T22:03:41.106 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-09-15T22:03:41.201 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-09-15T22:03:41.243 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-09-15T22:03:41.245 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-09-15T22:03:41.327 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-09-15T22:03:41.380 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-09-15T22:03:41.464 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-09-15T22:03:41.526 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-09-15T22:03:41.610 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-09-15T22:03:41.663 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-09-15T22:03:41.736 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-09-15T22:03:41.789 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-09-15T22:03:41.872 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-09-15T22:03:41.926 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-09-15T22:03:42.000 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-09-15T22:03:42.052 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-09-15T22:03:42.137 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-09-15T22:03:42.189 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-09-15T22:03:42.264 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-09-15T22:03:42.317 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-09-15T22:03:42.401 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-09-15T22:03:42.453 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-09-15T22:03:42.538 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-09-15T22:03:42.581 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-09-15T22:03:42.674 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-09-15T22:03:42.717 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-09-15T22:03:42.801 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-09-15T22:03:42.853 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-09-15T22:03:42.938 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-09-15T22:03:43.000 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-09-15T22:03:43.074 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-09-15T22:03:43.137 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-09-15T22:03:43.200 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-09-15T22:03:43.264 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-09-15T22:03:43.328 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-09-15T22:03:43.401 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-09-15T22:03:43.465 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-09-15T22:03:43.527 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-09-15T22:03:43.591 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-09-15T22:03:43.665 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-09-15T22:03:43.728 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-09-15T22:03:43.817 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:43 +0000 (0:00:19.895) 0:00:53.318 *** 2021-09-15T22:03:43.826 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-09-15T22:03:43.904 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-09-15T22:03:43.905 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:43.915 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:43.917 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:43.927 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-09-15T22:03:43.928 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc5 2021-09-15T22:03:43.930 INFO:teuthology.task.ansible.out:6I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:43.941 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:43.950 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:43.952 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:43.961 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.056 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi184.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-09-15T22:03:44.109 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-09-15T22:03:44.111 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-09-15T22:03:44.121 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.122 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.196 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-09-15T22:03:44.198 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-09-15T22:03:44.261 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-09-15T22:03:44.263 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-09-15T22:03:44.286 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:44 +0000 (0:00:00.468) 0:00:53.787 *** 2021-09-15T22:03:44.368 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.379 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.381 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005 2021-09-15T22:03:44.383 INFO:teuthology.task.ansible.out:a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.391 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.393 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.403 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.403 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.404 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.404 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "ite 2021-09-15T22:03:44.406 INFO:teuthology.task.ansible.out:m", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.415 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.417 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.427 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.429 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.439 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.441 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.450 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.452 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.462 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.473 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.474 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.485 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.486 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.497 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.508 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.510 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.519 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.521 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.531 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.541 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.543 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.553 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.564 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.565 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.579 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.590 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.592 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad 2021-09-15T22:03:44.593 INFO:teuthology.task.ansible.out:1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.603 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.604 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.615 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.617 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.626 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.637 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.639 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.648 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.650 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.660 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.672 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.674 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.683 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.685 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.694 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.696 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.706 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.717 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.719 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.728 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.729 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-09-15T22:03:44.730 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.740 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.751 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.753 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.764 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.765 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.776 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.778 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.789 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.789 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.800 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.811 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.813 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.822 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.833 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.835 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.844 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.846 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.856 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.867 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.869 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a 2021-09-15T22:03:44.871 INFO:teuthology.task.ansible.out:'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.879 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.881 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0k 2021-09-15T22:03:44.883 INFO:teuthology.task.ansible.out:cymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.892 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.894 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.904 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.906 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.906 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.se 2021-09-15T22:03:44.908 INFO:teuthology.task.ansible.out:pia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.918 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.918 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.930 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.931 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.942 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.943 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.954 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.956 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.967 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.968 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f9 2021-09-15T22:03:44.970 INFO:teuthology.task.ansible.out:66b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.979 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.981 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.991 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:44.993 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.003 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.005 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.016 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.017 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.028 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.029 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.040 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.042 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.053 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.055 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.066 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.068 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.078 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.080 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.091 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.093 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.104 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.105 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.106 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.117 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.118 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.129 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.131 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.141 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.143 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.153 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.154 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.154 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.156 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.166 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.168 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.168 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.169 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.180 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.181 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.192 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.194 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.204 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.206 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.217 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.218 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.228 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.230 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.241 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.242 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.253 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.253 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.254 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.254 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.265 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.267 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.277 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.278 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.289 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.290 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.301 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.303 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.303 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.313 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.315 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.330 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.341 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.344 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.363 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.364 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.388 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:45 +0000 (0:00:01.102) 0:00:54.889 *** 2021-09-15T22:03:45.396 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.398 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.399 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.400 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.412 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.412 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.424 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.434 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.436 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.446 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.448 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.457 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.459 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.483 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:45 +0000 (0:00:00.094) 0:00:54.984 *** 2021-09-15T22:03:45.489 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.490 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.491 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.502 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.504 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.514 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.516 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.526 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.526 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.537 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.548 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.550 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.560 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.561 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.571 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.582 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.583 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.593 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.594 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.605 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.616 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.618 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.628 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.639 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.641 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.651 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.652 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.662 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.664 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.674 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.675 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.685 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.696 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-09-15T22:03:45.698 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.709 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.711 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.720 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.731 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.733 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.743 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.744 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.754 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.765 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.767 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.776 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.778 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.788 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.799 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.801 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.810 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.821 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.822 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.852 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-09-15T22:03:45.854 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-09-15T22:03:45.877 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:45 +0000 (0:00:00.393) 0:00:55.378 *** 2021-09-15T22:03:45.947 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-09-15T22:03:45.949 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:45.971 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:45 +0000 (0:00:00.094) 0:00:55.472 *** 2021-09-15T22:03:45.978 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-09-15T22:03:45.979 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-09-15T22:03:46.104 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-09-15T22:03:46.188 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-09-15T22:03:46.231 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-09-15T22:03:46.316 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-09-15T22:03:46.369 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-09-15T22:03:46.454 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-09-15T22:03:46.505 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-09-15T22:03:46.589 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-09-15T22:03:46.636 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-09-15T22:03:46.716 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-09-15T22:03:46.769 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-09-15T22:03:46.853 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-09-15T22:03:46.906 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-09-15T22:03:46.990 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-09-15T22:03:47.042 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-09-15T22:03:47.126 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-09-15T22:03:47.168 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-09-15T22:03:47.265 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-09-15T22:03:47.307 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-09-15T22:03:47.391 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-09-15T22:03:47.444 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-09-15T22:03:47.528 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-09-15T22:03:47.570 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-09-15T22:03:47.654 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-09-15T22:03:47.707 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-09-15T22:03:47.801 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-09-15T22:03:47.843 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-09-15T22:03:47.927 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-09-15T22:03:47.979 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-09-15T22:03:48.063 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-09-15T22:03:48.106 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-09-15T22:03:48.200 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-09-15T22:03:48.242 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-09-15T22:03:48.338 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-09-15T22:03:48.383 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-09-15T22:03:48.467 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-09-15T22:03:48.510 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-09-15T22:03:48.594 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-09-15T22:03:48.647 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-09-15T22:03:48.731 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-09-15T22:03:48.794 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-09-15T22:03:48.868 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-09-15T22:03:48.920 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-09-15T22:03:48.995 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-09-15T22:03:49.059 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-09-15T22:03:49.132 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-09-15T22:03:49.196 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-09-15T22:03:49.269 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-09-15T22:03:49.332 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-09-15T22:03:49.406 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-09-15T22:03:49.459 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-09-15T22:03:49.543 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-09-15T22:03:49.596 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-09-15T22:03:49.669 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-09-15T22:03:49.733 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-09-15T22:03:49.807 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-09-15T22:03:49.870 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-09-15T22:03:49.944 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-09-15T22:03:50.009 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-09-15T22:03:50.082 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-09-15T22:03:50.135 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-09-15T22:03:50.220 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-09-15T22:03:50.273 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-09-15T22:03:50.358 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-09-15T22:03:50.411 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-09-15T22:03:50.496 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-09-15T22:03:50.539 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-09-15T22:03:50.623 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-09-15T22:03:50.676 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-09-15T22:03:50.760 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-09-15T22:03:50.813 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-09-15T22:03:50.897 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-09-15T22:03:51.042 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-09-15T22:03:51.170 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-09-15T22:03:51.306 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-09-15T22:03:51.318 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "davidz", "name": "davidz", "remove": false, "state": "absent"} 2021-09-15T22:03:51.726 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "davidz", "name": "davidz", "remove": false, "state": "absent"} 2021-09-15T22:03:51.791 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "wusui", "name": "wusui", "remove": false, "state": "absent"} 2021-09-15T22:03:52.155 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "wusui", "name": "wusui", "remove": false, "state": "absent"} 2021-09-15T22:03:52.272 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "nwatkins", "name": "nwatkins", "remove": false, "state": "absent"} 2021-09-15T22:03:52.584 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "nwatkins", "name": "nwatkins", "remove": false, "state": "absent"} 2021-09-15T22:03:52.782 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sidharthanup", "name": "sidharthanup", "remove": false, "state": "absent"} 2021-09-15T22:03:53.033 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sidharthanup", "name": "sidharthanup", "remove": false, "state": "absent"} 2021-09-15T22:03:53.283 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "varsha", "name": "varsha", "remove": false, "state": "absent"} 2021-09-15T22:03:53.415 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "varsha", "name": "varsha", "remove": false, "state": "absent"} 2021-09-15T22:03:53.730 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "hmunjulu", "name": "hmunjulu", "remove": false, "state": "absent"} 2021-09-15T22:03:53.835 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "hmunjulu", "name": "hmunjulu", "remove": false, "state": "absent"} 2021-09-15T22:03:53.867 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-09-15T22:03:53.973 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-09-15T22:03:54.005 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-09-15T22:03:54.111 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-09-15T22:03:54.133 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-09-15T22:03:54.251 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-09-15T22:03:54.273 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-09-15T22:03:54.400 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-09-15T22:03:54.411 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-09-15T22:03:54.538 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-09-15T22:03:54.550 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-09-15T22:03:54.678 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-09-15T22:03:54.690 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-09-15T22:03:54.808 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-09-15T22:03:54.820 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-09-15T22:03:54.944 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-09-15T22:03:54.956 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-09-15T22:03:55.081 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-09-15T22:03:55.093 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-09-15T22:03:55.152 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:55 +0000 (0:00:09.181) 0:01:04.654 *** 2021-09-15T22:03:55.213 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-09-15T22:03:55.271 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:55 +0000 (0:00:00.119) 0:01:04.773 *** 2021-09-15T22:03:55.830 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-09-15T22:03:55.832 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"changed": true, "checksum": "4a5787f42b17837e1416d13c4325647102121755", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "c85c4869d3df1b2c6c21c5a0709ecc0c", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1631743435.3572319-23635-78993269064032/source", "state": "file", "uid": 0} changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "checksum": "4a5787f42b17837e1416d13c4325647102121755", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "c85c4869d3df1b2c6c21c5a0709ecc0c", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1631743435.2363808-23620-170707385604616/source", "state": "file", "uid": 0} 2021-09-15T22:03:55.855 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:55 +0000 (0:00:00.583) 0:01:05.357 *** 2021-09-15T22:03:55.879 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:55 +0000 (0:00:00.023) 0:01:05.380 *** 2021-09-15T22:03:55.927 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-09-15T22:03:55.929 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => { "msg": "Host smithi180.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-09-15T22:03:55.952 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:55 +0000 (0:00:00.073) 0:01:05.453 *** 2021-09-15T22:03:55.959 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => { "msg": "Host smithi184.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-09-15T22:03:55.987 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:55 +0000 (0:00:00.034) 0:01:05.488 *** 2021-09-15T22:03:56.025 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-09-15T22:03:56.027 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-09-15T22:03:56.051 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.064) 0:01:05.552 *** 2021-09-15T22:03:56.068 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-09-15T22:03:56.096 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.045) 0:01:05.597 *** 2021-09-15T22:03:56.112 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-09-15T22:03:56.114 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:56.138 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.042) 0:01:05.640 *** 2021-09-15T22:03:56.156 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:56.181 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.042) 0:01:05.683 *** 2021-09-15T22:03:56.209 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-09-15T22:03:56.211 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:56.236 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.054) 0:01:05.737 *** 2021-09-15T22:03:56.255 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:56.281 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.045) 0:01:05.782 *** 2021-09-15T22:03:56.299 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:56.325 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.043) 0:01:05.826 *** 2021-09-15T22:03:56.353 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:56.378 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.053) 0:01:05.880 *** 2021-09-15T22:03:56.396 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-09-15T22:03:56.398 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:56.421 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.042) 0:01:05.923 *** 2021-09-15T22:03:56.450 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:56.486 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.064) 0:01:05.987 *** 2021-09-15T22:03:56.493 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:56.519 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.033) 0:01:06.021 *** 2021-09-15T22:03:56.558 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:56.587 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.067) 0:01:06.088 *** 2021-09-15T22:03:56.594 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-09-15T22:03:56.596 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:56.620 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.033) 0:01:06.122 *** 2021-09-15T22:03:56.661 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:56.684 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.063) 0:01:06.185 *** 2021-09-15T22:03:56.691 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-09-15T22:03:56.693 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:56.719 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.034) 0:01:06.220 *** 2021-09-15T22:03:56.748 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:56.773 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.054) 0:01:06.275 *** 2021-09-15T22:03:56.790 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-09-15T22:03:56.792 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:56.816 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.042) 0:01:06.318 *** 2021-09-15T22:03:56.844 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:56.870 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.053) 0:01:06.371 *** 2021-09-15T22:03:56.898 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi180.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-09-15T22:03:56.901 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-09-15T22:03:56.925 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.054) 0:01:06.426 *** 2021-09-15T22:03:56.954 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-09-15T22:03:56.955 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-09-15T22:03:56.980 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:56 +0000 (0:00:00.055) 0:01:06.481 *** 2021-09-15T22:03:56.996 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-09-15T22:03:56.999 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:57.023 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.042) 0:01:06.524 *** 2021-09-15T22:03:57.052 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:57.078 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.055) 0:01:06.580 *** 2021-09-15T22:03:57.097 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-09-15T22:03:57.099 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:57.122 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.044) 0:01:06.624 *** 2021-09-15T22:03:57.160 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:57.188 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.065) 0:01:06.690 *** 2021-09-15T22:03:57.194 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-09-15T22:03:57.196 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:57.221 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.032) 0:01:06.722 *** 2021-09-15T22:03:57.248 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:57.274 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.052) 0:01:06.775 *** 2021-09-15T22:03:57.290 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-09-15T22:03:57.291 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-09-15T22:03:57.316 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.042) 0:01:06.817 *** 2021-09-15T22:03:57.343 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-09-15T22:03:57.375 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.059) 0:01:06.877 *** 2021-09-15T22:03:57.383 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-09-15T22:03:57.384 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:57.424 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.048) 0:01:06.925 *** 2021-09-15T22:03:57.453 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:57.478 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.053) 0:01:06.979 *** 2021-09-15T22:03:57.494 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-09-15T22:03:57.496 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-09-15T22:03:57.520 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.041) 0:01:07.021 *** 2021-09-15T22:03:57.547 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-09-15T22:03:57.573 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.052) 0:01:07.074 *** 2021-09-15T22:03:57.590 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-09-15T22:03:57.591 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:57.616 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.043) 0:01:07.117 *** 2021-09-15T22:03:57.645 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:57.669 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.052) 0:01:07.170 *** 2021-09-15T22:03:57.686 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-09-15T22:03:57.687 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:57.712 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.042) 0:01:07.213 *** 2021-09-15T22:03:57.741 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:57.767 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.055) 0:01:07.269 *** 2021-09-15T22:03:57.785 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-09-15T22:03:57.786 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:57.810 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.042) 0:01:07.311 *** 2021-09-15T22:03:57.838 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:57.865 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.054) 0:01:07.366 *** 2021-09-15T22:03:57.882 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:57.908 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.043) 0:01:07.410 *** 2021-09-15T22:03:57.926 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:57.952 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.043) 0:01:07.454 *** 2021-09-15T22:03:57.980 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-09-15T22:03:57.982 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-09-15T22:03:58.007 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:57 +0000 (0:00:00.053) 0:01:07.508 *** 2021-09-15T22:03:58.024 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-09-15T22:03:58.049 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.043) 0:01:07.551 *** 2021-09-15T22:03:58.066 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-09-15T22:03:58.068 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:58.092 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.042) 0:01:07.594 *** 2021-09-15T22:03:58.121 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:58.146 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.053) 0:01:07.648 *** 2021-09-15T22:03:58.164 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:58.189 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.042) 0:01:07.690 *** 2021-09-15T22:03:58.217 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:58.241 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.052) 0:01:07.743 *** 2021-09-15T22:03:58.259 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-09-15T22:03:58.261 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:58.296 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.054) 0:01:07.797 *** 2021-09-15T22:03:58.316 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:58.359 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.062) 0:01:07.860 *** 2021-09-15T22:03:58.388 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-09-15T22:03:58.390 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:58.424 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.064) 0:01:07.925 *** 2021-09-15T22:03:58.430 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:58.459 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.035) 0:01:07.960 *** 2021-09-15T22:03:58.489 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-09-15T22:03:58.491 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:58.523 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.063) 0:01:08.024 *** 2021-09-15T22:03:58.541 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:58.735 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.047) 0:01:08.071 *** TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.044) 0:01:08.116 *** skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.053) 0:01:08.169 *** TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi180.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.043) 0:01:08.212 *** 2021-09-15T22:03:58.739 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-09-15T22:03:58.765 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.053) 0:01:08.266 *** 2021-09-15T22:03:58.781 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-09-15T22:03:58.783 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:58.806 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.041) 0:01:08.307 *** 2021-09-15T22:03:58.834 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:58.859 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.052) 0:01:08.360 *** 2021-09-15T22:03:58.876 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-09-15T22:03:58.878 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:58.901 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.042) 0:01:08.403 *** 2021-09-15T22:03:58.929 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:58.959 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.057) 0:01:08.460 *** 2021-09-15T22:03:58.976 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-09-15T22:03:58.978 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:59.001 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:58 +0000 (0:00:00.042) 0:01:08.503 *** 2021-09-15T22:03:59.019 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:59.044 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:59 +0000 (0:00:00.042) 0:01:08.546 *** 2021-09-15T22:03:59.072 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-09-15T22:03:59.074 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:59.084 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:59.111 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:59 +0000 (0:00:00.065) 0:01:08.612 *** 2021-09-15T22:03:59.128 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:59.130 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:59.156 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:59 +0000 (0:00:00.045) 0:01:08.657 *** 2021-09-15T22:03:59.183 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-09-15T22:03:59.185 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-09-15T22:03:59.211 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:59 +0000 (0:00:00.054) 0:01:08.712 *** 2021-09-15T22:03:59.228 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-09-15T22:03:59.230 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-09-15T22:03:59.255 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:59 +0000 (0:00:00.044) 0:01:08.756 *** 2021-09-15T22:03:59.272 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-09-15T22:03:59.273 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:59.297 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:59 +0000 (0:00:00.042) 0:01:08.798 *** 2021-09-15T22:03:59.324 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:59.351 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:59 +0000 (0:00:00.053) 0:01:08.852 *** 2021-09-15T22:03:59.482 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-09-15T22:03:59.483 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.010244", "end": "2021-09-15 22:03:59.379897", "rc": 0, "start": "2021-09-15 22:03:59.369653", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-09-15T22:03:59.507 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:59 +0000 (0:00:00.155) 0:01:09.008 *** 2021-09-15T22:03:59.545 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.013075", "end": "2021-09-15 22:03:59.144146", "rc": 0, "start": "2021-09-15 22:03:59.131071", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-09-15T22:03:59.574 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:59 +0000 (0:00:00.067) 0:01:09.076 *** 2021-09-15T22:03:59.592 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-09-15T22:03:59.593 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:59.617 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:59 +0000 (0:00:00.042) 0:01:09.118 *** 2021-09-15T22:03:59.644 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:59.675 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:59 +0000 (0:00:00.057) 0:01:09.176 *** 2021-09-15T22:03:59.693 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-09-15T22:03:59.695 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:59.719 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:59 +0000 (0:00:00.044) 0:01:09.220 *** 2021-09-15T22:03:59.747 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:03:59.772 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:03:59 +0000 (0:00:00.053) 0:01:09.274 *** 2021-09-15T22:04:00.291 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-09-15T22:04:00.292 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-09-15T22:04:00.303 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-09-15T22:04:00.471 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-09-15T22:04:00.473 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-09-15T22:04:00.651 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-09-15T22:04:00.653 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-09-15T22:04:00.822 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-09-15T22:04:00.825 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-09-15T22:04:00.853 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:00 +0000 (0:00:01.080) 0:01:10.354 *** 2021-09-15T22:04:00.877 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:00 +0000 (0:00:00.023) 0:01:10.378 *** 2021-09-15T22:04:00.926 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-09-15T22:04:00.927 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:00.953 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:00 +0000 (0:00:00.075) 0:01:10.454 *** 2021-09-15T22:04:00.960 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:00.987 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:00 +0000 (0:00:00.033) 0:01:10.488 *** 2021-09-15T22:04:01.025 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-09-15T22:04:01.027 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:01.054 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:01 +0000 (0:00:00.066) 0:01:10.555 *** 2021-09-15T22:04:01.063 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:01.089 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:01 +0000 (0:00:00.035) 0:01:10.590 *** 2021-09-15T22:04:01.116 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-09-15T22:04:01.118 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:01.142 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:01 +0000 (0:00:00.053) 0:01:10.644 *** 2021-09-15T22:04:01.159 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:01.185 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:01 +0000 (0:00:00.042) 0:01:10.686 *** 2021-09-15T22:04:01.202 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-09-15T22:04:01.204 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:01.228 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:01 +0000 (0:00:00.042) 0:01:10.729 *** 2021-09-15T22:04:01.244 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:01.273 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:01 +0000 (0:00:00.044) 0:01:10.773 *** 2021-09-15T22:04:01.293 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-09-15T22:04:01.295 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:01.318 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:01 +0000 (0:00:00.046) 0:01:10.820 *** 2021-09-15T22:04:01.335 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:01.361 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:01 +0000 (0:00:00.043) 0:01:10.863 *** 2021-09-15T22:04:01.609 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-09-15T22:04:01.611 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.157648", "end": "2021-09-15 22:04:01.500396", "rc": 0, "start": "2021-09-15 22:04:01.342748", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:04:01.636 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:01 +0000 (0:00:00.274) 0:01:11.137 *** 2021-09-15T22:04:01.716 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-09-15T22:04:01.718 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:01.741 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:01 +0000 (0:00:00.104) 0:01:11.242 *** 2021-09-15T22:04:01.905 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-09-15T22:04:01.907 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.408229", "end": "2021-09-15 22:04:01.500403", "rc": 0, "start": "2021-09-15 22:04:01.092174", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:04:01.930 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:01 +0000 (0:00:00.188) 0:01:11.431 *** 2021-09-15T22:04:01.998 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-09-15T22:04:01.999 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:02.026 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:02 +0000 (0:00:00.095) 0:01:11.527 *** 2021-09-15T22:04:02.063 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-09-15T22:04:02.065 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.134092", "end": "2021-09-15 22:04:01.953367", "rc": 0, "start": "2021-09-15 22:04:01.819275", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:04:02.090 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:02 +0000 (0:00:00.064) 0:01:11.592 *** 2021-09-15T22:04:02.286 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.085078", "end": "2021-09-15 22:04:01.878836", "rc": 0, "start": "2021-09-15 22:04:01.793758", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:04:02.311 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:02 +0000 (0:00:00.220) 0:01:11.813 *** 2021-09-15T22:04:05.882 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** ok: [smithi184.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1631743179, "cache_updated": false, "changed": false} 2021-09-15T22:04:05.905 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:05 +0000 (0:00:03.593) 0:01:15.407 *** 2021-09-15T22:04:06.037 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1631743118, "cache_updated": false, "changed": false} 2021-09-15T22:04:06.064 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:06 +0000 (0:00:00.158) 0:01:15.565 *** 2021-09-15T22:04:06.643 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-09-15T22:04:06.644 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"cache_update_time": 1631743179, "cache_updated": false, "changed": false} 2021-09-15T22:04:06.668 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:06 +0000 (0:00:00.604) 0:01:16.169 *** 2021-09-15T22:04:06.737 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:06.761 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:06 +0000 (0:00:00.092) 0:01:16.262 *** 2021-09-15T22:04:06.798 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-09-15T22:04:06.800 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"cache_update_time": 1631743118, "cache_updated": false, "changed": false} 2021-09-15T22:04:06.827 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:06 +0000 (0:00:00.065) 0:01:16.328 *** 2021-09-15T22:04:06.905 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-09-15T22:04:06.907 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:06.930 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:06 +0000 (0:00:00.103) 0:01:16.431 *** 2021-09-15T22:04:07.156 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-09-15T22:04:07.157 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-09-15T22:04:07.182 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:07 +0000 (0:00:00.252) 0:01:16.683 *** 2021-09-15T22:04:07.336 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-09-15T22:04:07.364 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:07 +0000 (0:00:00.182) 0:01:16.865 *** 2021-09-15T22:04:07.905 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-09-15T22:04:07.908 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"cache_update_time": 1631743179, "cache_updated": false, "changed": false} 2021-09-15T22:04:07.933 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:07 +0000 (0:00:00.569) 0:01:17.434 *** 2021-09-15T22:04:08.087 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"cache_update_time": 1631743118, "cache_updated": false, "changed": false} 2021-09-15T22:04:08.115 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:08 +0000 (0:00:00.181) 0:01:17.616 *** 2021-09-15T22:04:08.330 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-09-15T22:04:08.332 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-09-15T22:04:08.521 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-09-15T22:04:08.658 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-09-15T22:04:08.846 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-09-15T22:04:08.951 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-09-15T22:04:08.978 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:08 +0000 (0:00:00.863) 0:01:18.479 *** 2021-09-15T22:04:09.111 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-09-15T22:04:09.112 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-09-15T22:04:09.135 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:09 +0000 (0:00:00.156) 0:01:18.636 *** 2021-09-15T22:04:09.151 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-09-15T22:04:09.153 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-09-15T22:04:09.179 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:09 +0000 (0:00:00.044) 0:01:18.681 *** 2021-09-15T22:04:09.322 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-09-15T22:04:09.346 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:09 +0000 (0:00:00.166) 0:01:18.847 *** 2021-09-15T22:04:09.502 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-09-15T22:04:09.504 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-09-15T22:04:09.723 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-09-15T22:04:09.787 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-09-15T22:04:10.006 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-09-15T22:04:10.082 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-09-15T22:04:10.109 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:10 +0000 (0:00:00.762) 0:01:19.610 *** 2021-09-15T22:04:10.190 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-09-15T22:04:10.192 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-09-15T22:04:10.216 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:10 +0000 (0:00:00.107) 0:01:19.717 *** 2021-09-15T22:04:10.295 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-09-15T22:04:10.296 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:10.318 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:10 +0000 (0:00:00.101) 0:01:19.819 *** 2021-09-15T22:04:10.325 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-09-15T22:04:10.326 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-09-15T22:04:10.356 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:10 +0000 (0:00:00.037) 0:01:19.857 *** 2021-09-15T22:04:10.384 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-09-15T22:04:10.386 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-09-15T22:04:10.410 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:10 +0000 (0:00:00.054) 0:01:19.911 *** 2021-09-15T22:04:10.438 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-09-15T22:04:10.440 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-09-15T22:04:10.464 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:10 +0000 (0:00:00.053) 0:01:19.965 *** 2021-09-15T22:04:10.492 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-09-15T22:04:10.493 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-09-15T22:04:10.503 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-09-15T22:04:10.524 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-09-15T22:04:10.535 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install nrpe without epel] ************************************** 2021-09-15T22:04:10.537 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-09-15T22:04:10.561 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:10 +0000 (0:00:00.097) 0:01:20.062 *** 2021-09-15T22:04:10.583 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:10 +0000 (0:00:00.021) 0:01:20.084 *** 2021-09-15T22:04:10.631 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-09-15T22:04:10.633 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-09-15T22:04:10.657 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:10 +0000 (0:00:00.073) 0:01:20.158 *** 2021-09-15T22:04:10.664 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-09-15T22:04:10.666 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:10.690 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:10 +0000 (0:00:00.032) 0:01:20.191 *** 2021-09-15T22:04:10.738 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-09-15T22:04:10.739 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-09-15T22:04:10.749 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-09-15T22:04:10.760 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-09-15T22:04:10.781 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-09-15T22:04:10.809 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:10 +0000 (0:00:00.118) 0:01:20.310 *** 2021-09-15T22:04:10.888 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-09-15T22:04:10.889 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:10.912 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:10 +0000 (0:00:00.102) 0:01:20.412 *** 2021-09-15T22:04:11.422 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-09-15T22:04:11.424 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"cache_update_time": 1631743179, "cache_updated": false, "changed": false} 2021-09-15T22:04:11.448 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:11 +0000 (0:00:00.536) 0:01:20.949 *** 2021-09-15T22:04:11.676 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"cache_update_time": 1631743118, "cache_updated": false, "changed": false} 2021-09-15T22:04:11.701 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:11 +0000 (0:00:00.253) 0:01:21.203 *** 2021-09-15T22:04:11.853 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-09-15T22:04:11.855 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-09-15T22:04:11.879 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:11 +0000 (0:00:00.177) 0:01:21.380 *** 2021-09-15T22:04:12.072 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-09-15T22:04:12.097 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:12 +0000 (0:00:00.218) 0:01:21.599 *** 2021-09-15T22:04:12.271 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-09-15T22:04:12.273 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-09-15T22:04:12.296 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:12 +0000 (0:00:00.198) 0:01:21.797 *** 2021-09-15T22:04:12.490 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi184.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-09-15T22:04:12.512 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-09-15T22:04:12.514 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-09-15T22:04:12.537 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:12 +0000 (0:00:00.241) 0:01:22.038 *** 2021-09-15T22:04:12.627 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-09-15T22:04:12.629 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-09-15T22:04:12.661 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:12 +0000 (0:00:00.123) 0:01:22.162 *** 2021-09-15T22:04:12.744 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-09-15T22:04:12.746 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:12.769 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:12 +0000 (0:00:00.108) 0:01:22.270 *** 2021-09-15T22:04:12.862 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi184.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-09-15T22:04:12.864 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi180.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-09-15T22:04:12.890 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:12 +0000 (0:00:00.121) 0:01:22.391 *** 2021-09-15T22:04:12.913 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:12 +0000 (0:00:00.022) 0:01:22.414 *** 2021-09-15T22:04:12.961 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-09-15T22:04:12.963 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:12.988 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:12 +0000 (0:00:00.075) 0:01:22.489 *** 2021-09-15T22:04:12.996 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-09-15T22:04:12.997 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:13.022 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:13 +0000 (0:00:00.034) 0:01:22.523 *** 2021-09-15T22:04:13.061 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-09-15T22:04:13.063 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-09-15T22:04:13.088 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:13 +0000 (0:00:00.066) 0:01:22.590 *** 2021-09-15T22:04:13.157 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-09-15T22:04:13.159 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:13.182 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:13 +0000 (0:00:00.093) 0:01:22.684 *** 2021-09-15T22:04:13.401 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-09-15T22:04:13.403 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-09-15T22:04:13.433 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:13 +0000 (0:00:00.250) 0:01:22.934 *** 2021-09-15T22:04:13.579 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-09-15T22:04:13.605 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:13 +0000 (0:00:00.172) 0:01:23.106 *** 2021-09-15T22:04:13.709 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-09-15T22:04:13.710 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-09-15 22:02:28 UTC", "ActiveEnterTimestampMonotonic": "15110804", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target sysinit.target nss-lookup.target local-fs.target systemd-tmpfiles-setup.service var-run.mount time-sync.target remote-fs.target -.mount basic.target systemd-journald.socket system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-09-15 22:02:28 UTC", "AssertTimestampMonotonic": "15055915", "Before": "plymouth-quit.service getty@tty1.service shutdown.target multi-user.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-09-15 22:02:28 UTC", "Co 2021-09-15T22:04:13.712 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15055914", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "892", "ExecMainStartTimestamp": "Wed 2021-09-15 22:02:28 UTC", "ExecMainStartTimestampMonotonic": "15110628", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-09-15 22:02:28 UTC] ; stop_time=[n/a] ; pid=892 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-09-15 22:02:28 UTC] ; stop_time=[n/a] ; pid=892 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-09-15T22:04:13.714 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-09-15 22:02:28 UTC", "InactiveExitTimestampMonotonic": "15110804", "InvocationID": "8bd7d576703d4817b0a734982fc43e00", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "892", "MemoryAccounting": "yes", "MemoryCurrent": "1310720", "MemoryD 2021-09-15T22:04:13.715 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-09-15 22:02:28 UTC", "StateChangeTimestampMonotonic": "15110804", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-09-15T22:04:13.717 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38333", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-09-15T22:04:13.738 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:13 +0000 (0:00:00.133) 0:01:23.239 *** 2021-09-15T22:04:13.740 INFO:teuthology.task.ansible.out: 2021-09-15T22:04:13.808 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-09-15T22:04:13.810 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:13.834 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:13 +0000 (0:00:00.096) 0:01:23.336 *** 2021-09-15T22:04:13.885 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-09-15T22:04:13.886 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-09-15 22:02:21 UTC", "ActiveEnterTimestampMonotonic": "15757851", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target remote-fs.target systemd-journald.socket systemd-tmpfiles-setup.service time-sync.target -.mount nss-lookup.target system.slice local-fs.target var-run.mount network.target sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-09-15 22:02:21 UTC", "AssertTimestampMonotonic": "15737463", "Before": "multi-user.target plymouth-quit.service xdm.service shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-09-15 22:02:21 UTC", "Co 2021-09-15T22:04:13.889 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15737463", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "891", "ExecMainStartTimestamp": "Wed 2021-09-15 22:02:21 UTC", "ExecMainStartTimestampMonotonic": "15757683", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-09-15 22:02:21 UTC] ; stop_time=[n/a] ; pid=891 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-09-15 22:02:21 UTC] ; stop_time=[n/a] ; pid=891 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-09-15T22:04:13.890 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-09-15 22:02:21 UTC", "InactiveExitTimestampMonotonic": "15757851", "InvocationID": "6011c5f8c4c14c1da903485c0abd1e76", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "63361", "LimitNPROCSoft": "63361", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "63361", "LimitSIGPENDINGSoft": "63361", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "891", "MemoryAccounting": "yes", "MemoryCurrent": "1265664", "MemoryDenyW 2021-09-15T22:04:13.892 INFO:teuthology.task.ansible.out:riteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-09-15 22:02:21 UTC", "StateChangeTimestampMonotonic": "15757851", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "S 2021-09-15T22:04:13.894 INFO:teuthology.task.ansible.out:ubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "19008", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-09-15T22:04:13.921 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:13 +0000 (0:00:00.086) 0:01:23.422 *** 2021-09-15T22:04:13.930 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-09-15T22:04:13.932 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:13.959 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:13 +0000 (0:00:00.038) 0:01:23.460 *** 2021-09-15T22:04:13.987 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-09-15T22:04:13.989 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.016 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.056) 0:01:23.517 *** 2021-09-15T22:04:14.038 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.069 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.052) 0:01:23.570 *** 2021-09-15T22:04:14.086 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-09-15T22:04:14.088 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.118 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.048) 0:01:23.619 *** 2021-09-15T22:04:14.157 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-09-15T22:04:14.159 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.185 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.066) 0:01:23.686 *** 2021-09-15T22:04:14.192 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-09-15T22:04:14.194 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.222 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.037) 0:01:23.723 *** 2021-09-15T22:04:14.253 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-09-15T22:04:14.255 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.279 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.057) 0:01:23.781 *** 2021-09-15T22:04:14.305 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-09-15T22:04:14.307 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.332 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.052) 0:01:23.833 *** 2021-09-15T22:04:14.361 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.386 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.053) 0:01:23.887 *** 2021-09-15T22:04:14.414 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.438 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.052) 0:01:23.940 *** 2021-09-15T22:04:14.466 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.498 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.059) 0:01:23.999 *** 2021-09-15T22:04:14.516 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.543 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.045) 0:01:24.044 *** 2021-09-15T22:04:14.571 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-09-15T22:04:14.573 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.602 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.058) 0:01:24.103 *** 2021-09-15T22:04:14.619 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-09-15T22:04:14.621 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.646 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.043) 0:01:24.147 *** 2021-09-15T22:04:14.674 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-09-15T22:04:14.676 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.701 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.055) 0:01:24.203 *** 2021-09-15T22:04:14.719 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-09-15T22:04:14.721 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.746 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.044) 0:01:24.247 *** 2021-09-15T22:04:14.764 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.789 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.043) 0:01:24.291 *** 2021-09-15T22:04:14.816 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-09-15T22:04:14.818 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.842 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.052) 0:01:24.343 *** 2021-09-15T22:04:14.864 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-09-15T22:04:14.866 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-09-15T22:04:14.890 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.047) 0:01:24.391 *** 2021-09-15T22:04:14.918 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-09-15T22:04:14.920 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:14.944 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:14 +0000 (0:00:00.054) 0:01:24.445 *** 2021-09-15T22:04:14.983 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi184.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-09-15T22:04:15.010 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:15 +0000 (0:00:00.065) 0:01:24.510 *** 2021-09-15T22:04:15.027 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-09-15T22:04:15.029 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-09-15T22:04:15.053 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:15 +0000 (0:00:00.043) 0:01:24.554 *** 2021-09-15T22:04:15.091 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi184.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-09-15T22:04:15.125 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:15 +0000 (0:00:00.072) 0:01:24.627 *** 2021-09-15T22:04:15.143 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-09-15T22:04:15.145 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-09-15T22:04:15.174 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:15 +0000 (0:00:00.048) 0:01:24.675 *** 2021-09-15T22:04:15.203 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-09-15T22:04:15.205 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-09-15T22:04:15.231 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:15 +0000 (0:00:00.057) 0:01:24.732 *** 2021-09-15T22:04:15.269 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-09-15T22:04:15.271 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-09-15T22:04:15.298 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:15 +0000 (0:00:00.066) 0:01:24.799 *** 2021-09-15T22:04:15.371 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-09-15T22:04:15.373 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-09-15T22:04:15.397 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:15 +0000 (0:00:00.098) 0:01:24.898 *** 2021-09-15T22:04:15.403 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-09-15T22:04:15.405 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-09-15T22:04:15.431 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:15 +0000 (0:00:00.034) 0:01:24.932 *** 2021-09-15T22:04:15.568 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-09-15T22:04:15.571 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-09-15T22:04:15.606 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:15 +0000 (0:00:00.175) 0:01:25.107 *** 2021-09-15T22:04:15.630 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:15 +0000 (0:00:00.023) 0:01:25.131 *** 2021-09-15T22:04:15.699 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-09-15T22:04:15.701 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:15.725 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:15 +0000 (0:00:00.093) 0:01:25.225 *** 2021-09-15T22:04:15.792 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-09-15T22:04:15.794 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-09-15T22:04:15.820 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:15 +0000 (0:00:00.094) 0:01:25.319 *** 2021-09-15T22:04:15.825 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-09-15T22:04:15.827 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:15.854 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:15 +0000 (0:00:00.036) 0:01:25.356 *** 2021-09-15T22:04:15.897 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:15.932 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:15 +0000 (0:00:00.077) 0:01:25.433 *** 2021-09-15T22:04:16.015 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:16.045 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:16 +0000 (0:00:00.112) 0:01:25.546 *** 2021-09-15T22:04:16.074 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-09-15T22:04:16.076 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-09-15T22:04:16.101 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:16 +0000 (0:00:00.055) 0:01:25.602 *** 2021-09-15T22:04:16.260 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-09-15T22:04:16.294 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:16 +0000 (0:00:00.193) 0:01:25.795 *** 2021-09-15T22:04:16.576 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-09-15T22:04:16.578 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-09-15T22:04:16.602 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:16 +0000 (0:00:00.307) 0:01:26.103 *** 2021-09-15T22:04:16.682 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-09-15T22:04:16.684 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi184"}, "changed": false} 2021-09-15T22:04:16.709 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:16 +0000 (0:00:00.106) 0:01:26.210 *** 2021-09-15T22:04:16.823 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-09-15T22:04:16.847 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:16 +0000 (0:00:00.139) 0:01:26.349 *** 2021-09-15T22:04:16.852 INFO:teuthology.task.ansible.out: 2021-09-15T22:04:16.931 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-09-15T22:04:16.934 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi180"}, "changed": false} 2021-09-15T22:04:16.956 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:16 +0000 (0:00:00.108) 0:01:26.457 *** 2021-09-15T22:04:17.479 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi184.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi184.front.sepia.ceph.com", "ansible_hostname": "smithi184", "ansible_nodename": "smithi184"}, "changed": true, "name": "smithi184"} 2021-09-15T22:04:17.504 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:17 +0000 (0:00:00.548) 0:01:27.005 *** 2021-09-15T22:04:17.512 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi180.front.sepia.ceph.com", "ansible_hostname": "smithi180", "ansible_nodename": "smithi180"}, "changed": true, "name": "smithi180"} 2021-09-15T22:04:17.540 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:17 +0000 (0:00:00.036) 0:01:27.042 *** 2021-09-15T22:04:17.913 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-09-15T22:04:17.915 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-09-15T22:04:17.942 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:17 +0000 (0:00:00.401) 0:01:27.443 *** 2021-09-15T22:04:17.951 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-09-15T22:04:17.980 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:17 +0000 (0:00:00.037) 0:01:27.481 *** 2021-09-15T22:04:18.332 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-09-15T22:04:18.334 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-09-15T22:04:18.360 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:18 +0000 (0:00:00.380) 0:01:27.861 *** 2021-09-15T22:04:18.388 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-09-15T22:04:18.416 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:18 +0000 (0:00:00.056) 0:01:27.918 *** 2021-09-15T22:04:18.862 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-09-15T22:04:18.864 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-09-15T22:04:18.888 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:18 +0000 (0:00:00.471) 0:01:28.389 *** 2021-09-15T22:04:18.906 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-09-15T22:04:18.932 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:18 +0000 (0:00:00.044) 0:01:28.434 *** 2021-09-15T22:04:18.960 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-09-15T22:04:18.962 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:18.986 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:18 +0000 (0:00:00.053) 0:01:28.488 *** 2021-09-15T22:04:19.014 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:19.040 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.053) 0:01:28.541 *** 2021-09-15T22:04:19.342 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.050) 0:01:28.592 *** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.058) 0:01:28.651 *** TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.063) 0:01:28.715 *** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.049) 0:01:28.764 *** TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.045) 0:01:28.810 *** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:19.362 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.053) 0:01:28.863 *** 2021-09-15T22:04:19.382 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-09-15T22:04:19.384 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:19.409 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.047) 0:01:28.910 *** 2021-09-15T22:04:19.426 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:19.457 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.047) 0:01:28.958 *** 2021-09-15T22:04:19.475 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-09-15T22:04:19.477 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:19.502 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.045) 0:01:29.004 *** 2021-09-15T22:04:19.521 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:19.548 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.045) 0:01:29.049 *** 2021-09-15T22:04:19.586 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-09-15T22:04:19.587 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:19.614 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.065) 0:01:29.115 *** 2021-09-15T22:04:19.631 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:19.659 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.044) 0:01:29.160 *** 2021-09-15T22:04:19.697 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-09-15T22:04:19.699 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:19.726 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.067) 0:01:29.228 *** 2021-09-15T22:04:19.733 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:19.759 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.032) 0:01:29.260 *** 2021-09-15T22:04:19.797 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-09-15T22:04:19.799 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:19.828 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.069) 0:01:29.329 *** 2021-09-15T22:04:19.846 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:19.873 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.044) 0:01:29.375 *** 2021-09-15T22:04:19.902 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-09-15T22:04:19.903 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-09-15T22:04:19.930 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.057) 0:01:29.432 *** 2021-09-15T22:04:19.959 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-09-15T22:04:19.986 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:19 +0000 (0:00:00.055) 0:01:29.487 *** 2021-09-15T22:04:20.003 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-09-15T22:04:20.005 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:20.031 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.045) 0:01:29.532 *** 2021-09-15T22:04:20.071 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:20.098 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.066) 0:01:29.599 *** 2021-09-15T22:04:20.116 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-09-15T22:04:20.142 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.044) 0:01:29.643 *** 2021-09-15T22:04:20.185 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.043) 0:01:29.687 *** 2021-09-15T22:04:20.215 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-09-15T22:04:20.242 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.056) 0:01:29.743 *** 2021-09-15T22:04:20.295 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.053) 0:01:29.797 *** 2021-09-15T22:04:20.314 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-09-15T22:04:20.340 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.044) 0:01:29.841 *** 2021-09-15T22:04:20.395 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.055) 0:01:29.896 *** 2021-09-15T22:04:20.423 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-09-15T22:04:20.425 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:20.453 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.058) 0:01:29.954 *** 2021-09-15T22:04:20.472 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:20.498 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.045) 0:01:30.000 *** 2021-09-15T22:04:20.526 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-09-15T22:04:20.528 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-09-15T22:04:20.554 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.055) 0:01:30.056 *** 2021-09-15T22:04:20.572 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-09-15T22:04:20.574 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-09-15T22:04:20.598 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.044) 0:01:30.100 *** 2021-09-15T22:04:20.617 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:20.644 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.045) 0:01:30.146 *** 2021-09-15T22:04:20.646 INFO:teuthology.task.ansible.out: 2021-09-15T22:04:20.696 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:20.723 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.078) 0:01:30.224 *** 2021-09-15T22:04:20.731 INFO:teuthology.task.ansible.out: 2021-09-15T22:04:20.733 INFO:teuthology.task.ansible.out:TASK [testnode : set_fact] ***************************************************** skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:20.763 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.039) 0:01:30.264 *** 2021-09-15T22:04:20.792 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:20.818 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.055) 0:01:30.320 *** 2021-09-15T22:04:20.846 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-09-15T22:04:20.848 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:20.872 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.053) 0:01:30.373 *** 2021-09-15T22:04:20.889 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:20.917 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.045) 0:01:30.419 *** 2021-09-15T22:04:20.958 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-09-15T22:04:20.960 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:20.983 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:20 +0000 (0:00:00.065) 0:01:30.485 *** 2021-09-15T22:04:21.001 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.032 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.048) 0:01:30.533 *** 2021-09-15T22:04:21.051 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-09-15T22:04:21.053 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.080 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.048) 0:01:30.582 *** 2021-09-15T22:04:21.108 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.133 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.052) 0:01:30.635 *** 2021-09-15T22:04:21.150 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-09-15T22:04:21.152 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.176 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.043) 0:01:30.678 *** 2021-09-15T22:04:21.204 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.229 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.052) 0:01:30.730 *** 2021-09-15T22:04:21.245 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-09-15T22:04:21.247 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.271 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.042) 0:01:30.773 *** 2021-09-15T22:04:21.299 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.324 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.052) 0:01:30.826 *** 2021-09-15T22:04:21.342 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-09-15T22:04:21.343 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.368 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.043) 0:01:30.869 *** 2021-09-15T22:04:21.385 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.411 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.042) 0:01:30.912 *** 2021-09-15T22:04:21.438 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-09-15T22:04:21.440 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.464 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.052) 0:01:30.965 *** 2021-09-15T22:04:21.480 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.508 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.044) 0:01:31.010 *** 2021-09-15T22:04:21.538 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-09-15T22:04:21.540 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.564 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.055) 0:01:31.065 *** 2021-09-15T22:04:21.591 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.617 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.052) 0:01:31.118 *** 2021-09-15T22:04:21.633 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-09-15T22:04:21.635 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.667 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.050) 0:01:31.169 *** 2021-09-15T22:04:21.686 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.713 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.045) 0:01:31.214 *** 2021-09-15T22:04:21.730 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-09-15T22:04:21.732 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.757 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.044) 0:01:31.259 *** 2021-09-15T22:04:21.776 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.804 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.046) 0:01:31.305 *** 2021-09-15T22:04:21.821 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-09-15T22:04:21.823 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.847 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.043) 0:01:31.349 *** 2021-09-15T22:04:21.875 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.901 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.053) 0:01:31.403 *** 2021-09-15T22:04:21.920 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-09-15T22:04:21.921 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:21.956 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.054) 0:01:31.457 *** 2021-09-15T22:04:21.978 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:22.005 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:21 +0000 (0:00:00.048) 0:01:31.506 *** 2021-09-15T22:04:22.036 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-09-15T22:04:22.038 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:22.065 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:22 +0000 (0:00:00.059) 0:01:31.566 *** 2021-09-15T22:04:22.243 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:22.268 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:22 +0000 (0:00:00.203) 0:01:31.769 *** 2021-09-15T22:04:22.285 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-09-15T22:04:22.286 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:22.310 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:22 +0000 (0:00:00.042) 0:01:31.811 *** 2021-09-15T22:04:22.487 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:22.512 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:22 +0000 (0:00:00.201) 0:01:32.013 *** 2021-09-15T22:04:22.529 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-09-15T22:04:22.530 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:22.561 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:22 +0000 (0:00:00.048) 0:01:32.062 *** 2021-09-15T22:04:22.589 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:22.615 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:22 +0000 (0:00:00.054) 0:01:32.116 *** 2021-09-15T22:04:22.632 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-09-15T22:04:22.634 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:22.660 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:22 +0000 (0:00:00.045) 0:01:32.161 *** 2021-09-15T22:04:22.677 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:22.703 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:22 +0000 (0:00:00.043) 0:01:32.205 *** 2021-09-15T22:04:22.731 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-09-15T22:04:22.733 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:22.758 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:22 +0000 (0:00:00.054) 0:01:32.259 *** 2021-09-15T22:04:22.785 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:22.811 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:22 +0000 (0:00:00.053) 0:01:32.312 *** 2021-09-15T22:04:22.828 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-09-15T22:04:22.830 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:22.855 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:22 +0000 (0:00:00.043) 0:01:32.356 *** 2021-09-15T22:04:22.883 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:22.909 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:22 +0000 (0:00:00.053) 0:01:32.410 *** 2021-09-15T22:04:23.052 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-09-15T22:04:23.054 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005387", "end": "2021-09-15 22:04:22.648669", "rc": 0, "start": "2021-09-15 22:04:22.643282", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:04:23.078 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:23 +0000 (0:00:00.168) 0:01:32.578 *** 2021-09-15T22:04:23.271 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005516", "end": "2021-09-15 22:04:23.168392", "rc": 0, "start": "2021-09-15 22:04:23.162876", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:04:23.297 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:23 +0000 (0:00:00.219) 0:01:32.797 *** 2021-09-15T22:04:23.303 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-09-15T22:04:23.329 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:23 +0000 (0:00:00.033) 0:01:32.831 *** 2021-09-15T22:04:23.545 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:23 +0000 (0:00:00.215) 0:01:33.046 *** 2021-09-15T22:04:23.982 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-09-15T22:04:23.984 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-09-15T22:04:24.018 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:24 +0000 (0:00:00.473) 0:01:33.519 *** 2021-09-15T22:04:24.082 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-09-15T22:04:24.112 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:24 +0000 (0:00:00.094) 0:01:33.613 *** 2021-09-15T22:04:24.119 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:24.149 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:24 +0000 (0:00:00.036) 0:01:33.650 *** 2021-09-15T22:04:24.188 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:24.214 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:24 +0000 (0:00:00.065) 0:01:33.715 *** 2021-09-15T22:04:25.309 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-09-15T22:04:25.311 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} ok: [smithi184.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-09-15T22:04:26.269 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-09-15T22:04:26.270 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-09-15T22:04:26.296 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:26 +0000 (0:00:02.081) 0:01:35.797 *** 2021-09-15T22:04:26.323 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:26 +0000 (0:00:00.027) 0:01:35.825 *** 2021-09-15T22:04:27.031 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-09-15T22:04:27.034 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"cache_update_time": 1631743118, "cache_updated": false, "changed": false} 2021-09-15T22:04:27.056 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:27 +0000 (0:00:00.732) 0:01:36.557 *** 2021-09-15T22:04:27.064 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"cache_update_time": 1631743179, "cache_updated": false, "changed": false} 2021-09-15T22:04:27.090 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:27 +0000 (0:00:00.034) 0:01:36.591 *** 2021-09-15T22:04:27.117 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-09-15T22:04:27.155 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:27 +0000 (0:00:00.063) 0:01:36.655 *** 2021-09-15T22:04:27.199 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:27 +0000 (0:00:00.045) 0:01:36.700 *** 2021-09-15T22:04:27.364 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** [WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo 2021-09-15T22:04:27.366 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.031797", "end": "2021-09-15 22:04:27.258372", "rc": 0, "start": "2021-09-15 22:04:27.226575", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:04:27.391 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:27 +0000 (0:00:00.191) 0:01:36.892 *** 2021-09-15T22:04:27.430 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.033646", "end": "2021-09-15 22:04:27.024298", "rc": 0, "start": "2021-09-15 22:04:26.990652", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:04:27.457 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:27 +0000 (0:00:00.065) 0:01:36.958 *** 2021-09-15T22:04:29.578 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** ok: [smithi180.front.sepia.ceph.com] => {"cache_update_time": 1631743118, "cache_updated": false, "changed": false} 2021-09-15T22:04:29.602 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:29 +0000 (0:00:02.145) 0:01:39.103 *** 2021-09-15T22:04:29.654 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"cache_update_time": 1631743179, "cache_updated": false, "changed": false} 2021-09-15T22:04:29.696 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:29 +0000 (0:00:00.093) 0:01:39.197 *** 2021-09-15T22:04:37.517 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-09-15T22:04:37.519 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 174 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138110 files and directories currently installed.)\r 2021-09-15T22:04:37.520 INFO:teuthology.task.ansible.out:\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 174 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "( 2021-09-15T22:04:37.522 INFO:teuthology.task.ansible.out:Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138110 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-09-15T22:04:37.544 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:37 +0000 (0:00:07.848) 0:01:47.045 *** 2021-09-15T22:04:37.553 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 174 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138110 files and directories currently installed.)\r 2021-09-15T22:04:37.555 INFO:teuthology.task.ansible.out:\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 174 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "( 2021-09-15T22:04:37.557 INFO:teuthology.task.ansible.out:Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138110 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-09-15T22:04:37.586 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:37 +0000 (0:00:00.041) 0:01:47.087 *** 2021-09-15T22:04:38.267 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-09-15T22:04:38.270 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"cache_update_time": 1631743118, "cache_updated": false, "changed": false} 2021-09-15T22:04:38.293 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:38 +0000 (0:00:00.707) 0:01:47.795 *** 2021-09-15T22:04:38.312 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"cache_update_time": 1631743179, "cache_updated": false, "changed": false} 2021-09-15T22:04:38.339 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:38 +0000 (0:00:00.045) 0:01:47.840 *** 2021-09-15T22:04:38.380 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-09-15T22:04:38.382 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:38.407 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:38 +0000 (0:00:00.067) 0:01:47.908 *** 2021-09-15T22:04:38.425 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:04:38.452 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:38 +0000 (0:00:00.044) 0:01:47.953 *** 2021-09-15T22:04:59.120 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-09-15T22:04:59.122 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"cache_update_time": 1631743118, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n libpython3.8 libpython3.8-dev libpython3.8-minimal libpython3.8-stdlib\n librados2 librbd1 python3.8 python3.8-dev python3.8-minimal python3.8-venv\n qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn python3.8-doc binfmt-support samba vde2\n debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 python3-venv python3.8-venv qemu-block-extra\n qemu-system-common qemu-system-x86 qemu-utils\nThe following packages will be upgraded:\n git libpython3.8 libpython3.8-dev libpython3.8-minimal libpython3.8-stdlib\n python3.8 python3.8-dev python3.8-minimal\n8 upgraded, 8 newly installed, 0 to remove and 166 not upgraded.\nNeed to get 29.0 MB of archives.\nAfter this operation, 62.8 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3.8-dev amd64 3.8.10-0ubuntu1~20.04 [510 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3.8 amd64 3.8.10-0ubuntu1~20.04 [387 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpython3.8-dev amd64 3.8.10-0ubuntu1~20.04 [3943 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpython3.8 amd64 3.8.10-0ubuntu1~20.04 [1625 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpython3.8-stdlib amd64 3.8.10-0ubuntu1~20.04 [1675 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-u 2021-09-15T22:04:59.124 INFO:teuthology.task.ansible.out:pdates/main amd64 python3.8-minimal amd64 3.8.10-0ubuntu1~20.04 [1898 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpython3.8-minimal amd64 3.8.10-0ubuntu1~20.04 [717 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.2 [4554 kB]\nGet:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.2 [3210 kB]\nGet:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.2 [1624 kB]\nGet:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3.8-venv amd64 3.8.10-0ubuntu1~20.04 [5456 B]\nGet:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-venv amd64 3.8.2-0ubuntu2 [1228 B]\nGet:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]\nGet:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]\nGet:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.17 [6738 kB]\nGet:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]\nFetched 29.0 MB in 2s (17.3 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../00-python3.8-dev_3.8.10-0ubuntu1~20.04_amd64.deb ...\r\nUnpacking python3.8-de 2021-09-15T22:04:59.125 INFO:teuthology.task.ansible.out:v (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...\r\nPreparing to unpack .../01-python3.8_3.8.10-0ubuntu1~20.04_amd64.deb ...\r\nUnpacking python3.8 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...\r\nPreparing to unpack .../02-libpython3.8-dev_3.8.10-0ubuntu1~20.04_amd64.deb ...\r\nUnpacking libpython3.8-dev:amd64 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...\r\nPreparing to unpack .../03-libpython3.8_3.8.10-0ubuntu1~20.04_amd64.deb ...\r\nUnpacking libpython3.8:amd64 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...\r\nPreparing to unpack .../04-libpython3.8-stdlib_3.8.10-0ubuntu1~20.04_amd64.deb ...\r\nUnpacking libpython3.8-stdlib:amd64 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...\r\nPreparing to unpack .../05-python3.8-minimal_3.8.10-0ubuntu1~20.04_amd64.deb ...\r\nUnpacking python3.8-minimal (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...\r\nPreparing to unpack .../06-libpython3.8-minimal_3.8.10-0ubuntu1~20.04_amd64.deb ...\r\nUnpacking libpython3.8-minimal:amd64 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...\r\nPreparing to unpack .../07-git_1%3a2.25.1-1ubuntu3.2_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.2) over (1:2.25.1-1ubuntu3.1) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../08-librados2_15.2.13-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../09-librbd1_15.2.13-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package python3.8-venv.\r\nPreparing to unpack .../10-python3.8-venv_3.8.10-0ubuntu1~20.04_amd64.deb ...\r\nUnpacking python3.8-venv (3.8.10-0ubuntu1~20.04) ...\r\nSelecting previously unselected package python3-venv.\r\nPreparing to unpack .../11-python3-venv_3.8.2-0ubuntu2_amd64.deb ...\r\nUnpacking python3-venv (3.8.2-0ubuntu2) ...\r\nSelecting previously unselected package qemu-block-extra:amd64 2021-09-15T22:04:59.127 INFO:teuthology.task.ansible.out:.\r\nPreparing to unpack .../12-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../13-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../14-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../15-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.17) ...\r\nSetting up librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nSetting up libpython3.8-minimal:amd64 (3.8.10-0ubuntu1~20.04) ...\r\nSetting up git (1:2.25.1-1ubuntu3.2) ...\r\nSetting up librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nSetting up python3.8-minimal (3.8.10-0ubuntu1~20.04) ...\r\nSetting up libpython3.8-stdlib:amd64 (3.8.10-0ubuntu1~20.04) ...\r\nSetting up python3.8 (3.8.10-0ubuntu1~20.04) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSetting up libpython3.8:amd64 (3.8.10-0ubuntu1~20.04) ...\r\nSetting up python3.8-venv (3.8.10-0ubuntu1~20.04) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.17) ...\r\nSetting up python3-venv (3.8.2-0ubuntu2) ...\r\nSetting up libpython3.8-dev:amd64 (3.8.10-0ubuntu1~20.04) ...\r\nSetting up python3.8-dev (3.8.10-0ubuntu1~20.04) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " libpython3.8 libpython3.8-dev libpytho 2021-09-15T22:04:59.129 INFO:teuthology.task.ansible.out:n3.8-minimal libpython3.8-stdlib", " librados2 librbd1 python3.8 python3.8-dev python3.8-minimal python3.8-venv", " qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn python3.8-doc binfmt-support samba vde2", " debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 python3-venv python3.8-venv qemu-block-extra", " qemu-system-common qemu-system-x86 qemu-utils", "The following packages will be upgraded:", " git libpython3.8 libpython3.8-dev libpython3.8-minimal libpython3.8-stdlib", " python3.8 python3.8-dev python3.8-minimal", "8 upgraded, 8 newly installed, 0 to remove and 166 not upgraded.", "Need to get 29.0 MB of archives.", "After this operation, 62.8 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3.8-dev amd64 3.8.10-0ubuntu1~20.04 [510 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3.8 amd64 3.8.10-0ubuntu1~20.04 [387 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpython3.8-dev amd64 3.8.10-0ubuntu1~20.04 [3943 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpython3.8 amd64 3.8.10-0ubuntu1~20.04 [1625 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpython3.8-stdlib amd64 3.8.10-0ubuntu1~20.04 [1675 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3.8-minimal amd64 3.8.10-0ubuntu1~20.04 [1898 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpython3.8-minimal amd64 3.8.10-0ubuntu1~20.04 [717 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.2 [4554 kB]", "Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.2 [3210 kB]", "Get:10 http://archive.ubuntu.com/ubuntu focal 2021-09-15T22:04:59.130 INFO:teuthology.task.ansible.out:-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.2 [1624 kB]", "Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3.8-venv amd64 3.8.10-0ubuntu1~20.04 [5456 B]", "Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-venv amd64 3.8.2-0ubuntu2 [1228 B]", "Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]", "Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]", "Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.17 [6738 kB]", "Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]", "Fetched 29.0 MB in 2s (17.3 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../00-python3.8-dev_3.8.10-0ubuntu1~20.04_amd64.deb ...", "Unpacking python3.8-dev (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...", "Preparing to unpack .../01-python3.8_3.8.10-0ubuntu1~20.04_amd64.deb ...", "Unpacking python3.8 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...", "Preparing to unpack .../02-libpython3.8-dev_3.8.10-0ubuntu1~20.04_amd64.deb ...", "Unpacking libpython3.8-dev:amd64 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...", "Preparing to unpack .../03-lib 2021-09-15T22:04:59.132 INFO:teuthology.task.ansible.out:python3.8_3.8.10-0ubuntu1~20.04_amd64.deb ...", "Unpacking libpython3.8:amd64 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...", "Preparing to unpack .../04-libpython3.8-stdlib_3.8.10-0ubuntu1~20.04_amd64.deb ...", "Unpacking libpython3.8-stdlib:amd64 (3.8.10-0ubuntu1~20.04) over (3.8. 2021-09-15T22:04:59.132 INFO:teuthology.task.ansible.out:5-1~20.04.2) ...", "Preparing to unpack .../05-python3.8-minimal_3.8.10-0ubuntu1~20.04_amd64.deb ...", "Unpacking python3.8-minimal (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...", "Preparing to unpack .../06-libpython3.8-minimal_3.8.10-0ubuntu1~20.04_amd64.deb ...", "Unpacking libpython3.8-minimal:amd64 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...", "Preparing to unpack .../07-git_1%3a2.25.1-1ubuntu3.2_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.2) over (1:2.25.1-1ubuntu3.1) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../08-librados2_15.2.13-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../09-librbd1_15.2.13-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Selecting previously unselected package python3.8-venv.", "Preparing to unpack .../10-python3.8-venv_3.8.10-0ubuntu1~20.04_amd64.deb ...", "Unpacking python3.8-venv (3.8.10-0ubuntu1~20.04) ...", "Selecting previously unselected package python3-venv.", "Preparing to unpack .../11-python3-venv_3.8.2-0ubuntu2_amd64.deb ...", "Unpacking python3-venv (3.8.2-0ubuntu2) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../12-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../13-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", 2021-09-15T22:04:59.134 INFO:teuthology.task.ansible.out: "Preparing to unpack .../14-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../15-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.17) ...", "Setting up librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Setting up libpython3.8-minimal:amd64 (3.8.10-0ubuntu1~20.04) ...", "Setting up git (1:2.25.1-1ubuntu3.2) ...", "Setting up librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Setting up python3.8-minimal (3.8.10-0ubuntu1~20.04) ...", "Setting up libpython3.8-stdlib:amd64 (3.8.10-0ubuntu1~20.04) ...", "Setting up python3.8 (3.8.10-0ubuntu1~20.04) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Setting up libpython3.8:amd64 (3.8.10-0ubuntu1~20.04) ...", "Setting up python3.8-venv (3.8.10-0ubuntu1~20.04) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.17) ...", "Setting up python3-venv (3.8.2-0ubuntu2) ...", "Setting up libpython3.8-dev:amd64 (3.8.10-0ubuntu1~20.04) ...", "Setting up python3.8-dev (3.8.10-0ubuntu1~20.04) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-09-15T22:04:59.158 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:59 +0000 (0:00:20.706) 0:02:08.659 *** 2021-09-15T22:04:59.649 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"cache_update_time": 1631743179, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n libpython3.8 libpython3.8-dev libpython3.8-minimal libpython3.8-stdlib\n librados2 librbd1 python3.8 python3.8-dev python3.8-minimal python3.8-venv\n qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn python3.8-doc binfmt-support samba vde2\n debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 python3-venv python3.8-venv qemu-block-extra\n qemu-system-common qemu-system-x86 qemu-utils\nThe following packages will be upgraded:\n git libpython3.8 libpython3.8-dev libpython3.8-minimal libpython3.8-stdlib\n python3.8 python3.8-dev python3.8-minimal\n8 upgraded, 8 newly installed, 0 to remove and 166 not upgraded.\nNeed to get 29.0 MB of archives.\nAfter this operation, 62.8 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3.8-dev amd64 3.8.10-0ubuntu1~20.04 [510 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3.8 amd64 3.8.10-0ubuntu1~20.04 [387 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpython3.8-dev amd64 3.8.10-0ubuntu1~20.04 [3943 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpython3.8 amd64 3.8.10-0ubuntu1~20.04 [1625 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpython3.8-stdlib amd64 3.8.10-0ubuntu1~20.04 [1675 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-u 2021-09-15T22:04:59.651 INFO:teuthology.task.ansible.out:pdates/main amd64 python3.8-minimal amd64 3.8.10-0ubuntu1~20.04 [1898 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpython3.8-minimal amd64 3.8.10-0ubuntu1~20.04 [717 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.2 [4554 kB]\nGet:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.2 [3210 kB]\nGet:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.2 [1624 kB]\nGet:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3.8-venv amd64 3.8.10-0ubuntu1~20.04 [5456 B]\nGet:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-venv amd64 3.8.2-0ubuntu2 [1228 B]\nGet:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]\nGet:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]\nGet:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.17 [6738 kB]\nGet:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]\nFetched 29.0 MB in 2s (17.5 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138038 files and directories currently installed.)\r\nPreparing to unpack .../00-python3.8-dev_3.8.10-0ubuntu1~20.04_amd64.deb ...\r\nUnpacking python3.8-de 2021-09-15T22:04:59.653 INFO:teuthology.task.ansible.out:v (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...\r\nPreparing to unpack .../01-python3.8_3.8.10-0ubuntu1~20.04_amd64.deb ...\r\nUnpacking python3.8 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...\r\nPreparing to unpack .../02-libpython3.8-dev_3.8.10-0ubuntu1~20.04_amd64.deb ...\r\nUnpacking libpython3.8-dev:amd64 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...\r\nPreparing to unpack .../03-libpython3.8_3.8.10-0ubuntu1~20.04_amd64.deb ...\r\nUnpacking libpython3.8:amd64 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...\r\nPreparing to unpack .../04-libpython3.8-stdlib_3.8.10-0ubuntu1~20.04_amd64.deb ...\r\nUnpacking libpython3.8-stdlib:amd64 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...\r\nPreparing to unpack .../05-python3.8-minimal_3.8.10-0ubuntu1~20.04_amd64.deb ...\r\nUnpacking python3.8-minimal (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...\r\nPreparing to unpack .../06-libpython3.8-minimal_3.8.10-0ubuntu1~20.04_amd64.deb ...\r\nUnpacking libpython3.8-minimal:amd64 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...\r\nPreparing to unpack .../07-git_1%3a2.25.1-1ubuntu3.2_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.2) over (1:2.25.1-1ubuntu3.1) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../08-librados2_15.2.13-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../09-librbd1_15.2.13-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package python3.8-venv.\r\nPreparing to unpack .../10-python3.8-venv_3.8.10-0ubuntu1~20.04_amd64.deb ...\r\nUnpacking python3.8-venv (3.8.10-0ubuntu1~20.04) ...\r\nSelecting previously unselected package python3-venv.\r\nPreparing to unpack .../11-python3-venv_3.8.2-0ubuntu2_amd64.deb ...\r\nUnpacking python3-venv (3.8.2-0ubuntu2) ...\r\nSelecting previously unselected package qemu-block-extra:amd64 2021-09-15T22:04:59.655 INFO:teuthology.task.ansible.out:.\r\nPreparing to unpack .../12-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../13-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../14-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../15-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.17) ...\r\nSetting up librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nSetting up libpython3.8-minimal:amd64 (3.8.10-0ubuntu1~20.04) ...\r\nSetting up git (1:2.25.1-1ubuntu3.2) ...\r\nSetting up librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nSetting up python3.8-minimal (3.8.10-0ubuntu1~20.04) ...\r\nSetting up libpython3.8-stdlib:amd64 (3.8.10-0ubuntu1~20.04) ...\r\nSetting up python3.8 (3.8.10-0ubuntu1~20.04) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSetting up libpython3.8:amd64 (3.8.10-0ubuntu1~20.04) ...\r\nSetting up python3.8-venv (3.8.10-0ubuntu1~20.04) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.17) ...\r\nSetting up python3-venv (3.8.2-0ubuntu2) ...\r\nSetting up libpython3.8-dev:amd64 (3.8.10-0ubuntu1~20.04) ...\r\nSetting up python3.8-dev (3.8.10-0ubuntu1~20.04) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " libpython3.8 libpython3.8-dev libpytho 2021-09-15T22:04:59.656 INFO:teuthology.task.ansible.out:n3.8-minimal libpython3.8-stdlib", " librados2 librbd1 python3.8 python3.8-dev python3.8-minimal python3.8-venv", " qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn python3.8-doc binfmt-support samba vde2", " debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 python3-venv python3.8-venv qemu-block-extra", " qemu-system-common qemu-system-x86 qemu-utils", "The following packages will be upgraded:", " git libpython3.8 libpython3.8-dev libpython3.8-minimal libpython3.8-stdlib", " python3.8 python3.8-dev python3.8-minimal", "8 upgraded, 8 newly installed, 0 to remove and 166 not upgraded.", "Need to get 29.0 MB of archives.", "After this operation, 62.8 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3.8-dev amd64 3.8.10-0ubuntu1~20.04 [510 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3.8 amd64 3.8.10-0ubuntu1~20.04 [387 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpython3.8-dev amd64 3.8.10-0ubuntu1~20.04 [3943 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpython3.8 amd64 3.8.10-0ubuntu1~20.04 [1625 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpython3.8-stdlib amd64 3.8.10-0ubuntu1~20.04 [1675 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3.8-minimal amd64 3.8.10-0ubuntu1~20.04 [1898 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpython3.8-minimal amd64 3.8.10-0ubuntu1~20.04 [717 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.2 [4554 kB]", "Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.2 [3210 kB]", "Get:10 http://archive.ubuntu.com/ubuntu focal 2021-09-15T22:04:59.658 INFO:teuthology.task.ansible.out:-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.2 [1624 kB]", "Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3.8-venv amd64 3.8.10-0ubuntu1~20.04 [5456 B]", "Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-venv amd64 3.8.2-0ubuntu2 [1228 B]", "Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]", "Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]", "Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.17 [6738 kB]", "Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]", "Fetched 29.0 MB in 2s (17.5 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138038 files and directories currently installed.)", "Preparing to unpack .../00-python3.8-dev_3.8.10-0ubuntu1~20.04_amd64.deb ...", "Unpacking python3.8-dev (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...", "Preparing to unpack .../01-python3.8_3.8.10-0ubuntu1~20.04_amd64.deb ...", "Unpacking python3.8 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...", "Preparing to unpack .../02-libpython3.8-dev_3.8.10-0ubuntu1~20.04_amd64.deb ...", "Unpacking libpython3.8-dev:amd64 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...", "Preparing to unpack .../03-lib 2021-09-15T22:04:59.659 INFO:teuthology.task.ansible.out:python3.8_3.8.10-0ubuntu1~20.04_amd64.deb ...", "Unpacking libpython3.8:amd64 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...", "Preparing to unpack .../04-libpython3.8-stdlib_3.8.10-0ubuntu1~20.04_amd64.deb ...", "Unpacking libpython3.8-stdlib:amd64 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...", "Preparing to unpack .../05-python3.8-minimal_3.8.10-0ubuntu1~20.04_amd64.deb ...", "Unpacking python3.8-minimal (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...", "Preparing to unpack .../06-libpython3.8-minimal_3.8.10-0ubuntu1~20.04_amd64.deb ...", "Unpacking libpython3.8-minimal:amd64 (3.8.10-0ubuntu1~20.04) over (3.8.5-1~20.04.2) ...", "Preparing to unpack .../07-git_1%3a2.25.1-1ubuntu3.2_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.2) over (1:2.25.1-1ubuntu3.1) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../08-librados2_15.2.13-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../09-librbd1_15.2.13-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Selecting previously unselected package python3.8-venv.", "Preparing to unpack .../10-python3.8-venv_3.8.10-0ubuntu1~20.04_amd64.deb ...", "Unpacking python3.8-venv (3.8.10-0ubuntu1~20.04) ...", "Selecting previously unselected package python3-venv.", "Preparing to unpack .../11-python3-venv_3.8.2-0ubuntu2_amd64.deb ...", "Unpacking python3-venv (3.8.2-0ubuntu2) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../12-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../13-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", 2021-09-15T22:04:59.661 INFO:teuthology.task.ansible.out: "Preparing to unpack .../14-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../15-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.17) ...", "Setting up librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Setting up libpython3.8-minimal:amd64 (3.8.10-0ubuntu1~20.04) ...", "Setting up git (1:2.25.1-1ubuntu3.2) ...", "Setting up librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Setting up python3.8-minimal (3.8.10-0ubuntu1~20.04) ...", "Setting up libpython3.8-stdlib:amd64 (3.8.10-0ubuntu1~20.04) ...", "Setting up python3.8 (3.8.10-0ubuntu1~20.04) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Setting up libpython3.8:amd64 (3.8.10-0ubuntu1~20.04) ...", "Setting up python3.8-venv (3.8.10-0ubuntu1~20.04) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.17) ...", "Setting up python3-venv (3.8.2-0ubuntu2) ...", "Setting up libpython3.8-dev:amd64 (3.8.10-0ubuntu1~20.04) ...", "Setting up python3.8-dev (3.8.10-0ubuntu1~20.04) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-09-15T22:04:59.684 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:59 +0000 (0:00:00.526) 0:02:09.186 *** 2021-09-15T22:04:59.878 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-09-15T22:04:59.880 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"cache_update_time": 1631743118, "cache_updated": false, "changed": false} 2021-09-15T22:04:59.905 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:04:59 +0000 (0:00:00.220) 0:02:09.406 *** 2021-09-15T22:05:00.396 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"cache_update_time": 1631743179, "cache_updated": false, "changed": false} 2021-09-15T22:05:00.421 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:00 +0000 (0:00:00.516) 0:02:09.922 *** 2021-09-15T22:05:00.616 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-09-15T22:05:00.618 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"cache_update_time": 1631743118, "cache_updated": false, "changed": false} 2021-09-15T22:05:00.642 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:00 +0000 (0:00:00.220) 0:02:10.143 *** 2021-09-15T22:05:00.826 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-09-15T22:05:00.828 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-09-15T22:05:00.854 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:00 +0000 (0:00:00.212) 0:02:10.355 *** 2021-09-15T22:05:00.933 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-09-15T22:05:00.934 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:00.961 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:00 +0000 (0:00:00.106) 0:02:10.462 *** 2021-09-15T22:05:01.126 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** ok: [smithi184.front.sepia.ceph.com] => {"cache_update_time": 1631743179, "cache_updated": false, "changed": false} 2021-09-15T22:05:01.152 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:01 +0000 (0:00:00.190) 0:02:10.653 *** 2021-09-15T22:05:01.158 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-09-15T22:05:01.160 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-09-15T22:05:01.185 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:01 +0000 (0:00:00.033) 0:02:10.687 *** 2021-09-15T22:05:01.351 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-09-15T22:05:01.376 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:01 +0000 (0:00:00.190) 0:02:10.877 *** 2021-09-15T22:05:01.456 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-09-15T22:05:01.458 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:01.481 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:01 +0000 (0:00:00.105) 0:02:10.983 *** 2021-09-15T22:05:01.583 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-09-15T22:05:01.585 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-09-15T22:05:01.614 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:01 +0000 (0:00:00.132) 0:02:11.115 *** 2021-09-15T22:05:01.674 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-09-15T22:05:01.676 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-09-15T22:05:01.705 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:01 +0000 (0:00:00.090) 0:02:11.206 *** 2021-09-15T22:05:01.838 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-09-15T22:05:01.840 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-09-15T22:05:01.866 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:01 +0000 (0:00:00.160) 0:02:11.367 *** 2021-09-15T22:05:02.054 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-09-15T22:05:02.056 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-09-15T22:05:02.088 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:02 +0000 (0:00:00.222) 0:02:11.590 *** 2021-09-15T22:05:02.108 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-09-15T22:05:02.110 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-09-15T22:05:02.139 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:02 +0000 (0:00:00.050) 0:02:11.640 *** 2021-09-15T22:05:02.355 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-09-15T22:05:02.357 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-09-15T22:05:02.379 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:02 +0000 (0:00:00.240) 0:02:11.881 *** 2021-09-15T22:05:02.407 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-09-15T22:05:02.409 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-09-15 22:02:22 UTC", "ActiveEnterTimestampMonotonic": "16345187", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target network.target sysinit.target -.mount systemd-journald.socket basic.target system.slice systemd-tmpfiles-setup.service remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-09-15 22:02:21 UTC", "AssertTimestampMonotonic": "15645301", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-09-15 22:02:21 UTC", "ConditionTimestampMonotonic": "15645301", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup" 2021-09-15T22:05:02.410 INFO:teuthology.task.ansible.out:: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1026", "ExecMainStartTimestamp": "Wed 2021-09-15 22:02:22 UTC", "ExecMainStartTimestampMonotonic": "16345145", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "1844674407370 2021-09-15T22:05:02.412 INFO:teuthology.task.ansible.out:9551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-09-15 22:02:21 UTC", "InactiveExitTimestampMonotonic": "15646457", "InvocationID": "8399e90076ac497c9501bf16806eeb6d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "63361", "LimitNPROCSoft": "63361", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "63361", "LimitSIGPENDINGSoft": "63361", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1026", "MemoryAccounting": "yes", "MemoryCurrent": "10010624", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy" 2021-09-15T22:05:02.414 INFO:teuthology.task.ansible.out:: "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-09-15 22:02:22 UTC", "StateChangeTimestampMonotonic": "16345187", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "19008", "TimeoutAbortUSec": "1 2021-09-15T22:05:02.415 INFO:teuthology.task.ansible.out:min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-09-15T22:05:02.435 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:02 +0000 (0:00:00.055) 0:02:11.937 *** 2021-09-15T22:05:02.504 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-09-15T22:05:02.506 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:02.528 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:02 +0000 (0:00:00.092) 0:02:12.029 *** 2021-09-15T22:05:02.576 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-09-15T22:05:02.578 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-09-15T22:05:02.605 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:02 +0000 (0:00:00.074) 0:02:12.104 *** 2021-09-15T22:05:02.609 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-09-15T22:05:02.611 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:02.636 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:02 +0000 (0:00:00.033) 0:02:12.137 *** 2021-09-15T22:05:02.706 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-09-15T22:05:02.707 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:02.735 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:02 +0000 (0:00:00.098) 0:02:12.236 *** 2021-09-15T22:05:02.805 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:02.830 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:02 +0000 (0:00:00.094) 0:02:12.331 *** 2021-09-15T22:05:02.899 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-09-15T22:05:02.901 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:02.924 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:02 +0000 (0:00:00.094) 0:02:12.426 *** 2021-09-15T22:05:02.932 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-09-15T22:05:02.934 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-09-15 22:02:28 UTC", "ActiveEnterTimestampMonotonic": "15524138", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target nss-lookup.target basic.target systemd-journald.socket system.slice network.target remote-fs.target -.mount systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-09-15 22:02:28 UTC", "AssertTimestampMonotonic": "14979611", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-09-15 22:02:28 UTC", "ConditionTimestampMonotonic": "14979611", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup" 2021-09-15T22:05:02.935 INFO:teuthology.task.ansible.out:: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1006", "ExecMainStartTimestamp": "Wed 2021-09-15 22:02:28 UTC", "ExecMainStartTimestampMonotonic": "15524091", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "1844674407370 2021-09-15T22:05:02.937 INFO:teuthology.task.ansible.out:9551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-09-15 22:02:28 UTC", "InactiveExitTimestampMonotonic": "14980679", "InvocationID": "a8029fc0d0b6465e91214adb01bd1d6c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1006", "MemoryAccounting": "yes", "MemoryCurrent": "10018816", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPol 2021-09-15T22:05:02.939 INFO:teuthology.task.ansible.out:icy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-09-15 22:02:28 UTC", "StateChangeTimestampMonotonic": "15524138", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38333", "TimeoutAbortUSec" 2021-09-15T22:05:02.940 INFO:teuthology.task.ansible.out:: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-09-15T22:05:02.963 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:02 +0000 (0:00:00.038) 0:02:12.464 *** 2021-09-15T22:05:02.991 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-09-15T22:05:02.993 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.017 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.054) 0:02:12.518 *** 2021-09-15T22:05:03.035 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-09-15T22:05:03.037 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.061 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.043) 0:02:12.562 *** 2021-09-15T22:05:03.088 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-09-15T22:05:03.090 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.114 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.052) 0:02:12.615 *** 2021-09-15T22:05:03.131 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-09-15T22:05:03.133 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.158 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.043) 0:02:12.659 *** 2021-09-15T22:05:03.186 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-09-15T22:05:03.188 INFO:teuthology.task.ansible.out: skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.212 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.054) 0:02:12.713 *** 2021-09-15T22:05:03.229 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-09-15T22:05:03.230 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.257 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.045) 0:02:12.758 *** 2021-09-15T22:05:03.285 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-09-15T22:05:03.286 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.310 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.053) 0:02:12.811 *** 2021-09-15T22:05:03.338 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-09-15T22:05:03.340 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.367 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.056) 0:02:12.868 *** 2021-09-15T22:05:03.384 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-09-15T22:05:03.386 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.411 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.043) 0:02:12.912 *** 2021-09-15T22:05:03.438 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-09-15T22:05:03.441 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.464 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.053) 0:02:12.966 *** 2021-09-15T22:05:03.481 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-09-15T22:05:03.483 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.508 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.043) 0:02:13.010 *** 2021-09-15T22:05:03.536 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-09-15T22:05:03.538 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.561 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.053) 0:02:13.063 *** 2021-09-15T22:05:03.578 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-09-15T22:05:03.580 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.605 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.043) 0:02:13.106 *** 2021-09-15T22:05:03.622 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-09-15T22:05:03.624 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.649 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.044) 0:02:13.150 *** 2021-09-15T22:05:03.677 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-09-15T22:05:03.679 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.703 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.054) 0:02:13.204 *** 2021-09-15T22:05:03.731 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-09-15T22:05:03.733 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.757 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.053) 0:02:13.258 *** 2021-09-15T22:05:03.775 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.801 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.043) 0:02:13.302 *** 2021-09-15T22:05:03.830 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-09-15T22:05:03.831 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.855 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.054) 0:02:13.357 *** 2021-09-15T22:05:03.872 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-09-15T22:05:03.874 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.902 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.046) 0:02:13.404 *** 2021-09-15T22:05:03.931 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-09-15T22:05:03.933 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:03.966 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:03 +0000 (0:00:00.063) 0:02:13.467 *** 2021-09-15T22:05:03.994 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-09-15T22:05:03.996 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.020 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.054) 0:02:13.522 *** 2021-09-15T22:05:04.038 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-09-15T22:05:04.040 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.069 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.048) 0:02:13.570 *** 2021-09-15T22:05:04.086 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-09-15T22:05:04.088 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.115 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.046) 0:02:13.617 *** 2021-09-15T22:05:04.133 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-09-15T22:05:04.134 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.163 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.047) 0:02:13.664 *** 2021-09-15T22:05:04.203 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.229 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.066) 0:02:13.731 *** 2021-09-15T22:05:04.246 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.274 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.044) 0:02:13.775 *** 2021-09-15T22:05:04.303 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-09-15T22:05:04.305 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.330 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.055) 0:02:13.831 *** 2021-09-15T22:05:04.348 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-09-15T22:05:04.350 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.374 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.044) 0:02:13.875 *** 2021-09-15T22:05:04.404 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-09-15T22:05:04.406 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.431 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.056) 0:02:13.932 *** 2021-09-15T22:05:04.469 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-09-15T22:05:04.471 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.500 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.069) 0:02:14.001 *** 2021-09-15T22:05:04.520 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-09-15T22:05:04.521 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.547 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.046) 0:02:14.048 *** 2021-09-15T22:05:04.574 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-09-15T22:05:04.576 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.604 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.057) 0:02:14.105 *** 2021-09-15T22:05:04.623 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-09-15T22:05:04.625 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.651 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.046) 0:02:14.152 *** 2021-09-15T22:05:04.679 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-09-15T22:05:04.681 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.705 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.054) 0:02:14.206 *** 2021-09-15T22:05:04.722 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-09-15T22:05:04.724 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.749 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.043) 0:02:14.250 *** 2021-09-15T22:05:04.780 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.806 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.057) 0:02:14.307 *** 2021-09-15T22:05:04.824 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-09-15T22:05:04.827 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.852 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.046) 0:02:14.354 *** 2021-09-15T22:05:04.882 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.910 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.057) 0:02:14.412 *** 2021-09-15T22:05:04.930 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-09-15T22:05:04.932 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:04.960 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:04 +0000 (0:00:00.047) 0:02:14.459 *** 2021-09-15T22:05:04.998 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:05.036 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:05 +0000 (0:00:00.078) 0:02:14.538 *** 2021-09-15T22:05:05.047 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-09-15T22:05:05.049 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:05.078 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:05 +0000 (0:00:00.041) 0:02:14.579 *** 2021-09-15T22:05:05.118 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:05.143 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:05 +0000 (0:00:00.065) 0:02:14.645 *** 2021-09-15T22:05:05.214 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-09-15T22:05:05.215 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:05.238 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:05 +0000 (0:00:00.094) 0:02:14.739 *** 2021-09-15T22:05:05.275 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-09-15T22:05:05.277 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-09-15T22:05:05.305 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:05 +0000 (0:00:00.067) 0:02:14.806 *** 2021-09-15T22:05:05.322 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-09-15T22:05:05.324 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:05.349 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:05 +0000 (0:00:00.043) 0:02:14.850 *** 2021-09-15T22:05:05.417 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-09-15T22:05:05.419 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:05.441 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:05 +0000 (0:00:00.092) 0:02:14.943 *** 2021-09-15T22:05:05.510 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-09-15T22:05:05.511 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:05.534 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:05 +0000 (0:00:00.092) 0:02:15.035 *** 2021-09-15T22:05:05.602 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:05.627 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:05 +0000 (0:00:00.093) 0:02:15.128 *** 2021-09-15T22:05:05.676 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-09-15T22:05:05.678 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-09-15T22:05:05.705 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:05 +0000 (0:00:00.077) 0:02:15.206 *** 2021-09-15T22:05:05.787 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-09-15T22:05:05.789 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:05.811 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:05 +0000 (0:00:00.106) 0:02:15.313 *** 2021-09-15T22:05:05.819 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-09-15T22:05:05.820 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-09-15T22:05:05.845 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:05 +0000 (0:00:00.033) 0:02:15.346 *** 2021-09-15T22:05:06.197 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-09-15T22:05:06.199 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-09-15T22:05:06.225 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:06 +0000 (0:00:00.380) 0:02:15.726 *** 2021-09-15T22:05:06.233 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-09-15T22:05:06.235 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-09-15T22:05:06.273 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:06 +0000 (0:00:00.047) 0:02:15.774 *** 2021-09-15T22:05:06.356 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-09-15T22:05:06.358 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:06.381 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:06 +0000 (0:00:00.107) 0:02:15.882 *** 2021-09-15T22:05:06.606 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-09-15T22:05:06.608 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-09-15T22:05:06.636 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:06 +0000 (0:00:00.255) 0:02:16.138 *** 2021-09-15T22:05:06.760 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-09-15T22:05:06.762 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-09-15T22:05:06.786 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:06 +0000 (0:00:00.150) 0:02:16.288 *** 2021-09-15T22:05:07.024 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-09-15T22:05:07.052 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:07 +0000 (0:00:00.265) 0:02:16.553 *** 2021-09-15T22:05:07.165 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-09-15T22:05:07.166 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-09-15T22:05:07.191 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:07 +0000 (0:00:00.139) 0:02:16.693 *** 2021-09-15T22:05:07.229 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-09-15T22:05:07.231 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-09-15T22:05:07.256 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:07 +0000 (0:00:00.064) 0:02:16.757 *** 2021-09-15T22:05:07.336 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-09-15T22:05:07.337 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:07.360 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:07 +0000 (0:00:00.103) 0:02:16.861 *** 2021-09-15T22:05:07.428 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-09-15T22:05:07.430 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:07.453 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:07 +0000 (0:00:00.093) 0:02:16.955 *** 2021-09-15T22:05:07.531 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-09-15T22:05:07.533 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:07.556 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:07 +0000 (0:00:00.102) 0:02:17.057 *** 2021-09-15T22:05:07.572 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-09-15T22:05:07.575 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-09-15T22:05:07.599 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:07 +0000 (0:00:00.042) 0:02:17.100 *** 2021-09-15T22:05:07.626 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-09-15T22:05:07.628 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:07.652 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:07 +0000 (0:00:00.053) 0:02:17.153 *** 2021-09-15T22:05:07.733 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-09-15T22:05:07.735 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:07.761 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:07 +0000 (0:00:00.109) 0:02:17.263 *** 2021-09-15T22:05:07.780 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi184.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-09-15T22:05:07.808 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:07 +0000 (0:00:00.045) 0:02:17.309 *** 2021-09-15T22:05:07.835 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-09-15T22:05:07.837 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-09-15T22:05:07.861 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:07 +0000 (0:00:00.053) 0:02:17.362 *** 2021-09-15T22:05:07.878 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-09-15T22:05:07.880 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:07.904 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:07 +0000 (0:00:00.042) 0:02:17.405 *** 2021-09-15T22:05:07.941 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-09-15T22:05:07.943 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:07.952 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:07.954 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:07.964 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:07.975 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:07.977 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi180.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.002 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:07 +0000 (0:00:00.098) 0:02:17.503 *** 2021-09-15T22:05:08.010 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-09-15T22:05:08.012 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.023 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.024 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.026 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.036 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.037 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.068 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:08 +0000 (0:00:00.066) 0:02:17.570 *** 2021-09-15T22:05:08.074 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-09-15T22:05:08.075 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.100 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:08 +0000 (0:00:00.031) 0:02:17.601 *** 2021-09-15T22:05:08.189 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.213 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:08 +0000 (0:00:00.113) 0:02:17.714 *** 2021-09-15T22:05:08.292 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-09-15T22:05:08.294 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.316 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:08 +0000 (0:00:00.103) 0:02:17.818 *** 2021-09-15T22:05:08.323 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-09-15T22:05:08.325 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003101", "end": "2021-09-15 22:05:08.280784", "rc": 0, "start": "2021-09-15 22:05:08.277683", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/bin/teuthology-lock"]} 2021-09-15T22:05:08.352 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:08 +0000 (0:00:00.035) 0:02:17.854 *** 2021-09-15T22:05:08.391 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-09-15T22:05:08.393 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-09-15T22:05:08.429 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:08 +0000 (0:00:00.076) 0:02:17.930 *** 2021-09-15T22:05:08.437 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-09-15T22:05:08.438 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.470 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:08 +0000 (0:00:00.041) 0:02:17.971 *** 2021-09-15T22:05:08.519 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-09-15T22:05:08.521 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.530 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.532 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.542 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.544 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.553 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-09-15T22:05:08.555 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.582 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:08 +0000 (0:00:00.112) 0:02:18.083 *** 2021-09-15T22:05:08.589 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-09-15T22:05:08.591 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.592 INFO:teuthology.task.ansible.out: 2021-09-15T22:05:08.592 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.592 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.593 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.594 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.604 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.636 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:08 +0000 (0:00:00.053) 0:02:18.137 *** 2021-09-15T22:05:08.655 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-09-15T22:05:08.657 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:08.690 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:08 +0000 (0:00:00.054) 0:02:18.192 *** 2021-09-15T22:05:08.865 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-09-15T22:05:08.867 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003008", "end": "2021-09-15 22:05:08.845479", "rc": 0, "start": "2021-09-15 22:05:08.842471", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b135a4f82b02b966053efba0501e6a47c9d2d793/virtualenv/bin/teuthology-lock"]} 2021-09-15T22:05:08.894 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:08 +0000 (0:00:00.203) 0:02:18.395 *** 2021-09-15T22:05:08.973 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-09-15T22:05:08.975 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:09.000 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:08 +0000 (0:00:00.106) 0:02:18.502 *** 2021-09-15T22:05:09.093 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-09-15T22:05:09.094 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:09.117 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:09 +0000 (0:00:00.116) 0:02:18.619 *** 2021-09-15T22:05:09.207 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:09.232 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:09 +0000 (0:00:00.114) 0:02:18.733 *** 2021-09-15T22:05:09.396 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-09-15T22:05:09.398 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"cache_update_time": 1631743118, "cache_updated": false, "changed": false} 2021-09-15T22:05:09.422 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:09 +0000 (0:00:00.189) 0:02:18.923 *** 2021-09-15T22:05:09.501 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:09.525 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:09 +0000 (0:00:00.103) 0:02:19.026 *** 2021-09-15T22:05:09.616 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi180.front.sepia.ceph.com] => (item={'block_used': 13871122, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226223986, 'size_available': 926613446656, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150394, 'block_size': 4096, 'inode_available': 60904582}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226223986, "block_size": 4096, "block_total": 240095108, "block_used": 13871122, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904582, "inode_total": 61054976, "inode_used": 150394, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926613446656, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-09-15T22:05:09.641 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:09 +0000 (0:00:00.115) 0:02:19.142 *** 2021-09-15T22:05:09.840 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-09-15T22:05:09.842 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009431", "end": "2021-09-15 22:05:09.737948", "rc": 0, "start": "2021-09-15 22:05:09.728517", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:09.870 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:09 +0000 (0:00:00.228) 0:02:19.371 *** 2021-09-15T22:05:09.953 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-09-15T22:05:09.955 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"cache_update_time": 1631743179, "cache_updated": false, "changed": false} 2021-09-15T22:05:09.984 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:09 +0000 (0:00:00.114) 0:02:19.485 *** 2021-09-15T22:05:09.991 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-09-15T22:05:09.993 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'block_used': 13871122, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226223986, 'size_available': 926613446656, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150394, 'block_size': 4096, 'inode_available': 60904582}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226223986, "block_size": 4096, "block_total": 240095108, "block_used": 13871122, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904582, "inode_total": 61054976, "inode_used": 150394, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926613446656, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:10.023 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:10 +0000 (0:00:00.038) 0:02:19.524 *** 2021-09-15T22:05:10.078 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-09-15T22:05:10.080 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:10.115 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:10 +0000 (0:00:00.092) 0:02:19.617 *** 2021-09-15T22:05:10.122 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-09-15T22:05:10.152 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:10 +0000 (0:00:00.036) 0:02:19.654 *** 2021-09-15T22:05:10.204 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-09-15T22:05:10.206 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item={'block_used': 13871114, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226223994, 'size_available': 926613479424, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150394, 'block_size': 4096, 'inode_available': 60904582}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226223994, "block_size": 4096, "block_total": 240095108, "block_used": 13871114, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904582, "inode_total": 61054976, "inode_used": 150394, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926613479424, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-09-15T22:05:10.234 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:10 +0000 (0:00:00.081) 0:02:19.735 *** 2021-09-15T22:05:10.253 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-09-15T22:05:10.253 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:10.456 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-09-15T22:05:10.458 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009433", "end": "2021-09-15 22:05:10.055553", "rc": 0, "start": "2021-09-15 22:05:10.046120", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:10.485 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:10 +0000 (0:00:00.251) 0:02:19.987 *** 2021-09-15T22:05:10.589 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-09-15T22:05:10.591 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'block_used': 13871114, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226223994, 'size_available': 926613479424, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150394, 'block_size': 4096, 'inode_available': 60904582}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226223994, "block_size": 4096, "block_total": 240095108, "block_used": 13871114, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904582, "inode_total": 61054976, "inode_used": 150394, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926613479424, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:10.629 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:10 +0000 (0:00:00.143) 0:02:20.130 *** 2021-09-15T22:05:10.723 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-09-15T22:05:10.748 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:10 +0000 (0:00:00.119) 0:02:20.250 *** 2021-09-15T22:05:10.841 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-09-15T22:05:10.843 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:12.170 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4eVelhHzG2dr23e2XyOz8Yiq2fjkrts8sG'], 'uuids': ['ba09032b-a366-450e-9af0-453237cf514e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.780505", "end": "2021-09-15 22:05:12.045865", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4eVelhHzG2dr23e2XyOz8Yiq2fjkrts8sG"], "labels": [], "masters": [], "uuids": ["ba09032b-a366-450e-9af0-453237cf514e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:10.265360", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-09-15T22:05:12.181 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:12.193 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:12.774 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq6dpmeHdPzM8uNfF9LafD4MBlQiOoKg4Z4'], 'uuids': ['e3b837a7-0ec9-4f5b-8b7d-24ea73ed3864']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.797386", "end": "2021-09-15 22:05:12.361872", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq6dpmeHdPzM8uNfF9LafD4MBlQiOoKg4Z4"], "labels": [], "masters": [], "uuids": ["e3b837a7-0ec9-4f5b-8b7d-24ea73ed3864"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:10.564486", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-09-15T22:05:12.786 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:12.797 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:13.544 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4e2KsAOW9kf9wT8mIfAl8jNNFyDmDihQKO'], 'uuids': ['a960c481-73a5-4387-880f-0fec2e3d8c9b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.208667", "end": "2021-09-15 22:05:13.423921", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4e2KsAOW9kf9wT8mIfAl8jNNFyDmDihQKO"], "labels": [], "masters": [], "uuids": ["a960c481-73a5-4387-880f-0fec2e3d8c9b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:12.215254", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-09-15T22:05:13.547 INFO:teuthology.task.ansible.out: skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XGGP', 'wwn-0x5000c50092930050'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XGGP-part1', 'wwn-0x5000c50092930050-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092930050', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XGGP', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGGP", "wwn-0x5000c50092930050"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGGP-part1", "wwn-0x5000c50092930050-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XGGP", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092930050"} 2021-09-15T22:05:13.549 INFO:teuthology.task.ansible.out:}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:14.041 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq6hf22OZtb0HYiqJ9a5LRz93xwC9mD8Fxg'], 'uuids': ['39d55306-bb64-49c0-8961-4696ac97ae05']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.114993", "end": "2021-09-15 22:05:13.630088", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq6hf22OZtb0HYiqJ9a5LRz93xwC9mD8Fxg"], "labels": [], "masters": [], "uuids": ["39d55306-bb64-49c0-8961-4696ac97ae05"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:12.515095", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-09-15T22:05:14.053 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLJY', 'wwn-0x5000c5009294076e'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLJY-part1', 'wwn-0x5000c5009294076e-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009294076e', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XLJY', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLJY", "wwn-0x5000c5009294076e"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLJY-part1", "wwn-0x5000c5009294076e-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XLJY", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009294076e"}}, 2021-09-15T22:05:14.055 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-09-15T22:05:14.851 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-BO0TCH-FSFh-50q7-OSO1-Zjmu-6IyO-ZsVBQQ', 'nvme-INTEL_SSDPED1D480GA_PHMB747600M7480DGN', 'nvme-nvme.8086-50484d423734373630304d3734383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.161198", "end": "2021-09-15 22:05:14.730276", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-BO0TCH-FSFh-50q7-OSO1-Zjmu-6IyO-ZsVBQQ", "nvme-INTEL_SSDPED1D480GA_PHMB747600M7480DGN", "nvme-nvme.8086-50484d423734373630304d3734383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:13.569078", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You 2021-09-15T22:05:14.853 INFO:teuthology.task.ansible.out:may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-09-15T22:05:14.863 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:14.864 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:15.356 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-y0K5gk-1ges-WEIH-ue1I-Pq2s-GT21-a2YNKu', 'nvme-INTEL_SSDPEDMD400G4_CVFT626500CE400BGN', 'nvme-nvme.8086-43564654363236353030434534303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.167467", "end": "2021-09-15 22:05:14.941625", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-y0K5gk-1ges-WEIH-ue1I-Pq2s-GT21-a2YNKu", "nvme-INTEL_SSDPEDMD400G4_CVFT626500CE400BGN", "nvme-nvme.8086-43564654363236353030434534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:13.774158", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-09-15T22:05:15.358 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-09-15T22:05:15.366 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:15.368 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:16.162 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4eqnrnpZujTIkMNqlJsNaOML4jPrlWX1Ht'], 'uuids': ['8852625a-af29-4320-829f-5d34ea40de36']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.167181", "end": "2021-09-15 22:05:16.044863", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4eqnrnpZujTIkMNqlJsNaOML4jPrlWX1Ht"], "labels": [], "masters": [], "uuids": ["8852625a-af29-4320-829f-5d34ea40de36"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:14.877682", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-09-15T22:05:16.173 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:16.185 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:16.618 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq65KIRs6PztFqVGv0vsSpnWNkkKEaBfXlv'], 'uuids': ['b25d6140-0f10-4844-b587-a6023172a7d9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.116236", "end": "2021-09-15 22:05:16.206766", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq65KIRs6PztFqVGv0vsSpnWNkkKEaBfXlv"], "labels": [], "masters": [], "uuids": ["b25d6140-0f10-4844-b587-a6023172a7d9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:15.090530", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-09-15T22:05:16.629 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:16.642 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:17.440 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4eZpE2vrvzQMcmyfDfHI2rVx9h3qQXXCCR'], 'uuids': ['0e8b8f2b-736d-4560-9c46-0f724d39b254']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.127339", "end": "2021-09-15 22:05:17.323316", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4eZpE2vrvzQMcmyfDfHI2rVx9h3qQXXCCR"], "labels": [], "masters": [], "uuids": ["0e8b8f2b-736d-4560-9c46-0f724d39b254"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:16.195977", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-09-15T22:05:17.451 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:17.914 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq6EhSOlWfnxFWEaY8nwbpkuNX4wf9bouWn'], 'uuids': ['09b4903a-2d82-407e-8062-5dcab098c808']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.134362", "end": "2021-09-15 22:05:17.494760", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq6EhSOlWfnxFWEaY8nwbpkuNX4wf9bouWn"], "labels": [], "masters": [], "uuids": ["09b4903a-2d82-407e-8062-5dcab098c808"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:16.360398", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-09-15T22:05:17.927 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:18.712 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4e26u1kvM0nfpTvt2hXiMAbcG0itylqAD3'], 'uuids': ['9d0d436d-d743-4ccf-92bd-2eded996829c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.127623", "end": "2021-09-15 22:05:18.593159", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4e26u1kvM0nfpTvt2hXiMAbcG0itylqAD3"], "labels": [], "masters": [], "uuids": ["9d0d436d-d743-4ccf-92bd-2eded996829c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:17.465536", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-09-15T22:05:18.748 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:18 +0000 (0:00:07.999) 0:02:28.249 *** 2021-09-15T22:05:18.850 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-09-15T22:05:18.852 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:19.092 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4eVelhHzG2dr23e2XyOz8Yiq2fjkrts8sG'], 'uuids': ['ba09032b-a366-450e-9af0-453237cf514e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.115813", "end": "2021-09-15 22:05:18.980237", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4eVelhHzG2dr23e2XyOz8Yiq2fjkrts8sG"], "labels": [], "masters": [], "uuids": ["ba09032b-a366-450e-9af0-453237cf514e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:18.864424", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.111027 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.111027 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:19.103 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:19.115 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:19.179 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-09-15T22:05:19.181 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq621AN3sHc3edCT2lcudBPU6hi22FbX3Yp'], 'uuids': ['7e7296e9-311f-451b-ae16-f1e591836b4a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.115425", "end": "2021-09-15 22:05:18.762806", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq621AN3sHc3edCT2lcudBPU6hi22FbX3Yp"], "labels": [], "masters": [], "uuids": ["7e7296e9-311f-451b-ae16-f1e591836b4a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:17.647381", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-09-15T22:05:19.217 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:19 +0000 (0:00:00.468) 0:02:28.718 *** 2021-09-15T22:05:19.307 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-09-15T22:05:19.309 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:19.362 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4e2KsAOW9kf9wT8mIfAl8jNNFyDmDihQKO'], 'uuids': ['a960c481-73a5-4387-880f-0fec2e3d8c9b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.113772", "end": "2021-09-15 22:05:19.242494", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4e2KsAOW9kf9wT8mIfAl8jNNFyDmDihQKO"], "labels": [], "masters": [], "uuids": ["a960c481-73a5-4387-880f-0fec2e3d8c9b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:19.128722", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.109626 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.109626 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:19.374 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XGGP', 'wwn-0x5000c50092930050'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XGGP-part1', 'wwn-0x5000c50092930050-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092930050', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XGGP', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGGP", "wwn-0x5000c50092930050"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGGP-part1", "wwn-0x5000c50092930050-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XGGP", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092930050"}}, 2021-09-15T22:05:19.377 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-09-15T22:05:19.567 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-BO0TCH-FSFh-50q7-OSO1-Zjmu-6IyO-ZsVBQQ', 'nvme-INTEL_SSDPED1D480GA_PHMB747600M7480DGN', 'nvme-nvme.8086-50484d423734373630304d3734383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.054372", "end": "2021-09-15 22:05:19.448837", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-BO0TCH-FSFh-50q7-OSO1-Zjmu-6IyO-ZsVBQQ", "nvme-INTEL_SSDPED1D480GA_PHMB747600M7480DGN", "nvme-nvme.8086-50484d423734373630304d3734383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:19.394465", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0497396 s, 2.3 GB/s", "stderr_lines": [" 2021-09-15T22:05:19.570 INFO:teuthology.task.ansible.out:110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0497396 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:19.581 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:19.594 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:19.617 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq6dpmeHdPzM8uNfF9LafD4MBlQiOoKg4Z4'], 'uuids': ['e3b837a7-0ec9-4f5b-8b7d-24ea73ed3864']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.161600", "end": "2021-09-15 22:05:19.190114", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq6dpmeHdPzM8uNfF9LafD4MBlQiOoKg4Z4"], "labels": [], "masters": [], "uuids": ["e3b837a7-0ec9-4f5b-8b7d-24ea73ed3864"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:19.028514", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157294 s, 733 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157294 s, 733 MB/s"], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:19.618 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:19.630 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:19.832 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4eqnrnpZujTIkMNqlJsNaOML4jPrlWX1Ht'], 'uuids': ['8852625a-af29-4320-829f-5d34ea40de36']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.109238", "end": "2021-09-15 22:05:19.714957", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4eqnrnpZujTIkMNqlJsNaOML4jPrlWX1Ht"], "labels": [], "masters": [], "uuids": ["8852625a-af29-4320-829f-5d34ea40de36"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:19.605719", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.10545 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.10545 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:19.844 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:19.846 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:19.954 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq6hf22OZtb0HYiqJ9a5LRz93xwC9mD8Fxg'], 'uuids': ['39d55306-bb64-49c0-8961-4696ac97ae05']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.171823", "end": "2021-09-15 22:05:19.534000", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq6hf22OZtb0HYiqJ9a5LRz93xwC9mD8Fxg"], "labels": [], "masters": [], "uuids": ["39d55306-bb64-49c0-8961-4696ac97ae05"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:19.362177", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.167002 s, 691 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.167002 s, 691 MB/s"], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:19.956 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLJY', 'wwn-0x5000c5009294076e'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLJY-part1', 'wwn-0x5000c5009294076e-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009294076e', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XLJY', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLJY", "wwn-0x5000c5009294076e"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLJY-part1", "wwn-0x5000c5009294076e-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XLJY", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009294076e"}}, 2021-09-15T22:05:19.957 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-09-15T22:05:20.094 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4eZpE2vrvzQMcmyfDfHI2rVx9h3qQXXCCR'], 'uuids': ['0e8b8f2b-736d-4560-9c46-0f724d39b254']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.112403", "end": "2021-09-15 22:05:19.978107", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4eZpE2vrvzQMcmyfDfHI2rVx9h3qQXXCCR"], "labels": [], "masters": [], "uuids": ["0e8b8f2b-736d-4560-9c46-0f724d39b254"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:19.865704", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.107658 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.107658 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:20.105 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:20.149 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-y0K5gk-1ges-WEIH-ue1I-Pq2s-GT21-a2YNKu', 'nvme-INTEL_SSDPEDMD400G4_CVFT626500CE400BGN', 'nvme-nvme.8086-43564654363236353030434534303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.055579", "end": "2021-09-15 22:05:19.738715", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-y0K5gk-1ges-WEIH-ue1I-Pq2s-GT21-a2YNKu", "nvme-INTEL_SSDPEDMD400G4_CVFT626500CE400BGN", "nvme-nvme.8086-43564654363236353030434534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:19.683136", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0507681 s, 2.3 GB/s", "std 2021-09-15T22:05:20.151 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0507681 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:20.162 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:20.164 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:20.354 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4e26u1kvM0nfpTvt2hXiMAbcG0itylqAD3'], 'uuids': ['9d0d436d-d743-4ccf-92bd-2eded996829c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.119151", "end": "2021-09-15 22:05:20.240417", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-DeNpbouEjAPmox5FnqS0UURpczfh7j4e26u1kvM0nfpTvt2hXiMAbcG0itylqAD3"], "labels": [], "masters": [], "uuids": ["9d0d436d-d743-4ccf-92bd-2eded996829c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:20.121266", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.114355 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.114355 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:20.388 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:20 +0000 (0:00:01.171) 0:02:29.889 *** 2021-09-15T22:05:20.458 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq65KIRs6PztFqVGv0vsSpnWNkkKEaBfXlv'], 'uuids': ['b25d6140-0f10-4844-b587-a6023172a7d9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.160034", "end": "2021-09-15 22:05:20.049034", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq65KIRs6PztFqVGv0vsSpnWNkkKEaBfXlv"], "labels": [], "masters": [], "uuids": ["b25d6140-0f10-4844-b587-a6023172a7d9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:19.889000", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156142 s, 739 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156142 s, 739 MB/s"], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:20.470 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:20.471 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:20.722 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-09-15T22:05:20.724 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.128773", "end": "2021-09-15 22:05:20.550302", "rc": 0, "start": "2021-09-15 22:05:20.421529", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:20.747 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:20 +0000 (0:00:00.359) 0:02:30.248 *** 2021-09-15T22:05:20.775 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-09-15T22:05:20.777 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq6EhSOlWfnxFWEaY8nwbpkuNX4wf9bouWn'], 'uuids': ['09b4903a-2d82-407e-8062-5dcab098c808']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.171410", "end": "2021-09-15 22:05:20.364140", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq6EhSOlWfnxFWEaY8nwbpkuNX4wf9bouWn"], "labels": [], "masters": [], "uuids": ["09b4903a-2d82-407e-8062-5dcab098c808"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:20.192730", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.166753 s, 692 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.166753 s, 692 MB/s"], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:20.787 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:20.977 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-09-15T22:05:20.978 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.086562", "end": "2021-09-15 22:05:20.862957", "rc": 0, "start": "2021-09-15 22:05:20.776395", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:21.001 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:20 +0000 (0:00:00.254) 0:02:30.503 *** 2021-09-15T22:05:21.071 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-09-15T22:05:21.073 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq621AN3sHc3edCT2lcudBPU6hi22FbX3Yp'], 'uuids': ['7e7296e9-311f-451b-ae16-f1e591836b4a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.161686", "end": "2021-09-15 22:05:20.663965", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-QEzt2ARfzUFCBIbbLiBdWS6mP9Yksaq621AN3sHc3edCT2lcudBPU6hi22FbX3Yp"], "labels": [], "masters": [], "uuids": ["7e7296e9-311f-451b-ae16-f1e591836b4a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-09-15 22:05:20.502279", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156729 s, 736 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156729 s, 736 MB/s"], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:21.142 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.141) 0:02:30.644 *** 2021-09-15T22:05:21.165 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.022) 0:02:30.666 *** 2021-09-15T22:05:21.172 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-09-15T22:05:21.173 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:21.203 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.038) 0:02:30.704 *** 2021-09-15T22:05:21.241 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-09-15T22:05:21.243 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:21.279 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.076) 0:02:30.781 *** 2021-09-15T22:05:21.308 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-09-15T22:05:21.310 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:21.338 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.057) 0:02:30.838 *** 2021-09-15T22:05:21.364 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:21.388 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.051) 0:02:30.890 *** 2021-09-15T22:05:21.480 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-09-15T22:05:21.482 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.171203", "end": "2021-09-15 22:05:21.069710", "rc": 0, "start": "2021-09-15 22:05:20.898507", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:21.515 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.126) 0:02:31.016 *** 2021-09-15T22:05:21.535 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-09-15T22:05:21.536 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-09-15T22:05:21.567 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.052) 0:02:31.069 *** 2021-09-15T22:05:21.606 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-09-15T22:05:21.608 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'block_used': 13871122, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226223986, 'size_available': 926613446656, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150394, 'block_size': 4096, 'inode_available': 60904582}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226223986, "block_size": 4096, "block_total": 240095108, "block_used": 13871122, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904582, "inode_total": 61054976, "inode_used": 150394, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926613446656, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:21.632 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.064) 0:02:31.133 *** 2021-09-15T22:05:21.660 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-09-15T22:05:21.662 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:21.684 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.051) 0:02:31.185 *** 2021-09-15T22:05:21.711 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-09-15T22:05:21.715 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:21.739 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.055) 0:02:31.240 *** 2021-09-15T22:05:21.746 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-09-15T22:05:21.749 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.071628", "end": "2021-09-15 22:05:21.322244", "rc": 0, "start": "2021-09-15 22:05:21.250616", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:21.773 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.034) 0:02:31.274 *** 2021-09-15T22:05:21.780 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-09-15T22:05:21.781 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:21.811 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.037) 0:02:31.312 *** 2021-09-15T22:05:21.818 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-09-15T22:05:21.847 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.036) 0:02:31.348 *** 2021-09-15T22:05:21.854 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:21.880 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.032) 0:02:31.381 *** 2021-09-15T22:05:21.886 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-09-15T22:05:21.888 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:21.919 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.039) 0:02:31.420 *** 2021-09-15T22:05:21.926 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-09-15T22:05:21.928 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:21.953 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.034) 0:02:31.455 *** 2021-09-15T22:05:21.960 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-09-15T22:05:21.962 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:21.987 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:21 +0000 (0:00:00.034) 0:02:31.489 *** 2021-09-15T22:05:21.994 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-09-15T22:05:21.996 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:22.020 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:22 +0000 (0:00:00.032) 0:02:31.522 *** 2021-09-15T22:05:22.028 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-09-15T22:05:22.030 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:22.058 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:22 +0000 (0:00:00.037) 0:02:31.559 *** 2021-09-15T22:05:22.086 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-09-15T22:05:22.088 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:22.113 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:22 +0000 (0:00:00.054) 0:02:31.614 *** 2021-09-15T22:05:22.250 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi184.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-09-15T22:05:22.275 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:22 +0000 (0:00:00.161) 0:02:31.776 *** 2021-09-15T22:05:22.323 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-09-15T22:05:22.324 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'block_used': 13871114, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226223994, 'size_available': 926613479424, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150394, 'block_size': 4096, 'inode_available': 60904582}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226223994, "block_size": 4096, "block_total": 240095108, "block_used": 13871114, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904582, "inode_total": 61054976, "inode_used": 150394, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926613479424, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:22.348 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:22 +0000 (0:00:00.073) 0:02:31.849 *** 2021-09-15T22:05:22.376 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:22.400 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:22 +0000 (0:00:00.052) 0:02:31.901 *** 2021-09-15T22:05:22.427 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-09-15T22:05:22.429 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:22.452 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:22 +0000 (0:00:00.052) 0:02:31.953 *** 2021-09-15T22:05:22.481 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:22.504 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:22 +0000 (0:00:00.051) 0:02:32.005 *** 2021-09-15T22:05:22.532 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:22.555 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:22 +0000 (0:00:00.051) 0:02:32.057 *** 2021-09-15T22:05:22.587 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:22.615 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:22 +0000 (0:00:00.059) 0:02:32.116 *** 2021-09-15T22:05:22.642 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-09-15T22:05:22.644 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:22.667 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:22 +0000 (0:00:00.051) 0:02:32.168 *** 2021-09-15T22:05:22.832 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-09-15T22:05:22.834 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-09-15T22:05:22.859 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:22 +0000 (0:00:00.192) 0:02:32.360 *** 2021-09-15T22:05:23.202 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-09-15T22:05:23.228 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:23 +0000 (0:00:00.368) 0:02:32.729 *** 2021-09-15T22:05:23.521 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-09-15T22:05:23.522 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-09-15T22:05:23.639 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-09-15T22:05:23.903 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-09-15T22:05:24.041 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-09-15T22:05:24.274 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-09-15T22:05:24.433 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-09-15T22:05:24.656 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-09-15T22:05:24.814 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-09-15T22:05:25.047 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-09-15T22:05:25.078 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:25 +0000 (0:00:01.849) 0:02:34.579 *** 2021-09-15T22:05:25.223 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-09-15T22:05:25.224 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-09-15T22:05:25.251 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:25 +0000 (0:00:00.173) 0:02:34.752 *** 2021-09-15T22:05:25.276 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:25 +0000 (0:00:00.024) 0:02:34.777 *** 2021-09-15T22:05:25.412 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-09-15T22:05:25.423 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-09-15T22:05:25.425 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-09-15T22:05:25.451 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:25 +0000 (0:00:00.174) 0:02:34.951 *** 2021-09-15T22:05:25.533 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-09-15T22:05:25.535 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-09-15T22:05:25.610 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-09-15T22:05:25.653 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-09-15T22:05:25.729 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-09-15T22:05:25.771 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-09-15T22:05:25.783 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:25.822 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:25 +0000 (0:00:00.372) 0:02:35.324 *** 2021-09-15T22:05:25.852 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-09-15T22:05:25.854 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:25.877 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:25 +0000 (0:00:00.054) 0:02:35.378 *** 2021-09-15T22:05:25.886 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-09-15T22:05:25.908 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:25.933 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:25 +0000 (0:00:00.055) 0:02:35.434 *** 2021-09-15T22:05:25.975 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-09-15T22:05:25.977 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-09-15T22:05:25.987 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:26.016 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:26 +0000 (0:00:00.083) 0:02:35.518 *** 2021-09-15T22:05:26.046 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-09-15T22:05:26.048 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:26.070 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:26 +0000 (0:00:00.054) 0:02:35.572 *** 2021-09-15T22:05:26.088 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-09-15T22:05:26.090 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-09-15T22:05:26.116 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:26 +0000 (0:00:00.045) 0:02:35.617 *** 2021-09-15T22:05:26.126 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:26.153 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:26 +0000 (0:00:00.036) 0:02:35.654 *** 2021-09-15T22:05:26.160 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-09-15T22:05:26.162 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-09-15T22:05:26.189 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:26 +0000 (0:00:00.036) 0:02:35.691 *** 2021-09-15T22:05:26.302 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-09-15T22:05:26.304 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-09-15T22:05:26.331 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:26 +0000 (0:00:00.141) 0:02:35.832 *** 2021-09-15T22:05:26.370 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi184.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-09-15T22:05:26.394 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:26 +0000 (0:00:00.063) 0:02:35.895 *** 2021-09-15T22:05:26.655 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-09-15T22:05:26.657 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true} 2021-09-15T22:05:26.684 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:26 +0000 (0:00:00.290) 0:02:36.185 *** 2021-09-15T22:05:26.734 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"changed": true} 2021-09-15T22:05:26.759 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:26 +0000 (0:00:00.074) 0:02:36.260 *** 2021-09-15T22:05:27.152 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-09-15T22:05:27.154 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-09-15T22:05:27.183 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:27 +0000 (0:00:00.423) 0:02:36.684 *** 2021-09-15T22:05:27.192 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-09-15T22:05:27.219 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:27 +0000 (0:00:00.036) 0:02:36.720 *** 2021-09-15T22:05:27.229 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:27.255 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:27 +0000 (0:00:00.035) 0:02:36.756 *** 2021-09-15T22:05:27.263 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:27.290 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:27 +0000 (0:00:00.034) 0:02:36.791 *** 2021-09-15T22:05:27.296 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-09-15T22:05:27.298 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:27.323 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:27 +0000 (0:00:00.033) 0:02:36.825 *** 2021-09-15T22:05:27.331 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:27.357 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:27 +0000 (0:00:00.033) 0:02:36.858 *** 2021-09-15T22:05:27.364 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-09-15T22:05:27.366 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:27.395 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:27 +0000 (0:00:00.035) 0:02:36.894 *** 2021-09-15T22:05:27.400 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:27.426 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:27 +0000 (0:00:00.033) 0:02:36.928 *** 2021-09-15T22:05:27.432 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-09-15T22:05:27.434 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:27.458 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:27 +0000 (0:00:00.031) 0:02:36.959 *** 2021-09-15T22:05:27.465 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:27.492 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:27 +0000 (0:00:00.033) 0:02:36.993 *** 2021-09-15T22:05:27.637 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-09-15T22:05:27.638 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-09-15T22:05:27.662 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:27 +0000 (0:00:00.170) 0:02:37.163 *** 2021-09-15T22:05:27.682 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-09-15T22:05:27.717 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:27 +0000 (0:00:00.054) 0:02:37.217 *** 2021-09-15T22:05:27.831 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-09-15T22:05:27.833 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-09-15T22:05:27.858 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:27 +0000 (0:00:00.141) 0:02:37.359 *** 2021-09-15T22:05:27.878 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-09-15T22:05:27.907 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:27 +0000 (0:00:00.049) 0:02:37.408 *** 2021-09-15T22:05:28.233 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-09-15T22:05:28.235 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-09-15T22:05:28.260 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:28 +0000 (0:00:00.351) 0:02:37.760 *** 2021-09-15T22:05:28.291 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-09-15T22:05:28.316 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:28 +0000 (0:00:00.057) 0:02:37.818 *** 2021-09-15T22:05:28.644 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-09-15T22:05:28.677 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:28 +0000 (0:00:00.360) 0:02:38.178 *** 2021-09-15T22:05:28.702 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-09-15T22:05:28.735 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:28 +0000 (0:00:00.053) 0:02:38.232 *** 2021-09-15T22:05:29.357 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-09-15T22:05:29.359 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"cache_update_time": 1631743118, "cache_updated": false, "changed": false} 2021-09-15T22:05:29.382 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:29 +0000 (0:00:00.651) 0:02:38.884 *** 2021-09-15T22:05:29.400 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"cache_update_time": 1631743179, "cache_updated": false, "changed": false} 2021-09-15T22:05:29.428 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:29 +0000 (0:00:00.045) 0:02:38.929 *** 2021-09-15T22:05:29.649 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-09-15T22:05:29.651 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.108556", "end": "2021-09-15 22:05:29.534137", "rc": 0, "start": "2021-09-15 22:05:29.425581", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-09-15T22:05:29.674 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:29 +0000 (0:00:00.246) 0:02:39.176 *** 2021-09-15T22:05:29.704 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:29.728 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:29 +0000 (0:00:00.051) 0:02:39.227 *** 2021-09-15T22:05:29.734 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-09-15T22:05:29.735 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.137570", "end": "2021-09-15 22:05:29.309019", "rc": 0, "start": "2021-09-15 22:05:29.171449", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-09-15T22:05:29.759 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:29 +0000 (0:00:00.032) 0:02:39.260 *** 2021-09-15T22:05:29.765 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-09-15T22:05:29.767 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:29.791 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:29 +0000 (0:00:00.032) 0:02:39.292 *** 2021-09-15T22:05:29.797 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-09-15T22:05:29.799 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:29.824 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:29 +0000 (0:00:00.032) 0:02:39.325 *** 2021-09-15T22:05:29.850 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:29.874 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:29 +0000 (0:00:00.050) 0:02:39.375 *** 2021-09-15T22:05:30.462 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-09-15T22:05:30.464 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"cache_update_time": 1631743118, "cache_updated": false, "changed": false} 2021-09-15T22:05:30.489 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:30 +0000 (0:00:00.612) 0:02:39.988 *** 2021-09-15T22:05:30.514 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-09-15T22:05:30.517 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:30.539 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:30 +0000 (0:00:00.052) 0:02:40.041 *** 2021-09-15T22:05:30.547 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-09-15T22:05:30.548 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"cache_update_time": 1631743179, "cache_updated": false, "changed": false} 2021-09-15T22:05:30.574 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:30 +0000 (0:00:00.034) 0:02:40.076 *** 2021-09-15T22:05:30.601 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-09-15T22:05:30.603 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:30.627 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:30 +0000 (0:00:00.052) 0:02:40.128 *** 2021-09-15T22:05:30.884 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-09-15T22:05:30.886 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-09-15T22:05:30.913 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:30 +0000 (0:00:00.286) 0:02:40.414 *** 2021-09-15T22:05:30.942 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-09-15T22:05:30.942 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:30.967 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:30 +0000 (0:00:00.053) 0:02:40.468 *** 2021-09-15T22:05:30.974 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-09-15T22:05:30.976 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-09-15T22:05:31.001 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:30 +0000 (0:00:00.034) 0:02:40.502 *** 2021-09-15T22:05:31.028 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-09-15T22:05:31.030 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:31.053 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:31 +0000 (0:00:00.051) 0:02:40.554 *** 2021-09-15T22:05:31.188 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-09-15T22:05:31.189 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-09-15 22:02:19 UTC", "ActiveEnterTimestampMonotonic": "13697447", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount systemd-journald.socket sysinit.target basic.target system.slice network.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-09-15 22:02:19 UTC", "AssertTimestampMonotonic": "13593161", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-09-15 22:02:19 UTC", "ConditionTimestampMonotonic": "13593159", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-09-15T22:05:31.191 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "825", "ExecMainStartTimestamp": "Wed 2021-09-15 22:02:19 UTC", "ExecMainStartTimestampMonotonic": "13697434", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-09-15 22:02:19 UTC", "InactiveExitTimestampMonotonic": "13594354", "InvocationID": "c8beb5c4a9f34e6a9eeb2046c1c4d3d9", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-09-15T22:05:31.193 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "63361", "LimitNPROCSoft": "63361", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "63361", "LimitSIGPENDINGSoft": "63361", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "825", "MemoryAccounting": "yes", "MemoryCurrent": "3596288", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresM 2021-09-15T22:05:31.195 INFO:teuthology.task.ansible.out:ountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-09-15 22:02:19 UTC", "StateChangeTimestampMonotonic": "13697447", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "19008", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-09-15T22:05:31.219 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:31 +0000 (0:00:00.166) 0:02:40.721 *** 2021-09-15T22:05:31.247 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-09-15T22:05:31.249 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-09-15T22:05:31.271 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:31 +0000 (0:00:00.052) 0:02:40.773 *** 2021-09-15T22:05:31.287 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-09-15T22:05:31.287 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-09-15 22:02:26 UTC", "ActiveEnterTimestampMonotonic": "13195344", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount system.slice network.target sysinit.target basic.target systemd-tmpfiles-setup.service systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-09-15 22:02:26 UTC", "AssertTimestampMonotonic": "12931570", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-09-15 22:02:26 UTC", "ConditionTimestampMonotonic": "12931569", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-09-15T22:05:31.289 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "823", "ExecMainStartTimestamp": "Wed 2021-09-15 22:02:26 UTC", "ExecMainStartTimestampMonotonic": "13195328", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-09-15 22:02:26 UTC", "InactiveExitTimestampMonotonic": "12932516", "InvocationID": "50cea9a19e424c5a8940c5d5c328bd55", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-09-15T22:05:31.291 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "823", "MemoryAccounting": "yes", "MemoryCurrent": "3772416", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "Requi 2021-09-15T22:05:31.292 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-09-15 22:02:26 UTC", "StateChangeTimestampMonotonic": "13195344", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-09-15T22:05:31.317 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:31 +0000 (0:00:00.045) 0:02:40.818 *** 2021-09-15T22:05:31.326 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-09-15T22:05:31.327 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-09-15T22:05:31.353 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:31 +0000 (0:00:00.035) 0:02:40.854 *** 2021-09-15T22:05:31.361 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi184.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-09-15T22:05:31.388 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:31 +0000 (0:00:00.034) 0:02:40.889 *** 2021-09-15T22:05:31.394 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-09-15T22:05:31.396 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:31.422 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:31 +0000 (0:00:00.033) 0:02:40.923 *** 2021-09-15T22:05:31.429 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-09-15T22:05:31.432 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-09-15T22:05:31.458 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:31 +0000 (0:00:00.035) 0:02:40.958 *** 2021-09-15T22:05:31.488 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-09-15T22:05:31.490 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:31.512 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:31 +0000 (0:00:00.054) 0:02:41.013 *** 2021-09-15T22:05:32.366 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-09-15T22:05:32.369 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"cache_update_time": 1631743118, "cache_updated": false, "changed": false} 2021-09-15T22:05:32.392 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:32 +0000 (0:00:00.880) 0:02:41.893 *** 2021-09-15T22:05:32.420 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:32.444 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:32 +0000 (0:00:00.051) 0:02:41.945 *** 2021-09-15T22:05:32.492 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-09-15T22:05:32.494 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"cache_update_time": 1631743179, "cache_updated": false, "changed": false} 2021-09-15T22:05:32.524 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:32 +0000 (0:00:00.080) 0:02:42.026 *** 2021-09-15T22:05:32.563 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-09-15T22:05:32.565 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:32.587 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:32 +0000 (0:00:00.062) 0:02:42.088 *** 2021-09-15T22:05:32.619 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-09-15T22:05:32.653 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:32 +0000 (0:00:00.065) 0:02:42.154 *** 2021-09-15T22:05:32.775 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-09-15T22:05:32.801 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:32 +0000 (0:00:00.147) 0:02:42.302 *** 2021-09-15T22:05:33.077 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-09-15T22:05:33.079 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-09-15T22:05:33.104 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:33 +0000 (0:00:00.302) 0:02:42.605 *** 2021-09-15T22:05:33.227 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-09-15T22:05:33.252 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:33 +0000 (0:00:00.147) 0:02:42.753 *** 2021-09-15T22:05:35.241 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-09-15T22:05:35.273 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:35 +0000 (0:00:02.021) 0:02:44.774 *** 2021-09-15T22:05:35.281 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-09-15T22:05:35.311 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:35 +0000 (0:00:00.038) 0:02:44.813 *** 2021-09-15T22:05:35.798 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-09-15T22:05:35.800 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false} 2021-09-15T22:05:35.824 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:35 +0000 (0:00:00.512) 0:02:45.326 *** 2021-09-15T22:05:35.846 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false} 2021-09-15T22:05:35.869 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:35 +0000 (0:00:00.044) 0:02:45.371 *** 2021-09-15T22:05:35.876 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-09-15T22:05:35.878 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-09-15T22:05:35.903 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:35 +0000 (0:00:00.034) 0:02:45.405 *** 2021-09-15T22:05:35.911 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-09-15T22:05:35.938 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:35 +0000 (0:00:00.034) 0:02:45.439 *** 2021-09-15T22:05:36.095 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-09-15T22:05:36.238 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1631743093.477432, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1631743093.473432, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1631743093.473432, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} Wednesday 15 September 2021 22:05:36 +0000 (0:00:00.183) 0:02:45.623 *** ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1631743101.0438538, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1631743101.0398538, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1631743101.0398538, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} Wednesday 15 September 2021 22:05:36 +0000 (0:00:00.033) 0:02:45.656 *** 2021-09-15T22:05:36.532 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-09-15T22:05:36.534 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-09-15T22:05:36.534 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-09-15T22:05:36.558 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:36 +0000 (0:00:00.403) 0:02:46.059 *** 2021-09-15T22:05:36.585 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:36 +0000 (0:00:00.026) 0:02:46.086 *** 2021-09-15T22:05:36.591 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-09-15T22:05:36.593 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-09-15T22:05:36.618 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:36 +0000 (0:00:00.032) 0:02:46.119 *** 2021-09-15T22:05:36.628 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-09-15T22:05:36.651 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:36 +0000 (0:00:00.033) 0:02:46.152 *** 2021-09-15T22:05:36.657 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-09-15T22:05:36.659 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:36.685 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:36 +0000 (0:00:00.032) 0:02:46.185 *** 2021-09-15T22:05:36.693 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:36.718 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:36 +0000 (0:00:00.034) 0:02:46.220 *** 2021-09-15T22:05:36.864 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi180.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-09-15T22:05:36.890 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:36 +0000 (0:00:00.171) 0:02:46.391 *** 2021-09-15T22:05:36.908 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-09-15T22:05:36.935 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:36 +0000 (0:00:00.045) 0:02:46.437 *** 2021-09-15T22:05:37.058 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-09-15T22:05:37.059 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-09-15T22:05:37.085 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.149) 0:02:46.586 *** 2021-09-15T22:05:37.105 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-09-15T22:05:37.129 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.044) 0:02:46.630 *** 2021-09-15T22:05:37.136 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-09-15T22:05:37.138 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.163 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.033) 0:02:46.664 *** 2021-09-15T22:05:37.170 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.197 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.034) 0:02:46.698 *** 2021-09-15T22:05:37.206 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-09-15T22:05:37.208 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.221 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.223 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.233 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.235 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.260 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.062) 0:02:46.761 *** 2021-09-15T22:05:37.267 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.269 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.280 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.282 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.320 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.059) 0:02:46.821 *** 2021-09-15T22:05:37.329 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi180.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.344 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.354 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.385 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.064) 0:02:46.886 *** 2021-09-15T22:05:37.394 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.396 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi184.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.396 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.397 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.398 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.424 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.039) 0:02:46.925 *** 2021-09-15T22:05:37.431 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-09-15T22:05:37.433 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.460 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.035) 0:02:46.961 *** 2021-09-15T22:05:37.468 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.496 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.036) 0:02:46.997 *** 2021-09-15T22:05:37.502 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-09-15T22:05:37.504 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.529 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.032) 0:02:47.030 *** 2021-09-15T22:05:37.536 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.562 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.033) 0:02:47.063 *** 2021-09-15T22:05:37.569 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-09-15T22:05:37.571 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.598 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.035) 0:02:47.099 *** 2021-09-15T22:05:37.606 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.634 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.036) 0:02:47.135 *** 2021-09-15T22:05:37.641 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-09-15T22:05:37.642 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.669 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.034) 0:02:47.170 *** 2021-09-15T22:05:37.676 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.701 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.031) 0:02:47.202 *** 2021-09-15T22:05:37.708 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.735 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.033) 0:02:47.236 *** 2021-09-15T22:05:37.742 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.773 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.038) 0:02:47.274 *** 2021-09-15T22:05:37.780 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.808 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.035) 0:02:47.309 *** 2021-09-15T22:05:37.810 INFO:teuthology.task.ansible.out: 2021-09-15T22:05:37.817 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.846 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.038) 0:02:47.348 *** 2021-09-15T22:05:37.853 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-09-15T22:05:37.855 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.887 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.040) 0:02:47.388 *** 2021-09-15T22:05:37.897 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.926 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.037) 0:02:47.426 *** 2021-09-15T22:05:37.931 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-09-15T22:05:37.933 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.957 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.032) 0:02:47.459 *** 2021-09-15T22:05:37.965 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:37.994 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:37 +0000 (0:00:00.034) 0:02:47.493 *** 2021-09-15T22:05:38.176 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-09-15T22:05:38.178 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010715", "end": "2021-09-15 22:05:38.136692", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-09-15 22:05:38.125977", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:38.198 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010476", "end": "2021-09-15 22:05:37.784059", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-09-15 22:05:37.773583", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:38.335 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006151", "end": "2021-09-15 22:05:38.302406", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-09-15 22:05:38.296255", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:38.357 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006091", "end": "2021-09-15 22:05:37.953229", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-09-15 22:05:37.947138", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:38.494 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005358", "end": "2021-09-15 22:05:38.464521", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-09-15 22:05:38.459163", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:38.527 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005345", "end": "2021-09-15 22:05:38.114597", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-09-15 22:05:38.109252", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:38.674 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.025464", "end": "2021-09-15 22:05:38.642778", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-09-15 22:05:38.617314", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:38.702 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:38 +0000 (0:00:00.709) 0:02:48.203 *** 2021-09-15T22:05:38.710 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.027214", "end": "2021-09-15 22:05:38.295238", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-09-15 22:05:38.268024", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:38.739 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:38 +0000 (0:00:00.037) 0:02:48.240 *** 2021-09-15T22:05:38.747 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-09-15T22:05:38.775 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:38 +0000 (0:00:00.033) 0:02:48.274 *** 2021-09-15T22:05:38.813 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:38 +0000 (0:00:00.040) 0:02:48.315 *** 2021-09-15T22:05:38.821 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-09-15T22:05:38.823 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:38.848 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:38.935 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-09-15T22:05:38.954 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:38 +0000 (0:00:00.140) 0:02:48.455 *** 2021-09-15T22:05:38.975 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:38 +0000 (0:00:00.021) 0:02:48.477 *** 2021-09-15T22:05:40.096 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi180.front.sepia.ceph.com] 2021-09-15T22:05:40.107 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] 2021-09-15T22:05:40.188 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:40 +0000 (0:00:01.205) 0:02:49.682 *** 2021-09-15T22:05:40.205 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:40 +0000 (0:00:00.023) 0:02:49.706 *** 2021-09-15T22:05:40.214 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-09-15T22:05:40.244 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:40 +0000 (0:00:00.040) 0:02:49.746 *** 2021-09-15T22:05:40.252 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-09-15T22:05:40.277 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:40 +0000 (0:00:00.032) 0:02:49.778 *** 2021-09-15T22:05:40.283 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-09-15T22:05:40.286 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:40.309 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:40 +0000 (0:00:00.031) 0:02:49.810 *** 2021-09-15T22:05:40.316 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:40.350 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:40 +0000 (0:00:00.038) 0:02:49.849 *** 2021-09-15T22:05:40.355 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-09-15T22:05:40.357 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-09-15T22:05:40.385 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:40 +0000 (0:00:00.037) 0:02:49.887 *** 2021-09-15T22:05:40.398 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-09-15T22:05:40.434 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:40 +0000 (0:00:00.048) 0:02:49.935 *** 2021-09-15T22:05:41.159 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-09-15T22:05:41.161 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"cache_update_time": 1631743118, "cache_updated": false, "changed": false} 2021-09-15T22:05:41.186 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:41 +0000 (0:00:00.751) 0:02:50.687 *** 2021-09-15T22:05:41.205 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"cache_update_time": 1631743179, "cache_updated": false, "changed": false} 2021-09-15T22:05:41.229 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:41 +0000 (0:00:00.043) 0:02:50.730 *** 2021-09-15T22:05:41.237 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-09-15T22:05:41.238 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:41.262 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:41 +0000 (0:00:00.032) 0:02:50.763 *** 2021-09-15T22:05:41.269 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:41.298 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:41 +0000 (0:00:00.035) 0:02:50.799 *** 2021-09-15T22:05:41.305 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-09-15T22:05:41.334 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:41 +0000 (0:00:00.036) 0:02:50.835 *** 2021-09-15T22:05:41.354 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-09-15T22:05:41.386 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:41 +0000 (0:00:00.049) 0:02:50.885 *** 2021-09-15T22:05:41.544 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* ok: [smithi180.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-09-15T22:05:41.590 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-09-15T22:05:41.717 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-09-15T22:05:41.751 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:41 +0000 (0:00:00.366) 0:02:51.252 *** 2021-09-15T22:05:41.771 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-09-15T22:05:41.807 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:41 +0000 (0:00:00.051) 0:02:51.303 *** 2021-09-15T22:05:42.185 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-09-15T22:05:42.186 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-09-15T22:05:42.265 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-09-15T22:05:42.582 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-09-15T22:05:42.614 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:42 +0000 (0:00:00.806) 0:02:52.109 *** 2021-09-15T22:05:42.658 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-09-15T22:05:42.686 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:42 +0000 (0:00:00.077) 0:02:52.187 *** 2021-09-15T22:05:43.383 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** ok: [smithi180.front.sepia.ceph.com] => {"cache_update_time": 1631743118, "cache_updated": false, "changed": false} 2021-09-15T22:05:43.408 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:43 +0000 (0:00:00.722) 0:02:52.909 *** 2021-09-15T22:05:43.447 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"cache_update_time": 1631743179, "cache_updated": false, "changed": false} 2021-09-15T22:05:43.479 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:43 +0000 (0:00:00.071) 0:02:52.980 *** 2021-09-15T22:05:47.413 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-09-15T22:05:47.416 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-hfe3bdum\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-hfe3bdum"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-hfe3bdum\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=c841b85429e8c3b441ed7a7cba115793e0cebda0d8705ea24371ab0d0c0a7c5b\n Stored in directory: /tmp/pip-ephem-wheel-cache-hvl9x3k2/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/reg 2021-09-15T22:05:47.421 INFO:teuthology.task.ansible.out:istries-conf-ctl to ./pip-req-build-hfe3bdum", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=c841b85429e8c3b441ed7a7cba115793e0cebda0d8705ea24371ab0d0c0a7c5b", " Stored in directory: /tmp/pip-ephem-wheel-cache-hvl9x3k2/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-09-15T22:05:47.438 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:47 +0000 (0:00:03.958) 0:02:56.939 *** 2021-09-15T22:05:47.471 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-rvdzhg9e\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-rvdzhg9e"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-rvdzhg9e\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=c841b85429e8c3b441ed7a7cba115793e0cebda0d8705ea24371ab0d0c0a7c5b\n Stored in directory: /tmp/pip-ephem-wheel-cache-wa9er6zc/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/reg 2021-09-15T22:05:47.475 INFO:teuthology.task.ansible.out:istries-conf-ctl to ./pip-req-build-rvdzhg9e", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=c841b85429e8c3b441ed7a7cba115793e0cebda0d8705ea24371ab0d0c0a7c5b", " Stored in directory: /tmp/pip-ephem-wheel-cache-wa9er6zc/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-09-15T22:05:47.503 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:47 +0000 (0:00:00.063) 0:02:57.002 *** 2021-09-15T22:05:47.634 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1631743076.7414324, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "76c6651ed619dc361f25958c4bc22bbed7de3326", "ctime": 1628780204.6025991, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "application/json", "mode": "0644", "mtime": 1628780204.6025991, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 73, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-09-15T22:05:47.664 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:47 +0000 (0:00:00.162) 0:02:57.165 *** 2021-09-15T22:05:47.696 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1631743084.5438542, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "76c6651ed619dc361f25958c4bc22bbed7de3326", "ctime": 1628780204.6025991, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "application/json", "mode": "0644", "mtime": 1628780204.6025991, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 73, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-09-15T22:05:47.724 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:47 +0000 (0:00:00.060) 0:02:57.225 *** 2021-09-15T22:05:47.732 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-09-15T22:05:47.733 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:47.760 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:47 +0000 (0:00:00.035) 0:02:57.260 *** 2021-09-15T22:05:47.767 INFO:teuthology.task.ansible.out:skipping: [smithi184.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-09-15T22:05:47.800 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:47 +0000 (0:00:00.035) 0:02:57.296 *** 2021-09-15T22:05:48.033 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-09-15T22:05:48.035 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.084946", "end": "2021-09-15 22:05:48.008168", "rc": 0, "start": "2021-09-15 22:05:47.923222", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:48.062 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:48 +0000 (0:00:00.265) 0:02:57.562 *** 2021-09-15T22:05:48.079 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.099750", "end": "2021-09-15 22:05:48.067307", "rc": 0, "start": "2021-09-15 22:05:47.967557", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-09-15T22:05:48.106 INFO:teuthology.task.ansible.out:Wednesday 15 September 2021 22:05:48 +0000 (0:00:00.044) 0:02:57.607 *** 2021-09-15T22:05:49.636 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-09-15T22:05:49.638 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-09-15 22:02:25 UTC", "ActiveEnterTimestampMonotonic": "19178026", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "firewalld.service sysinit.target system.slice network-online.target docker.socket containerd.service systemd-journald.socket basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-09-15 22:02:21 UTC", "AssertTimestampMonotonic": "15589199", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-09-15 22:02:21 UTC", "ConditionTimestampMonotonic": "15589199", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/ 2021-09-15T22:05:49.640 INFO:teuthology.task.ansible.out:docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "877", "ExecMainStartTimestamp": "Wed 2021-09-15 22:02:21 UTC", "ExecMainStartTimestampMonotonic": "15589951", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIso 2021-09-15T22:05:49.641 INFO:teuthology.task.ansible.out:late": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-09-15 22:02:21 UTC", "InactiveExitTimestampMonotonic": "15590129", "InvocationID": "f5ca7ab94c214768a48a073ee840aa47", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "63361", "LimitSIGPENDINGSoft": "63361", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "877", "MemoryAccounting": "yes", "MemoryCurrent": "136929280", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", 2021-09-15T22:05:49.643 INFO:teuthology.task.ansible.out:"Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-09-15 22:02:25 UTC", "StateChangeTimestampMonotonic": "19178026", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "16", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": 2021-09-15T22:05:49.645 INFO:teuthology.task.ansible.out: "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-09-15T22:05:49.797 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-09-15 22:02:31 UTC", "ActiveEnterTimestampMonotonic": "18500366", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "firewalld.service systemd-journald.socket system.slice docker.socket sysinit.target basic.target network-online.target containerd.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-09-15 22:02:28 UTC", "AssertTimestampMonotonic": "14931661", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-09-15 22:02:28 UTC", "ConditionTimestampMonotonic": "14931661", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/ 2021-09-15T22:05:49.799 INFO:teuthology.task.ansible.out:docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "875", "ExecMainStartTimestamp": "Wed 2021-09-15 22:02:28 UTC", "ExecMainStartTimestampMonotonic": "14932423", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIso 2021-09-15T22:05:49.800 INFO:teuthology.task.ansible.out:late": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-09-15 22:02:28 UTC", "InactiveExitTimestampMonotonic": "14932573", "InvocationID": "1d60d9d20546433eb2e7bb088f8d0508", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "875", "MemoryAccounting": "yes", "MemoryCurrent": "137068544", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace" 2021-09-15T22:05:49.802 INFO:teuthology.task.ansible.out:, "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice docker.socket sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-09-15 22:02:31 UTC", "StateChangeTimestampMonotonic": "18500366", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "16", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset 2021-09-15T22:05:49.804 INFO:teuthology.task.ansible.out:": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-09-15T22:05:49.873 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-09-15T22:05:49.874 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-09-15T22:05:49.875 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-09-15T22:05:49.877 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-09-15T22:05:49.891 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Wednesday 15 September 2021 22:05:49 +0000 (0:00:01.785) 0:02:59.393 *** 2021-09-15T22:05:50.874 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] 2021-09-15T22:05:50.890 INFO:teuthology.task.ansible.out:ok: [smithi184.front.sepia.ceph.com] 2021-09-15T22:05:50.910 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** Wednesday 15 September 2021 22:05:50 +0000 (0:00:01.018) 0:03:00.411 *** 2021-09-15T22:05:51.099 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-09-15T22:05:51.120 INFO:teuthology.task.ansible.out:changed: [smithi184.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-09-15T22:05:51.123 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi180.front.sepia.ceph.com : ok=131 changed=31 unreachable=0 failed=0 skipped=189 rescued=0 ignored=0 smithi184.front.sepia.ceph.com : ok=131 changed=31 unreachable=0 failed=0 skipped=189 rescued=0 ignored=0 2021-09-15T22:05:51.125 INFO:teuthology.task.ansible.out: Wednesday 15 September 2021 22:05:51 +0000 (0:00:00.213) 0:03:00.625 *** =============================================================================== Create all admin users with sudo access. ------------------------------- 24.00s testnode : Install packages -------------------------------------------- 20.71s users : Update authorized_keys using the keys repo --------------------- 19.90s Remove revoked users ---------------------------------------------------- 9.18s testnode : Zap all non-root disks --------------------------------------- 8.00s testnode : Ensure packages are not present. ----------------------------- 7.85s container-host : Install registries-conf-ctl ---------------------------- 3.96s common : Update apt cache ----------------------------------------------- 3.59s Gathering Facts --------------------------------------------------------- 2.35s testnode : Update apt cache. -------------------------------------------- 2.15s testnode : Install apt keys --------------------------------------------- 2.08s testnode : Install packages via pip ------------------------------------- 2.02s testnode : Create logical volume(s) ------------------------------------- 1.85s container-host : Restart docker service --------------------------------- 1.79s Gathering Facts --------------------------------------------------------- 1.21s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.17s users : Update authorized_keys for each user with literal keys ---------- 1.10s common : Mask sleep units ----------------------------------------------- 1.08s Gathering Facts --------------------------------------------------------- 1.02s Gathering Facts --------------------------------------------------------- 0.92s 2021-09-15T22:05:51.496 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi180.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2021-09-15T22:05:51.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-09-15T22:05:51.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi180.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-09-15T22:05:51.558 DEBUG:teuthology.orchestra.run.smithi180:> true 2021-09-15T22:05:51.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-09-15T22:05:51.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-09-15T22:05:51.730 DEBUG:teuthology.orchestra.run.smithi184:> true 2021-09-15T22:05:51.854 INFO:teuthology.run_tasks:Running task clock... 2021-09-15T22:05:51.865 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-09-15T22:05:51.866 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-09-15T22:05:51.868 DEBUG:teuthology.orchestra.run.smithi180:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-09-15T22:05:51.907 INFO:teuthology.orchestra.run.smithi180.stdout:15 Sep 22:05:51 ntpd[8090]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-09-15T22:05:51.907 INFO:teuthology.orchestra.run.smithi180.stdout:15 Sep 22:05:51 ntpd[8090]: Command line: ntpd -gq 2021-09-15T22:05:51.908 INFO:teuthology.orchestra.run.smithi180.stdout:15 Sep 22:05:51 ntpd[8090]: proto: precision = 0.210 usec (-22) 2021-09-15T22:05:51.909 INFO:teuthology.orchestra.run.smithi180.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-09-15T22:05:51.909 INFO:teuthology.orchestra.run.smithi180.stdout:15 Sep 22:05:51 ntpd[8090]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-09-15T22:05:51.910 INFO:teuthology.orchestra.run.smithi180.stderr:restrict ::: KOD does nothing without LIMITED. 2021-09-15T22:05:51.911 INFO:teuthology.orchestra.run.smithi180.stdout:15 Sep 22:05:51 ntpd[8090]: restrict ::: KOD does nothing without LIMITED. 2021-09-15T22:05:51.911 INFO:teuthology.orchestra.run.smithi180.stdout:15 Sep 22:05:51 ntpd[8090]: Listen and drop on 0 v6wildcard [::]:123 2021-09-15T22:05:51.911 INFO:teuthology.orchestra.run.smithi180.stdout:15 Sep 22:05:51 ntpd[8090]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-09-15T22:05:51.912 INFO:teuthology.orchestra.run.smithi180.stdout:15 Sep 22:05:51 ntpd[8090]: Listen normally on 2 lo 127.0.0.1:123 2021-09-15T22:05:51.912 INFO:teuthology.orchestra.run.smithi180.stdout:15 Sep 22:05:51 ntpd[8090]: Listen normally on 3 enp3s0f1 172.21.15.180:123 2021-09-15T22:05:51.912 INFO:teuthology.orchestra.run.smithi180.stdout:15 Sep 22:05:51 ntpd[8090]: Listen normally on 4 lo [::1]:123 2021-09-15T22:05:51.912 INFO:teuthology.orchestra.run.smithi180.stdout:15 Sep 22:05:51 ntpd[8090]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:77ad%5]:123 2021-09-15T22:05:51.913 INFO:teuthology.orchestra.run.smithi180.stdout:15 Sep 22:05:51 ntpd[8090]: Listening on routing socket on fd #22 for interface updates 2021-09-15T22:05:52.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:52 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:52.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:52 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:52.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:52 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:52.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:52 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:52.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:52 ntpd[8090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:05:52.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:52 ntpd[8090]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:05:53.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:53 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:53.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:53 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:53.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:53 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:53.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:53 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:53.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:53 ntpd[8090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:05:53.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:53 ntpd[8090]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:05:54.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:54 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:54.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:54 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:54.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:54 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:54.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:54 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:54.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:54 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:54.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:54 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:54.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:54 ntpd[8090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:05:54.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:54 ntpd[8090]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:05:54.910 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:54 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:54.910 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:54 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:54.910 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:54 ntpd[8090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:05:54.910 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:54 ntpd[8090]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:05:55.907 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:55 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:55.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:55 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:55.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:55 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:55.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:55 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:55.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:55 ntpd[8090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:05:55.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:55 ntpd[8090]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:05:56.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:56.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:56.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:56.910 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:56.910 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:56.910 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:56.911 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:56.911 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:56.911 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:05:56.912 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:05:56.912 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:56.912 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:56.912 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:05:56.913 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:05:56.913 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:56.913 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:56.913 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:05:56.913 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:56 ntpd[8090]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:05:57.907 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:57 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:57.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:57 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:57.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:57 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:57.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:57 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:57.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:57 ntpd[8090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:05:57.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:57 ntpd[8090]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:05:58.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:58 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:58.908 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:58 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:58.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:58 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:58.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:58 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:58.909 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:58 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:58.910 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:58 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:58.910 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:58 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:58.910 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:58 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:58.910 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:58 ntpd[8090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:05:58.911 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:58 ntpd[8090]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:05:58.911 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:58 ntpd[8090]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:05:58.911 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:58 ntpd[8090]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:05:58.911 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:58 ntpd[8090]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:05:58.911 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:58 ntpd[8090]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:05:58.912 INFO:teuthology.orchestra.run.smithi180.stdout:15 Sep 22:05:58 ntpd[8090]: ntpd: time slew +0.001851 s 2021-09-15T22:05:58.912 INFO:teuthology.orchestra.run.smithi180.stdout:ntpd: time slew +0.001851s 2021-09-15T22:05:58.916 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:58 ntpd[8090]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-09-15T22:05:58.916 INFO:teuthology.orchestra.run.smithi180.stderr:15 Sep 22:05:58 ntpd[8090]: can't open /var/log/ntpstats/loopstats.20210915: Permission denied 2021-09-15T22:05:58.978 INFO:teuthology.orchestra.run.smithi180.stdout: remote refid st t when poll reach delay offset jitter 2021-09-15T22:05:58.978 INFO:teuthology.orchestra.run.smithi180.stdout:============================================================================== 2021-09-15T22:05:58.978 INFO:teuthology.orchestra.run.smithi180.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-09-15T22:05:58.979 INFO:teuthology.orchestra.run.smithi180.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-09-15T22:05:58.979 INFO:teuthology.orchestra.run.smithi180.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-09-15T22:05:58.979 INFO:teuthology.orchestra.run.smithi180.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-09-15T22:05:58.980 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-09-15T22:05:58.981 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-09-15T22:05:59.013 INFO:teuthology.orchestra.run.smithi184.stdout:15 Sep 22:05:59 ntpd[8046]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-09-15T22:05:59.013 INFO:teuthology.orchestra.run.smithi184.stdout:15 Sep 22:05:59 ntpd[8046]: Command line: ntpd -gq 2021-09-15T22:05:59.014 INFO:teuthology.orchestra.run.smithi184.stdout:15 Sep 22:05:59 ntpd[8046]: proto: precision = 0.090 usec (-23) 2021-09-15T22:05:59.014 INFO:teuthology.orchestra.run.smithi184.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-09-15T22:05:59.016 INFO:teuthology.orchestra.run.smithi184.stdout:15 Sep 22:05:59 ntpd[8046]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-09-15T22:05:59.016 INFO:teuthology.orchestra.run.smithi184.stderr:restrict ::: KOD does nothing without LIMITED. 2021-09-15T22:05:59.018 INFO:teuthology.orchestra.run.smithi184.stdout:15 Sep 22:05:59 ntpd[8046]: restrict ::: KOD does nothing without LIMITED. 2021-09-15T22:05:59.018 INFO:teuthology.orchestra.run.smithi184.stdout:15 Sep 22:05:59 ntpd[8046]: Listen and drop on 0 v6wildcard [::]:123 2021-09-15T22:05:59.019 INFO:teuthology.orchestra.run.smithi184.stdout:15 Sep 22:05:59 ntpd[8046]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-09-15T22:05:59.019 INFO:teuthology.orchestra.run.smithi184.stdout:15 Sep 22:05:59 ntpd[8046]: Listen normally on 2 lo 127.0.0.1:123 2021-09-15T22:05:59.019 INFO:teuthology.orchestra.run.smithi184.stdout:15 Sep 22:05:59 ntpd[8046]: Listen normally on 3 enp3s0f1 172.21.15.184:123 2021-09-15T22:05:59.019 INFO:teuthology.orchestra.run.smithi184.stdout:15 Sep 22:05:59 ntpd[8046]: Listen normally on 4 lo [::1]:123 2021-09-15T22:05:59.020 INFO:teuthology.orchestra.run.smithi184.stdout:15 Sep 22:05:59 ntpd[8046]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7b8f%5]:123 2021-09-15T22:05:59.020 INFO:teuthology.orchestra.run.smithi184.stdout:15 Sep 22:05:59 ntpd[8046]: Listening on routing socket on fd #22 for interface updates 2021-09-15T22:06:00.015 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:00 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:00.015 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:00 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:00.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:00 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:00.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:00 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:00.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:00 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:00.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:00 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:00.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:00 ntpd[8046]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:06:00.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:00 ntpd[8046]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:06:00.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:00 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:00.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:00 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:00.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:00 ntpd[8046]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:06:00.018 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:00 ntpd[8046]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:06:01.014 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:01 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:01.015 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:01 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:01.015 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:01 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:01.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:01 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:01.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:01 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:01.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:01 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:01.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:01 ntpd[8046]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:06:01.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:01 ntpd[8046]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:06:01.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:01 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:01.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:01 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:01.018 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:01 ntpd[8046]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:06:01.018 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:01 ntpd[8046]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:06:02.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:02 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:02.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:02 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:02.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:02 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:02.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:02 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:02.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:02 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:02.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:02 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:02.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:02 ntpd[8046]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:06:02.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:02 ntpd[8046]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:06:02.018 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:02 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:02.018 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:02 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:02.018 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:02 ntpd[8046]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:06:02.018 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:02 ntpd[8046]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:06:03.014 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:03 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:03.015 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:03 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:03.015 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:03 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:03.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:03 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:03.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:03 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:03.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:03 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:03.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:03 ntpd[8046]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:06:03.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:03 ntpd[8046]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:06:03.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:03 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:03.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:03 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:03.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:03 ntpd[8046]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:06:03.018 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:03 ntpd[8046]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:06:04.014 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:04 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:04.015 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:04 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:04.015 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:04 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:04.015 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:04 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:04.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:04 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:04.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:04 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:04.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:04 ntpd[8046]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:06:04.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:04 ntpd[8046]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:06:04.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:04 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:04.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:04 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:04.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:04 ntpd[8046]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:06:04.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:04 ntpd[8046]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:06:05.014 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:05 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:05.015 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:05 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:05.015 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:05 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:05.015 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:05 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:05.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:05 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:05.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:05 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:05.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:05 ntpd[8046]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:06:05.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:05 ntpd[8046]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:06:05.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:05 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:05.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:05 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:05.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:05 ntpd[8046]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:06:05.017 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:05 ntpd[8046]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:06:06.014 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:06 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:06.015 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:06 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:06.015 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:06 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:06.015 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:06 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:06.015 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:06 ntpd[8046]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-09-15T22:06:06.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:06 ntpd[8046]: can't open /var/log/ntpstats/rawstats.20210915: Permission denied 2021-09-15T22:06:06.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:06 ntpd[8046]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-09-15T22:06:06.016 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:06 ntpd[8046]: can't open /var/log/ntpstats/peerstats.20210915: Permission denied 2021-09-15T22:06:06.017 INFO:teuthology.orchestra.run.smithi184.stdout:15 Sep 22:06:06 ntpd[8046]: ntpd: time slew -0.014573 s 2021-09-15T22:06:06.017 INFO:teuthology.orchestra.run.smithi184.stdout:ntpd: time slew -0.014573s 2021-09-15T22:06:06.018 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:06 ntpd[8046]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-09-15T22:06:06.018 INFO:teuthology.orchestra.run.smithi184.stderr:15 Sep 22:06:06 ntpd[8046]: can't open /var/log/ntpstats/loopstats.20210915: Permission denied 2021-09-15T22:06:06.082 INFO:teuthology.orchestra.run.smithi184.stdout: remote refid st t when poll reach delay offset jitter 2021-09-15T22:06:06.082 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================== 2021-09-15T22:06:06.082 INFO:teuthology.orchestra.run.smithi184.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-09-15T22:06:06.083 INFO:teuthology.orchestra.run.smithi184.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-09-15T22:06:06.083 INFO:teuthology.orchestra.run.smithi184.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-09-15T22:06:06.083 INFO:teuthology.orchestra.run.smithi184.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-09-15T22:06:06.084 INFO:teuthology.run_tasks:Running task install... 2021-09-15T22:06:06.095 DEBUG:teuthology.task.install:project ceph 2021-09-15T22:06:06.096 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'branch': 'octopus', 'sha1': 'b70647e8796c78a4f551a1edd9ebceb06255dced'}} 2021-09-15T22:06:06.096 DEBUG:teuthology.task.install:config {'branch': 'octopus', 'sha1': 'b70647e8796c78a4f551a1edd9ebceb06255dced'} 2021-09-15T22:06:06.097 INFO:teuthology.task.install:Using flavor: basic 2021-09-15T22:06:06.104 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-09-15T22:06:06.104 INFO:teuthology.task.install:extra packages: [] 2021-09-15T22:06:06.105 DEBUG:teuthology.orchestra.run.smithi180:> sudo lsb_release -is 2021-09-15T22:06:06.158 INFO:teuthology.orchestra.run.smithi180.stdout:Ubuntu 2021-09-15T22:06:06.164 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-09-15T22:06:06.164 DEBUG:teuthology.orchestra.run.smithi184:> sudo lsb_release -is 2021-09-15T22:06:06.165 DEBUG:teuthology.orchestra.run.smithi180:> sudo apt-key list | grep Ceph 2021-09-15T22:06:06.215 INFO:teuthology.orchestra.run.smithi184.stdout:Ubuntu 2021-09-15T22:06:06.221 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-09-15T22:06:06.222 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-key list | grep Ceph 2021-09-15T22:06:06.258 INFO:teuthology.orchestra.run.smithi180.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-09-15T22:06:06.316 INFO:teuthology.orchestra.run.smithi180.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-09-15T22:06:06.317 INFO:teuthology.orchestra.run.smithi180.stdout:uid [ unknown] Ceph.com (release key) 2021-09-15T22:06:06.318 DEBUG:teuthology.orchestra.run.smithi180:> sudo lsb_release -is 2021-09-15T22:06:06.319 INFO:teuthology.orchestra.run.smithi184.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-09-15T22:06:06.368 INFO:teuthology.orchestra.run.smithi180.stdout:Ubuntu 2021-09-15T22:06:06.373 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-09-15T22:06:06.374 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-09-15T22:06:06.374 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-09-15T22:06:06.374 INFO:teuthology.packaging:ref: None 2021-09-15T22:06:06.375 INFO:teuthology.packaging:tag: None 2021-09-15T22:06:06.375 INFO:teuthology.packaging:branch: octopus 2021-09-15T22:06:06.375 INFO:teuthology.packaging:sha1: b70647e8796c78a4f551a1edd9ebceb06255dced 2021-09-15T22:06:06.376 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-09-15T22:06:06.382 INFO:teuthology.orchestra.run.smithi184.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-09-15T22:06:06.382 INFO:teuthology.orchestra.run.smithi184.stdout:uid [ unknown] Ceph.com (release key) 2021-09-15T22:06:06.382 DEBUG:teuthology.orchestra.run.smithi184:> sudo lsb_release -is 2021-09-15T22:06:06.430 INFO:teuthology.orchestra.run.smithi184.stdout:Ubuntu 2021-09-15T22:06:06.435 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-09-15T22:06:06.436 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-09-15T22:06:06.437 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-09-15T22:06:06.438 INFO:teuthology.packaging:ref: None 2021-09-15T22:06:06.438 INFO:teuthology.packaging:tag: None 2021-09-15T22:06:06.438 INFO:teuthology.packaging:branch: octopus 2021-09-15T22:06:06.438 INFO:teuthology.packaging:sha1: b70647e8796c78a4f551a1edd9ebceb06255dced 2021-09-15T22:06:06.439 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-09-15T22:06:06.637 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default/ 2021-09-15T22:06:06.638 INFO:teuthology.task.install.deb:Package version is 15.2.14-69-g3bb6dfef-1focal 2021-09-15T22:06:06.671 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default/ 2021-09-15T22:06:06.671 INFO:teuthology.task.install.deb:Package version is 15.2.14-69-g3bb6dfef-1focal 2021-09-15T22:06:06.759 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:06:06.760 DEBUG:teuthology.orchestra.run.smithi180:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-09-15T22:06:06.778 DEBUG:teuthology.orchestra.run.smithi180:> sudo apt-get update 2021-09-15T22:06:06.794 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:06:06.794 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-09-15T22:06:06.813 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get update 2021-09-15T22:06:06.952 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-09-15T22:06:06.968 INFO:teuthology.orchestra.run.smithi180.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-09-15T22:06:07.023 INFO:teuthology.orchestra.run.smithi180.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal InRelease 2021-09-15T22:06:07.025 INFO:teuthology.orchestra.run.smithi184.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal InRelease 2021-09-15T22:06:07.044 INFO:teuthology.orchestra.run.smithi180.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-09-15T22:06:07.046 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-09-15T22:06:07.066 INFO:teuthology.orchestra.run.smithi180.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal Release.gpg 2021-09-15T22:06:07.069 INFO:teuthology.orchestra.run.smithi184.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal Release.gpg 2021-09-15T22:06:07.069 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-09-15T22:06:07.080 INFO:teuthology.orchestra.run.smithi180.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-09-15T22:06:07.087 INFO:teuthology.orchestra.run.smithi180.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-09-15T22:06:07.092 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main i386 Packages [3,056 B] 2021-09-15T22:06:07.131 INFO:teuthology.orchestra.run.smithi180.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main i386 Packages [3,056 B] 2021-09-15T22:06:07.137 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-09-15T22:06:07.152 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-09-15T22:06:07.163 INFO:teuthology.orchestra.run.smithi180.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-09-15T22:06:07.239 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-09-15T22:06:07.245 INFO:teuthology.orchestra.run.smithi180.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-09-15T22:06:07.607 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 26.5 kB in 1s (42.0 kB/s) 2021-09-15T22:06:07.618 INFO:teuthology.orchestra.run.smithi180.stdout:Fetched 26.5 kB in 1s (41.6 kB/s) 2021-09-15T22:06:08.390 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2021-09-15T22:06:08.400 INFO:teuthology.orchestra.run.smithi180.stdout:Reading package lists... 2021-09-15T22:06:08.412 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.14-69-g3bb6dfef-1focal cephadm=15.2.14-69-g3bb6dfef-1focal ceph-mds=15.2.14-69-g3bb6dfef-1focal ceph-mgr=15.2.14-69-g3bb6dfef-1focal ceph-common=15.2.14-69-g3bb6dfef-1focal ceph-fuse=15.2.14-69-g3bb6dfef-1focal ceph-test=15.2.14-69-g3bb6dfef-1focal radosgw=15.2.14-69-g3bb6dfef-1focal python3-rados=15.2.14-69-g3bb6dfef-1focal python3-rgw=15.2.14-69-g3bb6dfef-1focal python3-cephfs=15.2.14-69-g3bb6dfef-1focal python3-rbd=15.2.14-69-g3bb6dfef-1focal libcephfs2=15.2.14-69-g3bb6dfef-1focal libcephfs-dev=15.2.14-69-g3bb6dfef-1focal librados2=15.2.14-69-g3bb6dfef-1focal librbd1=15.2.14-69-g3bb6dfef-1focal rbd-fuse=15.2.14-69-g3bb6dfef-1focal 2021-09-15T22:06:08.420 DEBUG:teuthology.orchestra.run.smithi180:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.14-69-g3bb6dfef-1focal cephadm=15.2.14-69-g3bb6dfef-1focal ceph-mds=15.2.14-69-g3bb6dfef-1focal ceph-mgr=15.2.14-69-g3bb6dfef-1focal ceph-common=15.2.14-69-g3bb6dfef-1focal ceph-fuse=15.2.14-69-g3bb6dfef-1focal ceph-test=15.2.14-69-g3bb6dfef-1focal radosgw=15.2.14-69-g3bb6dfef-1focal python3-rados=15.2.14-69-g3bb6dfef-1focal python3-rgw=15.2.14-69-g3bb6dfef-1focal python3-cephfs=15.2.14-69-g3bb6dfef-1focal python3-rbd=15.2.14-69-g3bb6dfef-1focal libcephfs2=15.2.14-69-g3bb6dfef-1focal libcephfs-dev=15.2.14-69-g3bb6dfef-1focal librados2=15.2.14-69-g3bb6dfef-1focal librbd1=15.2.14-69-g3bb6dfef-1focal rbd-fuse=15.2.14-69-g3bb6dfef-1focal 2021-09-15T22:06:08.479 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2021-09-15T22:06:08.491 INFO:teuthology.orchestra.run.smithi180.stdout:Reading package lists... 2021-09-15T22:06:08.642 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2021-09-15T22:06:08.643 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2021-09-15T22:06:08.655 INFO:teuthology.orchestra.run.smithi180.stdout:Building dependency tree... 2021-09-15T22:06:08.656 INFO:teuthology.orchestra.run.smithi180.stdout:Reading state information... 2021-09-15T22:06:08.783 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages were automatically installed and are no longer required: 2021-09-15T22:06:08.785 INFO:teuthology.orchestra.run.smithi184.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-09-15T22:06:08.785 INFO:teuthology.orchestra.run.smithi184.stdout:Use 'sudo apt autoremove' to remove them. 2021-09-15T22:06:08.786 INFO:teuthology.orchestra.run.smithi184.stdout:The following additional packages will be installed: 2021-09-15T22:06:08.786 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-09-15T22:06:08.786 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-09-15T22:06:08.786 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-09-15T22:06:08.787 INFO:teuthology.orchestra.run.smithi184.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-09-15T22:06:08.787 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-09-15T22:06:08.787 INFO:teuthology.orchestra.run.smithi184.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-09-15T22:06:08.787 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-09-15T22:06:08.787 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2021-09-15T22:06:08.788 INFO:teuthology.orchestra.run.smithi184.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2021-09-15T22:06:08.788 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-09-15T22:06:08.788 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-09-15T22:06:08.788 INFO:teuthology.orchestra.run.smithi184.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-09-15T22:06:08.789 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-09-15T22:06:08.789 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-09-15T22:06:08.789 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-09-15T22:06:08.789 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-09-15T22:06:08.789 INFO:teuthology.orchestra.run.smithi184.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2021-09-15T22:06:08.790 INFO:teuthology.orchestra.run.smithi184.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2021-09-15T22:06:08.790 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2021-09-15T22:06:08.790 INFO:teuthology.orchestra.run.smithi184.stdout:Suggested packages: 2021-09-15T22:06:08.791 INFO:teuthology.orchestra.run.smithi184.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-09-15T22:06:08.791 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-09-15T22:06:08.791 INFO:teuthology.orchestra.run.smithi184.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-09-15T22:06:08.791 INFO:teuthology.orchestra.run.smithi184.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-09-15T22:06:08.792 INFO:teuthology.orchestra.run.smithi184.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-09-15T22:06:08.792 INFO:teuthology.orchestra.run.smithi184.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-09-15T22:06:08.792 INFO:teuthology.orchestra.run.smithi184.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-09-15T22:06:08.792 INFO:teuthology.orchestra.run.smithi184.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-09-15T22:06:08.792 INFO:teuthology.orchestra.run.smithi184.stdout:Recommended packages: 2021-09-15T22:06:08.793 INFO:teuthology.orchestra.run.smithi184.stdout: btrfs-tools 2021-09-15T22:06:08.796 INFO:teuthology.orchestra.run.smithi180.stdout:The following packages were automatically installed and are no longer required: 2021-09-15T22:06:08.797 INFO:teuthology.orchestra.run.smithi180.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-09-15T22:06:08.797 INFO:teuthology.orchestra.run.smithi180.stdout:Use 'sudo apt autoremove' to remove them. 2021-09-15T22:06:08.797 INFO:teuthology.orchestra.run.smithi180.stdout:The following additional packages will be installed: 2021-09-15T22:06:08.797 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-09-15T22:06:08.797 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-09-15T22:06:08.799 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-09-15T22:06:08.799 INFO:teuthology.orchestra.run.smithi180.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-09-15T22:06:08.799 INFO:teuthology.orchestra.run.smithi180.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-09-15T22:06:08.800 INFO:teuthology.orchestra.run.smithi180.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-09-15T22:06:08.800 INFO:teuthology.orchestra.run.smithi180.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-09-15T22:06:08.800 INFO:teuthology.orchestra.run.smithi180.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2021-09-15T22:06:08.800 INFO:teuthology.orchestra.run.smithi180.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2021-09-15T22:06:08.800 INFO:teuthology.orchestra.run.smithi180.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-09-15T22:06:08.801 INFO:teuthology.orchestra.run.smithi180.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-09-15T22:06:08.801 INFO:teuthology.orchestra.run.smithi180.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-09-15T22:06:08.801 INFO:teuthology.orchestra.run.smithi180.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-09-15T22:06:08.801 INFO:teuthology.orchestra.run.smithi180.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-09-15T22:06:08.802 INFO:teuthology.orchestra.run.smithi180.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-09-15T22:06:08.802 INFO:teuthology.orchestra.run.smithi180.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-09-15T22:06:08.802 INFO:teuthology.orchestra.run.smithi180.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2021-09-15T22:06:08.802 INFO:teuthology.orchestra.run.smithi180.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2021-09-15T22:06:08.803 INFO:teuthology.orchestra.run.smithi180.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2021-09-15T22:06:08.803 INFO:teuthology.orchestra.run.smithi180.stdout:Suggested packages: 2021-09-15T22:06:08.803 INFO:teuthology.orchestra.run.smithi180.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-09-15T22:06:08.803 INFO:teuthology.orchestra.run.smithi180.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-09-15T22:06:08.804 INFO:teuthology.orchestra.run.smithi180.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-09-15T22:06:08.804 INFO:teuthology.orchestra.run.smithi180.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-09-15T22:06:08.804 INFO:teuthology.orchestra.run.smithi180.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-09-15T22:06:08.804 INFO:teuthology.orchestra.run.smithi180.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-09-15T22:06:08.804 INFO:teuthology.orchestra.run.smithi180.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-09-15T22:06:08.805 INFO:teuthology.orchestra.run.smithi180.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-09-15T22:06:08.805 INFO:teuthology.orchestra.run.smithi180.stdout:Recommended packages: 2021-09-15T22:06:08.805 INFO:teuthology.orchestra.run.smithi180.stdout: btrfs-tools 2021-09-15T22:06:08.874 INFO:teuthology.orchestra.run.smithi184.stdout:The following NEW packages will be installed: 2021-09-15T22:06:08.875 INFO:teuthology.orchestra.run.smithi184.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-09-15T22:06:08.875 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-09-15T22:06:08.875 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-09-15T22:06:08.877 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev libcephfs2 libjq1 2021-09-15T22:06:08.877 INFO:teuthology.orchestra.run.smithi184.stdout: libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d liblttng-ust0 2021-09-15T22:06:08.877 INFO:teuthology.orchestra.run.smithi184.stdout: liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-09-15T22:06:08.877 INFO:teuthology.orchestra.run.smithi184.stdout: libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-09-15T22:06:08.878 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-09-15T22:06:08.878 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-09-15T22:06:08.878 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2021-09-15T22:06:08.878 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2021-09-15T22:06:08.879 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2021-09-15T22:06:08.879 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib python3-openssl python3-packaging python3-paste 2021-09-15T22:06:08.879 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-09-15T22:06:08.879 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-09-15T22:06:08.879 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-rados 2021-09-15T22:06:08.880 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd python3-repoze.lru python3-requests-oauthlib python3-rgw 2021-09-15T22:06:08.880 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-09-15T22:06:08.880 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-09-15T22:06:08.880 INFO:teuthology.orchestra.run.smithi184.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-09-15T22:06:08.881 INFO:teuthology.orchestra.run.smithi184.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-09-15T22:06:08.881 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-09-15T22:06:08.881 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages will be upgraded: 2021-09-15T22:06:08.881 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 librbd1 2021-09-15T22:06:08.891 INFO:teuthology.orchestra.run.smithi180.stdout:The following NEW packages will be installed: 2021-09-15T22:06:08.892 INFO:teuthology.orchestra.run.smithi180.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-09-15T22:06:08.892 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-09-15T22:06:08.892 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-09-15T22:06:08.894 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev libcephfs2 libjq1 2021-09-15T22:06:08.894 INFO:teuthology.orchestra.run.smithi180.stdout: libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d liblttng-ust0 2021-09-15T22:06:08.894 INFO:teuthology.orchestra.run.smithi180.stdout: liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-09-15T22:06:08.895 INFO:teuthology.orchestra.run.smithi180.stdout: libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-09-15T22:06:08.895 INFO:teuthology.orchestra.run.smithi180.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-09-15T22:06:08.895 INFO:teuthology.orchestra.run.smithi180.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-09-15T22:06:08.895 INFO:teuthology.orchestra.run.smithi180.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2021-09-15T22:06:08.896 INFO:teuthology.orchestra.run.smithi180.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2021-09-15T22:06:08.896 INFO:teuthology.orchestra.run.smithi180.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2021-09-15T22:06:08.896 INFO:teuthology.orchestra.run.smithi180.stdout: python3-oauthlib python3-openssl python3-packaging python3-paste 2021-09-15T22:06:08.896 INFO:teuthology.orchestra.run.smithi180.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-09-15T22:06:08.897 INFO:teuthology.orchestra.run.smithi180.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-09-15T22:06:08.897 INFO:teuthology.orchestra.run.smithi180.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-rados 2021-09-15T22:06:08.897 INFO:teuthology.orchestra.run.smithi180.stdout: python3-rbd python3-repoze.lru python3-requests-oauthlib python3-rgw 2021-09-15T22:06:08.897 INFO:teuthology.orchestra.run.smithi180.stdout: python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-09-15T22:06:08.897 INFO:teuthology.orchestra.run.smithi180.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-09-15T22:06:08.898 INFO:teuthology.orchestra.run.smithi180.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-09-15T22:06:08.898 INFO:teuthology.orchestra.run.smithi180.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-09-15T22:06:08.898 INFO:teuthology.orchestra.run.smithi180.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-09-15T22:06:08.898 INFO:teuthology.orchestra.run.smithi180.stdout:The following packages will be upgraded: 2021-09-15T22:06:08.899 INFO:teuthology.orchestra.run.smithi180.stdout: librados2 librbd1 2021-09-15T22:06:09.020 INFO:teuthology.orchestra.run.smithi184.stdout:2 upgraded, 97 newly installed, 0 to remove and 166 not upgraded. 2021-09-15T22:06:09.021 INFO:teuthology.orchestra.run.smithi184.stdout:Need to get 153 MB of archives. 2021-09-15T22:06:09.021 INFO:teuthology.orchestra.run.smithi184.stdout:After this operation, 697 MB of additional disk space will be used. 2021-09-15T22:06:09.021 INFO:teuthology.orchestra.run.smithi184.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.14-69-g3bb6dfef-1focal [1,695 kB] 2021-09-15T22:06:09.052 INFO:teuthology.orchestra.run.smithi180.stdout:2 upgraded, 97 newly installed, 0 to remove and 166 not upgraded. 2021-09-15T22:06:09.053 INFO:teuthology.orchestra.run.smithi180.stdout:Need to get 153 MB of archives. 2021-09-15T22:06:09.053 INFO:teuthology.orchestra.run.smithi180.stdout:After this operation, 697 MB of additional disk space will be used. 2021-09-15T22:06:09.053 INFO:teuthology.orchestra.run.smithi180.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.14-69-g3bb6dfef-1focal [1,695 kB] 2021-09-15T22:06:09.068 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-09-15T22:06:09.088 INFO:teuthology.orchestra.run.smithi180.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-09-15T22:06:09.286 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.14-69-g3bb6dfef-1focal [3,248 kB] 2021-09-15T22:06:09.351 INFO:teuthology.orchestra.run.smithi180.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.14-69-g3bb6dfef-1focal [3,248 kB] 2021-09-15T22:06:09.457 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-09-15T22:06:09.465 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-09-15T22:06:09.465 INFO:teuthology.orchestra.run.smithi180.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-09-15T22:06:09.467 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-09-15T22:06:09.473 INFO:teuthology.orchestra.run.smithi180.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-09-15T22:06:09.479 INFO:teuthology.orchestra.run.smithi180.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-09-15T22:06:09.547 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.14-69-g3bb6dfef-1focal [463 kB] 2021-09-15T22:06:09.587 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.14-69-g3bb6dfef-1focal [365 kB] 2021-09-15T22:06:09.605 INFO:teuthology.orchestra.run.smithi184.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-09-15T22:06:09.611 INFO:teuthology.orchestra.run.smithi180.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-09-15T22:06:09.619 INFO:teuthology.orchestra.run.smithi184.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.14-69-g3bb6dfef-1focal [20.8 kB] 2021-09-15T22:06:09.620 INFO:teuthology.orchestra.run.smithi184.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.14-69-g3bb6dfef-1focal [156 kB] 2021-09-15T22:06:09.631 INFO:teuthology.orchestra.run.smithi184.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.14-69-g3bb6dfef-1focal [29.4 kB] 2021-09-15T22:06:09.632 INFO:teuthology.orchestra.run.smithi184.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.14-69-g3bb6dfef-1focal [363 kB] 2021-09-15T22:06:09.642 INFO:teuthology.orchestra.run.smithi184.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-09-15T22:06:09.649 INFO:teuthology.orchestra.run.smithi184.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-09-15T22:06:09.649 INFO:teuthology.orchestra.run.smithi180.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-09-15T22:06:09.655 INFO:teuthology.orchestra.run.smithi180.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-09-15T22:06:09.656 INFO:teuthology.orchestra.run.smithi184.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.14-69-g3bb6dfef-1focal [3,139 kB] 2021-09-15T22:06:09.670 INFO:teuthology.orchestra.run.smithi180.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.14-69-g3bb6dfef-1focal [463 kB] 2021-09-15T22:06:09.682 INFO:teuthology.orchestra.run.smithi184.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-09-15T22:06:09.688 INFO:teuthology.orchestra.run.smithi180.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-09-15T22:06:09.689 INFO:teuthology.orchestra.run.smithi184.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-09-15T22:06:09.693 INFO:teuthology.orchestra.run.smithi184.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-09-15T22:06:09.694 INFO:teuthology.orchestra.run.smithi180.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-09-15T22:06:09.699 INFO:teuthology.orchestra.run.smithi180.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-09-15T22:06:09.710 INFO:teuthology.orchestra.run.smithi180.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.14-69-g3bb6dfef-1focal [365 kB] 2021-09-15T22:06:09.711 INFO:teuthology.orchestra.run.smithi184.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-09-15T22:06:09.712 INFO:teuthology.orchestra.run.smithi184.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-09-15T22:06:09.713 INFO:teuthology.orchestra.run.smithi184.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-09-15T22:06:09.714 INFO:teuthology.orchestra.run.smithi184.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-09-15T22:06:09.718 INFO:teuthology.orchestra.run.smithi180.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-09-15T22:06:09.719 INFO:teuthology.orchestra.run.smithi180.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-09-15T22:06:09.720 INFO:teuthology.orchestra.run.smithi180.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-09-15T22:06:09.720 INFO:teuthology.orchestra.run.smithi180.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-09-15T22:06:09.738 INFO:teuthology.orchestra.run.smithi180.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.14-69-g3bb6dfef-1focal [20.8 kB] 2021-09-15T22:06:09.739 INFO:teuthology.orchestra.run.smithi180.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.14-69-g3bb6dfef-1focal [156 kB] 2021-09-15T22:06:09.749 INFO:teuthology.orchestra.run.smithi180.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.14-69-g3bb6dfef-1focal [29.4 kB] 2021-09-15T22:06:09.751 INFO:teuthology.orchestra.run.smithi180.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.14-69-g3bb6dfef-1focal [363 kB] 2021-09-15T22:06:09.780 INFO:teuthology.orchestra.run.smithi180.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.14-69-g3bb6dfef-1focal [3,139 kB] 2021-09-15T22:06:09.786 INFO:teuthology.orchestra.run.smithi184.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-09-15T22:06:09.786 INFO:teuthology.orchestra.run.smithi184.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-09-15T22:06:09.787 INFO:teuthology.orchestra.run.smithi184.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-09-15T22:06:09.791 INFO:teuthology.orchestra.run.smithi184.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-09-15T22:06:09.792 INFO:teuthology.orchestra.run.smithi184.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-09-15T22:06:09.794 INFO:teuthology.orchestra.run.smithi180.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-09-15T22:06:09.794 INFO:teuthology.orchestra.run.smithi180.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-09-15T22:06:09.795 INFO:teuthology.orchestra.run.smithi180.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-09-15T22:06:09.799 INFO:teuthology.orchestra.run.smithi180.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-09-15T22:06:09.800 INFO:teuthology.orchestra.run.smithi180.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-09-15T22:06:09.837 INFO:teuthology.orchestra.run.smithi184.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.14-69-g3bb6dfef-1focal [116 kB] 2021-09-15T22:06:09.845 INFO:teuthology.orchestra.run.smithi184.stdout:Get:30 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.14-69-g3bb6dfef-1focal [361 kB] 2021-09-15T22:06:09.865 INFO:teuthology.orchestra.run.smithi184.stdout:Get:31 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.14-69-g3bb6dfef-1focal [20.0 MB] 2021-09-15T22:06:09.868 INFO:teuthology.orchestra.run.smithi184.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-09-15T22:06:09.871 INFO:teuthology.orchestra.run.smithi184.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-09-15T22:06:09.873 INFO:teuthology.orchestra.run.smithi184.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-09-15T22:06:09.876 INFO:teuthology.orchestra.run.smithi180.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-09-15T22:06:09.879 INFO:teuthology.orchestra.run.smithi180.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-09-15T22:06:09.880 INFO:teuthology.orchestra.run.smithi180.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-09-15T22:06:09.893 INFO:teuthology.orchestra.run.smithi184.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-09-15T22:06:09.893 INFO:teuthology.orchestra.run.smithi184.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-09-15T22:06:09.900 INFO:teuthology.orchestra.run.smithi180.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-09-15T22:06:09.901 INFO:teuthology.orchestra.run.smithi180.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-09-15T22:06:09.950 INFO:teuthology.orchestra.run.smithi184.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-09-15T22:06:09.951 INFO:teuthology.orchestra.run.smithi184.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-09-15T22:06:09.955 INFO:teuthology.orchestra.run.smithi184.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-09-15T22:06:09.958 INFO:teuthology.orchestra.run.smithi180.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-09-15T22:06:09.959 INFO:teuthology.orchestra.run.smithi180.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-09-15T22:06:09.962 INFO:teuthology.orchestra.run.smithi180.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-09-15T22:06:09.963 INFO:teuthology.orchestra.run.smithi184.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-09-15T22:06:09.967 INFO:teuthology.orchestra.run.smithi184.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-09-15T22:06:09.970 INFO:teuthology.orchestra.run.smithi180.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-09-15T22:06:09.974 INFO:teuthology.orchestra.run.smithi180.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-09-15T22:06:10.019 INFO:teuthology.orchestra.run.smithi180.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.14-69-g3bb6dfef-1focal [116 kB] 2021-09-15T22:06:10.031 INFO:teuthology.orchestra.run.smithi180.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.14-69-g3bb6dfef-1focal [361 kB] 2021-09-15T22:06:10.032 INFO:teuthology.orchestra.run.smithi184.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-09-15T22:06:10.036 INFO:teuthology.orchestra.run.smithi184.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-09-15T22:06:10.040 INFO:teuthology.orchestra.run.smithi180.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-09-15T22:06:10.041 INFO:teuthology.orchestra.run.smithi184.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-09-15T22:06:10.044 INFO:teuthology.orchestra.run.smithi180.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-09-15T22:06:10.045 INFO:teuthology.orchestra.run.smithi184.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-09-15T22:06:10.045 INFO:teuthology.orchestra.run.smithi184.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-09-15T22:06:10.048 INFO:teuthology.orchestra.run.smithi180.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-09-15T22:06:10.053 INFO:teuthology.orchestra.run.smithi180.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-09-15T22:06:10.053 INFO:teuthology.orchestra.run.smithi180.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-09-15T22:06:10.055 INFO:teuthology.orchestra.run.smithi180.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.14-69-g3bb6dfef-1focal [20.0 MB] 2021-09-15T22:06:10.114 INFO:teuthology.orchestra.run.smithi184.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-09-15T22:06:10.122 INFO:teuthology.orchestra.run.smithi180.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-09-15T22:06:10.475 INFO:teuthology.orchestra.run.smithi180.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-09-15T22:06:10.481 INFO:teuthology.orchestra.run.smithi184.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-09-15T22:06:10.534 INFO:teuthology.orchestra.run.smithi184.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-09-15T22:06:10.537 INFO:teuthology.orchestra.run.smithi184.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-09-15T22:06:10.549 INFO:teuthology.orchestra.run.smithi180.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-09-15T22:06:10.550 INFO:teuthology.orchestra.run.smithi180.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-09-15T22:06:10.592 INFO:teuthology.orchestra.run.smithi184.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-09-15T22:06:10.592 INFO:teuthology.orchestra.run.smithi184.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-09-15T22:06:10.592 INFO:teuthology.orchestra.run.smithi184.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-09-15T22:06:10.594 INFO:teuthology.orchestra.run.smithi184.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-09-15T22:06:10.594 INFO:teuthology.orchestra.run.smithi184.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-09-15T22:06:10.595 INFO:teuthology.orchestra.run.smithi184.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-09-15T22:06:10.596 INFO:teuthology.orchestra.run.smithi184.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-09-15T22:06:10.598 INFO:teuthology.orchestra.run.smithi180.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-09-15T22:06:10.598 INFO:teuthology.orchestra.run.smithi180.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-09-15T22:06:10.599 INFO:teuthology.orchestra.run.smithi180.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-09-15T22:06:10.599 INFO:teuthology.orchestra.run.smithi180.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-09-15T22:06:10.600 INFO:teuthology.orchestra.run.smithi180.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-09-15T22:06:10.621 INFO:teuthology.orchestra.run.smithi180.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-09-15T22:06:10.622 INFO:teuthology.orchestra.run.smithi180.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-09-15T22:06:10.648 INFO:teuthology.orchestra.run.smithi184.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-09-15T22:06:10.649 INFO:teuthology.orchestra.run.smithi184.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-09-15T22:06:10.661 INFO:teuthology.orchestra.run.smithi180.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-09-15T22:06:10.662 INFO:teuthology.orchestra.run.smithi180.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-09-15T22:06:10.730 INFO:teuthology.orchestra.run.smithi184.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-09-15T22:06:10.734 INFO:teuthology.orchestra.run.smithi184.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-09-15T22:06:10.736 INFO:teuthology.orchestra.run.smithi184.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-09-15T22:06:10.739 INFO:teuthology.orchestra.run.smithi184.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-09-15T22:06:10.741 INFO:teuthology.orchestra.run.smithi184.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-09-15T22:06:10.745 INFO:teuthology.orchestra.run.smithi180.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-09-15T22:06:10.746 INFO:teuthology.orchestra.run.smithi184.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-09-15T22:06:10.747 INFO:teuthology.orchestra.run.smithi184.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-09-15T22:06:10.749 INFO:teuthology.orchestra.run.smithi184.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-09-15T22:06:10.751 INFO:teuthology.orchestra.run.smithi180.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-09-15T22:06:10.754 INFO:teuthology.orchestra.run.smithi180.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-09-15T22:06:10.758 INFO:teuthology.orchestra.run.smithi180.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-09-15T22:06:10.759 INFO:teuthology.orchestra.run.smithi180.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-09-15T22:06:10.762 INFO:teuthology.orchestra.run.smithi180.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-09-15T22:06:10.764 INFO:teuthology.orchestra.run.smithi180.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-09-15T22:06:10.766 INFO:teuthology.orchestra.run.smithi180.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-09-15T22:06:10.812 INFO:teuthology.orchestra.run.smithi184.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-09-15T22:06:10.812 INFO:teuthology.orchestra.run.smithi184.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-09-15T22:06:10.827 INFO:teuthology.orchestra.run.smithi180.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-09-15T22:06:10.828 INFO:teuthology.orchestra.run.smithi180.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-09-15T22:06:10.895 INFO:teuthology.orchestra.run.smithi184.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-09-15T22:06:10.895 INFO:teuthology.orchestra.run.smithi184.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-09-15T22:06:10.896 INFO:teuthology.orchestra.run.smithi184.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-09-15T22:06:10.912 INFO:teuthology.orchestra.run.smithi180.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-09-15T22:06:10.913 INFO:teuthology.orchestra.run.smithi180.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-09-15T22:06:10.915 INFO:teuthology.orchestra.run.smithi184.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-09-15T22:06:10.915 INFO:teuthology.orchestra.run.smithi184.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-09-15T22:06:10.916 INFO:teuthology.orchestra.run.smithi180.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-09-15T22:06:10.917 INFO:teuthology.orchestra.run.smithi184.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-09-15T22:06:10.917 INFO:teuthology.orchestra.run.smithi184.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-09-15T22:06:10.918 INFO:teuthology.orchestra.run.smithi184.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-09-15T22:06:10.936 INFO:teuthology.orchestra.run.smithi180.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-09-15T22:06:10.937 INFO:teuthology.orchestra.run.smithi180.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-09-15T22:06:10.937 INFO:teuthology.orchestra.run.smithi180.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-09-15T22:06:10.938 INFO:teuthology.orchestra.run.smithi180.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-09-15T22:06:10.938 INFO:teuthology.orchestra.run.smithi180.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-09-15T22:06:10.976 INFO:teuthology.orchestra.run.smithi184.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-09-15T22:06:10.977 INFO:teuthology.orchestra.run.smithi184.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-09-15T22:06:10.994 INFO:teuthology.orchestra.run.smithi180.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-09-15T22:06:10.995 INFO:teuthology.orchestra.run.smithi180.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-09-15T22:06:11.058 INFO:teuthology.orchestra.run.smithi184.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-09-15T22:06:11.076 INFO:teuthology.orchestra.run.smithi180.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-09-15T22:06:11.080 INFO:teuthology.orchestra.run.smithi180.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-09-15T22:06:11.098 INFO:teuthology.orchestra.run.smithi184.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-09-15T22:06:11.098 INFO:teuthology.orchestra.run.smithi184.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.14-69-g3bb6dfef-1focal [5,303 kB] 2021-09-15T22:06:11.334 INFO:teuthology.orchestra.run.smithi184.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.14-69-g3bb6dfef-1focal [162 kB] 2021-09-15T22:06:11.339 INFO:teuthology.orchestra.run.smithi184.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.14-69-g3bb6dfef-1focal [1,402 kB] 2021-09-15T22:06:11.415 INFO:teuthology.orchestra.run.smithi184.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.14-69-g3bb6dfef-1focal [6,171 kB] 2021-09-15T22:06:11.614 INFO:teuthology.orchestra.run.smithi180.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.14-69-g3bb6dfef-1focal [5,303 kB] 2021-09-15T22:06:11.774 INFO:teuthology.orchestra.run.smithi184.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.14-69-g3bb6dfef-1focal [23.9 MB] 2021-09-15T22:06:12.000 INFO:teuthology.orchestra.run.smithi180.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.14-69-g3bb6dfef-1focal [162 kB] 2021-09-15T22:06:12.011 INFO:teuthology.orchestra.run.smithi180.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.14-69-g3bb6dfef-1focal [1,402 kB] 2021-09-15T22:06:12.112 INFO:teuthology.orchestra.run.smithi180.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.14-69-g3bb6dfef-1focal [6,171 kB] 2021-09-15T22:06:12.664 INFO:teuthology.orchestra.run.smithi180.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.14-69-g3bb6dfef-1focal [23.9 MB] 2021-09-15T22:06:13.092 INFO:teuthology.orchestra.run.smithi184.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.14-69-g3bb6dfef-1focal [4,008 B] 2021-09-15T22:06:13.093 INFO:teuthology.orchestra.run.smithi184.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.14-69-g3bb6dfef-1focal [538 kB] 2021-09-15T22:06:13.102 INFO:teuthology.orchestra.run.smithi184.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.14-69-g3bb6dfef-1focal [2,007 kB] 2021-09-15T22:06:13.119 INFO:teuthology.orchestra.run.smithi184.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.14-69-g3bb6dfef-1focal [53.2 kB] 2021-09-15T22:06:13.120 INFO:teuthology.orchestra.run.smithi184.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.14-69-g3bb6dfef-1focal [58.1 kB] 2021-09-15T22:06:13.120 INFO:teuthology.orchestra.run.smithi184.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.14-69-g3bb6dfef-1focal [3,208 kB] 2021-09-15T22:06:13.256 INFO:teuthology.orchestra.run.smithi184.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.14-69-g3bb6dfef-1focal [34.4 kB] 2021-09-15T22:06:13.257 INFO:teuthology.orchestra.run.smithi184.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.14-69-g3bb6dfef-1focal [7,862 kB] 2021-09-15T22:06:13.577 INFO:teuthology.orchestra.run.smithi184.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.14-69-g3bb6dfef-1focal [4,124 B] 2021-09-15T22:06:13.577 INFO:teuthology.orchestra.run.smithi184.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.14-69-g3bb6dfef-1focal [39.9 MB] 2021-09-15T22:06:15.204 INFO:teuthology.orchestra.run.smithi184.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.14-69-g3bb6dfef-1focal [18.1 kB] 2021-09-15T22:06:15.205 INFO:teuthology.orchestra.run.smithi184.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.14-69-g3bb6dfef-1focal [9,717 kB] 2021-09-15T22:06:15.420 INFO:teuthology.orchestra.run.smithi184.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.14-69-g3bb6dfef-1focal [61.1 kB] 2021-09-15T22:06:15.993 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 153 MB in 7s (23.4 MB/s) 2021-09-15T22:06:16.210 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-09-15T22:06:16.265 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138119 files and directories currently installed.) 2021-09-15T22:06:16.269 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../00-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-09-15T22:06:16.360 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-09-15T22:06:16.742 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../01-librbd1_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:16.849 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librbd1 (15.2.14-69-g3bb6dfef-1focal) over (15.2.13-0ubuntu0.20.04.2) ... 2021-09-15T22:06:17.144 INFO:teuthology.orchestra.run.smithi180.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.14-69-g3bb6dfef-1focal [4,008 B] 2021-09-15T22:06:17.144 INFO:teuthology.orchestra.run.smithi180.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.14-69-g3bb6dfef-1focal [538 kB] 2021-09-15T22:06:17.168 INFO:teuthology.orchestra.run.smithi180.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.14-69-g3bb6dfef-1focal [2,007 kB] 2021-09-15T22:06:17.411 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../02-librados2_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:17.435 INFO:teuthology.orchestra.run.smithi180.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.14-69-g3bb6dfef-1focal [53.2 kB] 2021-09-15T22:06:17.437 INFO:teuthology.orchestra.run.smithi180.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.14-69-g3bb6dfef-1focal [58.1 kB] 2021-09-15T22:06:17.439 INFO:teuthology.orchestra.run.smithi180.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.14-69-g3bb6dfef-1focal [3,208 kB] 2021-09-15T22:06:17.546 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librados2 (15.2.14-69-g3bb6dfef-1focal) over (15.2.13-0ubuntu0.20.04.2) ... 2021-09-15T22:06:17.803 INFO:teuthology.orchestra.run.smithi180.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.14-69-g3bb6dfef-1focal [34.4 kB] 2021-09-15T22:06:17.804 INFO:teuthology.orchestra.run.smithi180.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.14-69-g3bb6dfef-1focal [7,862 kB] 2021-09-15T22:06:18.186 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libcephfs2. 2021-09-15T22:06:18.203 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../03-libcephfs2_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:18.248 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libcephfs2 (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:18.572 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rados. 2021-09-15T22:06:18.588 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../04-python3-rados_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:18.605 INFO:teuthology.orchestra.run.smithi180.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.14-69-g3bb6dfef-1focal [4,124 B] 2021-09-15T22:06:18.606 INFO:teuthology.orchestra.run.smithi180.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.14-69-g3bb6dfef-1focal [39.9 MB] 2021-09-15T22:06:18.623 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rados (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:18.958 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-09-15T22:06:18.978 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../05-python3-ceph-argparse_15.2.14-69-g3bb6dfef-1focal_all.deb ... 2021-09-15T22:06:19.049 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-ceph-argparse (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:19.300 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cephfs. 2021-09-15T22:06:19.319 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../06-python3-cephfs_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:19.360 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cephfs (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:19.693 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-ceph-common. 2021-09-15T22:06:19.711 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../07-python3-ceph-common_15.2.14-69-g3bb6dfef-1focal_all.deb ... 2021-09-15T22:06:19.752 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-ceph-common (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:20.094 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-prettytable. 2021-09-15T22:06:20.114 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../08-python3-prettytable_0.7.2-5_all.deb ... 2021-09-15T22:06:20.155 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-09-15T22:06:20.402 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rbd. 2021-09-15T22:06:20.420 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../09-python3-rbd_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:20.521 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rbd (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:21.005 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-09-15T22:06:21.021 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../10-librabbitmq4_0.10.0-1_amd64.deb ... 2021-09-15T22:06:21.064 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-09-15T22:06:21.431 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-09-15T22:06:21.447 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../11-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-09-15T22:06:21.490 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-09-15T22:06:21.867 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librgw2. 2021-09-15T22:06:21.886 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../12-librgw2_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:21.931 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librgw2 (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:22.509 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rgw. 2021-09-15T22:06:22.527 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../13-python3-rgw_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:22.560 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rgw (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:22.879 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-09-15T22:06:22.897 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../14-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-09-15T22:06:22.938 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-09-15T22:06:23.296 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liboath0. 2021-09-15T22:06:23.316 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../15-liboath0_2.6.1-1.3_amd64.deb ... 2021-09-15T22:06:23.357 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-09-15T22:06:23.647 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libradosstriper1. 2021-09-15T22:06:23.664 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../16-libradosstriper1_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:23.731 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libradosstriper1 (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:23.732 INFO:teuthology.orchestra.run.smithi180.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.14-69-g3bb6dfef-1focal [18.1 kB] 2021-09-15T22:06:23.733 INFO:teuthology.orchestra.run.smithi180.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.14-69-g3bb6dfef-1focal [9,717 kB] 2021-09-15T22:06:24.145 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-common. 2021-09-15T22:06:24.164 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../17-ceph-common_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:24.221 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-common (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:24.596 INFO:teuthology.orchestra.run.smithi180.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.14-69-g3bb6dfef-1focal [61.1 kB] 2021-09-15T22:06:25.167 INFO:teuthology.orchestra.run.smithi180.stdout:Fetched 153 MB in 16s (9,732 kB/s) 2021-09-15T22:06:25.321 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-09-15T22:06:25.376 INFO:teuthology.orchestra.run.smithi180.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138119 files and directories currently installed.) 2021-09-15T22:06:25.380 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../00-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-09-15T22:06:25.471 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-09-15T22:06:25.824 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../01-librbd1_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:25.958 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking librbd1 (15.2.14-69-g3bb6dfef-1focal) over (15.2.13-0ubuntu0.20.04.2) ... 2021-09-15T22:06:26.366 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-base. 2021-09-15T22:06:26.383 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../18-ceph-base_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:26.434 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-base (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:26.497 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../02-librados2_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:26.657 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking librados2 (15.2.14-69-g3bb6dfef-1focal) over (15.2.13-0ubuntu0.20.04.2) ... 2021-09-15T22:06:27.342 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package libcephfs2. 2021-09-15T22:06:27.545 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../03-libcephfs2_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:27.546 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking libcephfs2 (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:27.546 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cryptography. 2021-09-15T22:06:27.546 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../19-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-09-15T22:06:27.547 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-09-15T22:06:27.700 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-rados. 2021-09-15T22:06:27.718 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../04-python3-rados_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:27.758 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-rados (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:27.794 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-openssl. 2021-09-15T22:06:27.814 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../20-python3-openssl_19.0.0-1build1_all.deb ... 2021-09-15T22:06:27.852 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-09-15T22:06:28.151 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-09-15T22:06:28.161 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-09-15T22:06:28.169 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../05-python3-ceph-argparse_15.2.14-69-g3bb6dfef-1focal_all.deb ... 2021-09-15T22:06:28.180 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../21-ceph-mgr-modules-core_15.2.14-69-g3bb6dfef-1focal_all.deb ... 2021-09-15T22:06:28.209 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-ceph-argparse (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:28.220 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-modules-core (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:28.542 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-cephfs. 2021-09-15T22:06:28.558 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../06-python3-cephfs_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:28.600 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-cephfs (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:28.602 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-bcrypt. 2021-09-15T22:06:28.624 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../22-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-09-15T22:06:28.661 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-09-15T22:06:28.949 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-ceph-common. 2021-09-15T22:06:28.964 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../07-python3-ceph-common_15.2.14-69-g3bb6dfef-1focal_all.deb ... 2021-09-15T22:06:28.978 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cherrypy3. 2021-09-15T22:06:28.993 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../23-python3-cherrypy3_8.9.1-6_all.deb ... 2021-09-15T22:06:29.008 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-ceph-common (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:29.027 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-09-15T22:06:29.343 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-prettytable. 2021-09-15T22:06:29.359 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../08-python3-prettytable_0.7.2-5_all.deb ... 2021-09-15T22:06:29.389 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jwt. 2021-09-15T22:06:29.401 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-09-15T22:06:29.405 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../24-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-09-15T22:06:29.447 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-09-15T22:06:29.685 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-rbd. 2021-09-15T22:06:29.702 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../09-python3-rbd_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:29.709 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-logutils. 2021-09-15T22:06:29.728 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../25-python3-logutils_0.3.3-7_all.deb ... 2021-09-15T22:06:29.744 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-rbd (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:29.758 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-09-15T22:06:30.070 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-markupsafe. 2021-09-15T22:06:30.086 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../26-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-09-15T22:06:30.128 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-09-15T22:06:30.143 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-09-15T22:06:30.159 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../10-librabbitmq4_0.10.0-1_amd64.deb ... 2021-09-15T22:06:30.205 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-09-15T22:06:30.422 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-mako. 2021-09-15T22:06:30.440 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../27-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-09-15T22:06:30.497 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-09-15T22:06:30.562 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-09-15T22:06:30.578 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../11-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-09-15T22:06:30.629 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-09-15T22:06:30.784 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-simplegeneric. 2021-09-15T22:06:30.803 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../28-python3-simplegeneric_0.8.1-3_all.deb ... 2021-09-15T22:06:30.834 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-09-15T22:06:30.981 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package librgw2. 2021-09-15T22:06:30.998 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../12-librgw2_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:31.031 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking librgw2 (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:31.136 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-singledispatch. 2021-09-15T22:06:31.151 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../29-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-09-15T22:06:31.228 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-09-15T22:06:31.514 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webob. 2021-09-15T22:06:31.530 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../30-python3-webob_1%3a1.8.5-2_all.deb ... 2021-09-15T22:06:31.557 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-rgw. 2021-09-15T22:06:31.572 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-09-15T22:06:31.574 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../13-python3-rgw_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:31.628 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-rgw (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:31.915 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-09-15T22:06:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-soupsieve. 2021-09-15T22:06:31.933 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../14-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-09-15T22:06:31.942 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../31-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-09-15T22:06:31.972 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-09-15T22:06:31.983 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-09-15T22:06:32.308 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package liboath0. 2021-09-15T22:06:32.319 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-bs4. 2021-09-15T22:06:32.326 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../15-liboath0_2.6.1-1.3_amd64.deb ... 2021-09-15T22:06:32.335 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../32-python3-bs4_4.8.2-1_all.deb ... 2021-09-15T22:06:32.366 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-09-15T22:06:32.378 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-09-15T22:06:32.679 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package libradosstriper1. 2021-09-15T22:06:32.699 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../16-libradosstriper1_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:32.738 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking libradosstriper1 (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:32.783 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-waitress. 2021-09-15T22:06:32.797 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../33-python3-waitress_1.4.1-1_all.deb ... 2021-09-15T22:06:32.842 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-09-15T22:06:33.149 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package ceph-common. 2021-09-15T22:06:33.166 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../17-ceph-common_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:33.175 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-tempita. 2021-09-15T22:06:33.193 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../34-python3-tempita_0.5.2-6_all.deb ... 2021-09-15T22:06:33.209 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking ceph-common (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:33.233 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-09-15T22:06:33.561 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-paste. 2021-09-15T22:06:33.576 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../35-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-09-15T22:06:33.619 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-09-15T22:06:33.956 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-09-15T22:06:33.972 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../36-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-09-15T22:06:34.047 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-09-15T22:06:34.350 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pastedeploy. 2021-09-15T22:06:34.367 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../37-python3-pastedeploy_2.1.0-1_all.deb ... 2021-09-15T22:06:34.408 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-09-15T22:06:34.736 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webtest. 2021-09-15T22:06:34.752 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../38-python3-webtest_2.0.32-2_all.deb ... 2021-09-15T22:06:34.794 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-09-15T22:06:35.139 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pecan. 2021-09-15T22:06:35.159 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../39-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-09-15T22:06:35.197 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-09-15T22:06:35.319 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package ceph-base. 2021-09-15T22:06:35.334 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../18-ceph-base_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:35.412 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking ceph-base (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:35.577 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-werkzeug. 2021-09-15T22:06:35.593 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../40-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-09-15T22:06:35.635 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-09-15T22:06:36.039 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr. 2021-09-15T22:06:36.058 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../41-ceph-mgr_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:36.113 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:36.380 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-cryptography. 2021-09-15T22:06:36.400 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../19-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-09-15T22:06:36.440 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-09-15T22:06:36.625 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mon. 2021-09-15T22:06:36.641 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../42-ceph-mon_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:36.688 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mon (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:36.854 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-openssl. 2021-09-15T22:06:36.867 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../20-python3-openssl_19.0.0-1build1_all.deb ... 2021-09-15T22:06:36.910 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-09-15T22:06:37.194 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-09-15T22:06:37.213 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../21-ceph-mgr-modules-core_15.2.14-69-g3bb6dfef-1focal_all.deb ... 2021-09-15T22:06:37.254 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking ceph-mgr-modules-core (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:37.659 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-bcrypt. 2021-09-15T22:06:37.674 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../22-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-09-15T22:06:37.695 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-osd. 2021-09-15T22:06:37.714 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../43-ceph-osd_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:37.723 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-09-15T22:06:37.778 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-osd (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:38.085 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-cherrypy3. 2021-09-15T22:06:38.102 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../23-python3-cherrypy3_8.9.1-6_all.deb ... 2021-09-15T22:06:38.143 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-09-15T22:06:38.530 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-jwt. 2021-09-15T22:06:38.547 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../24-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-09-15T22:06:38.588 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-09-15T22:06:38.941 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-logutils. 2021-09-15T22:06:38.958 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../25-python3-logutils_0.3.3-7_all.deb ... 2021-09-15T22:06:38.999 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-09-15T22:06:39.335 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-markupsafe. 2021-09-15T22:06:39.351 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../26-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-09-15T22:06:39.393 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-09-15T22:06:39.747 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-mako. 2021-09-15T22:06:39.763 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../27-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-09-15T22:06:39.814 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-09-15T22:06:40.108 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph. 2021-09-15T22:06:40.124 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../44-ceph_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:40.166 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:40.183 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-simplegeneric. 2021-09-15T22:06:40.202 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../28-python3-simplegeneric_0.8.1-3_all.deb ... 2021-09-15T22:06:40.241 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-09-15T22:06:40.510 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-fuse. 2021-09-15T22:06:40.530 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../45-ceph-fuse_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:40.568 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-fuse (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:40.989 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mds. 2021-09-15T22:06:41.006 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../46-ceph-mds_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:41.038 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mds (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:41.145 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-singledispatch. 2021-09-15T22:06:41.161 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../29-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-09-15T22:06:41.228 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-09-15T22:06:41.556 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-webob. 2021-09-15T22:06:41.573 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../30-python3-webob_1%3a1.8.5-2_all.deb ... 2021-09-15T22:06:41.614 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-09-15T22:06:41.950 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-soupsieve. 2021-09-15T22:06:41.966 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../31-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-09-15T22:06:42.000 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-09-15T22:06:42.133 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephadm. 2021-09-15T22:06:42.150 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../47-cephadm_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:42.191 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephadm (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:42.278 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-bs4. 2021-09-15T22:06:42.293 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../32-python3-bs4_4.8.2-1_all.deb ... 2021-09-15T22:06:42.327 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-09-15T22:06:42.536 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jinja2. 2021-09-15T22:06:42.552 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../48-python3-jinja2_2.10.1-2_all.deb ... 2021-09-15T22:06:42.594 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-09-15T22:06:42.706 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-waitress. 2021-09-15T22:06:42.722 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../33-python3-waitress_1.4.1-1_all.deb ... 2021-09-15T22:06:42.767 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-09-15T22:06:42.964 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-09-15T22:06:42.979 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../49-ceph-mgr-cephadm_15.2.14-69-g3bb6dfef-1focal_all.deb ... 2021-09-15T22:06:43.022 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-cephadm (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:43.117 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-tempita. 2021-09-15T22:06:43.133 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../34-python3-tempita_0.5.2-6_all.deb ... 2021-09-15T22:06:43.175 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-09-15T22:06:43.392 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-repoze.lru. 2021-09-15T22:06:43.408 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../50-python3-repoze.lru_0.7-2_all.deb ... 2021-09-15T22:06:43.459 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-09-15T22:06:43.507 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-paste. 2021-09-15T22:06:43.519 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../35-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-09-15T22:06:43.561 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-09-15T22:06:43.747 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjs-underscore. 2021-09-15T22:06:43.761 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../51-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-09-15T22:06:43.807 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-09-15T22:06:43.907 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-09-15T22:06:43.924 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../36-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-09-15T22:06:43.966 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-09-15T22:06:44.113 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-09-15T22:06:44.135 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../52-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-09-15T22:06:44.180 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-09-15T22:06:44.292 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-pastedeploy. 2021-09-15T22:06:44.312 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../37-python3-pastedeploy_2.1.0-1_all.deb ... 2021-09-15T22:06:44.351 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-09-15T22:06:44.499 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-routes. 2021-09-15T22:06:44.516 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../53-python3-routes_2.4.1-2_all.deb ... 2021-09-15T22:06:44.582 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-09-15T22:06:44.637 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-webtest. 2021-09-15T22:06:44.656 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../38-python3-webtest_2.0.32-2_all.deb ... 2021-09-15T22:06:44.720 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-09-15T22:06:44.903 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-09-15T22:06:44.923 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../54-ceph-mgr-dashboard_15.2.14-69-g3bb6dfef-1focal_all.deb ... 2021-09-15T22:06:44.962 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-dashboard (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:45.065 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-pecan. 2021-09-15T22:06:45.083 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../39-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-09-15T22:06:45.148 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-09-15T22:06:45.545 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-werkzeug. 2021-09-15T22:06:45.564 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../40-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-09-15T22:06:45.603 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-09-15T22:06:45.859 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-09-15T22:06:45.879 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-cloud_15.2.14-69-g3bb6dfef-1focal_all.deb ... 2021-09-15T22:06:45.917 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:46.023 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package ceph-mgr. 2021-09-15T22:06:46.041 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../41-ceph-mgr_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:46.089 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking ceph-mgr (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:46.212 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-decorator. 2021-09-15T22:06:46.228 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../56-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-09-15T22:06:46.261 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-09-15T22:06:46.564 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-09-15T22:06:46.568 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package ceph-mon. 2021-09-15T22:06:46.581 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../57-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-09-15T22:06:46.586 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../42-ceph-mon_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:46.623 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-09-15T22:06:46.625 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking ceph-mon (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:46.942 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-scipy. 2021-09-15T22:06:46.962 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../58-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-09-15T22:06:47.000 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-09-15T22:06:47.671 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package ceph-osd. 2021-09-15T22:06:47.687 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../43-ceph-osd_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:47.762 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking ceph-osd (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:48.310 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-09-15T22:06:48.328 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../59-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-09-15T22:06:48.368 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-09-15T22:06:48.939 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-joblib. 2021-09-15T22:06:48.958 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../60-python3-joblib_0.14.0-3_all.deb ... 2021-09-15T22:06:48.996 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-09-15T22:06:49.408 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-sklearn. 2021-09-15T22:06:49.424 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../61-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-09-15T22:06:49.475 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-09-15T22:06:50.166 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-09-15T22:06:50.184 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../62-ceph-mgr-diskprediction-local_15.2.14-69-g3bb6dfef-1focal_all.deb ... 2021-09-15T22:06:50.185 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package ceph. 2021-09-15T22:06:50.204 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../44-ceph_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:50.224 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:50.245 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking ceph (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:50.570 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package ceph-fuse. 2021-09-15T22:06:50.588 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../45-ceph-fuse_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:50.628 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking ceph-fuse (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:51.074 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package ceph-mds. 2021-09-15T22:06:51.090 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../46-ceph-mds_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:51.140 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking ceph-mds (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:51.328 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cachetools. 2021-09-15T22:06:51.347 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../63-python3-cachetools_4.0.0-1_all.deb ... 2021-09-15T22:06:51.385 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-09-15T22:06:51.739 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyasn1. 2021-09-15T22:06:51.759 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../64-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-09-15T22:06:51.797 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-09-15T22:06:52.068 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package cephadm. 2021-09-15T22:06:52.084 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../47-cephadm_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:52.125 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-09-15T22:06:52.126 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking cephadm (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:52.143 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../65-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-09-15T22:06:52.226 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-09-15T22:06:52.505 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-jinja2. 2021-09-15T22:06:52.522 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../48-python3-jinja2_2.10.1-2_all.deb ... 2021-09-15T22:06:52.571 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-09-15T22:06:52.932 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-09-15T22:06:52.950 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../49-ceph-mgr-cephadm_15.2.14-69-g3bb6dfef-1focal_all.deb ... 2021-09-15T22:06:52.961 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rsa. 2021-09-15T22:06:52.977 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../66-python3-rsa_4.0-3_all.deb ... 2021-09-15T22:06:52.999 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking ceph-mgr-cephadm (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:53.019 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rsa (4.0-3) ... 2021-09-15T22:06:53.341 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-google-auth. 2021-09-15T22:06:53.359 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../67-python3-google-auth_1.5.1-2_all.deb ... 2021-09-15T22:06:53.369 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-repoze.lru. 2021-09-15T22:06:53.385 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../50-python3-repoze.lru_0.7-2_all.deb ... 2021-09-15T22:06:53.399 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-09-15T22:06:53.427 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-09-15T22:06:53.721 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package libjs-underscore. 2021-09-15T22:06:53.735 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-blinker. 2021-09-15T22:06:53.738 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../51-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-09-15T22:06:53.752 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../68-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-09-15T22:06:53.780 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-09-15T22:06:53.793 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-09-15T22:06:54.082 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-09-15T22:06:54.098 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../52-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-09-15T22:06:54.105 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-oauthlib. 2021-09-15T22:06:54.121 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../69-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-09-15T22:06:54.140 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-09-15T22:06:54.154 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-09-15T22:06:54.442 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-09-15T22:06:54.460 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../70-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-09-15T22:06:54.485 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-routes. 2021-09-15T22:06:54.491 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-09-15T22:06:54.504 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../53-python3-routes_2.4.1-2_all.deb ... 2021-09-15T22:06:54.543 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-09-15T22:06:54.753 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-websocket. 2021-09-15T22:06:54.771 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../71-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-09-15T22:06:54.811 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-09-15T22:06:54.897 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-09-15T22:06:54.912 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../54-ceph-mgr-dashboard_15.2.14-69-g3bb6dfef-1focal_all.deb ... 2021-09-15T22:06:54.955 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking ceph-mgr-dashboard (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:55.155 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-kubernetes. 2021-09-15T22:06:55.172 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../72-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-09-15T22:06:55.213 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-09-15T22:06:55.768 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-09-15T22:06:55.785 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../73-ceph-mgr-k8sevents_15.2.14-69-g3bb6dfef-1focal_all.deb ... 2021-09-15T22:06:55.826 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-k8sevents (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:55.979 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-09-15T22:06:55.995 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-cloud_15.2.14-69-g3bb6dfef-1focal_all.deb ... 2021-09-15T22:06:56.062 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:56.179 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libonig5:amd64. 2021-09-15T22:06:56.195 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../74-libonig5_6.9.4-1_amd64.deb ... 2021-09-15T22:06:56.237 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-09-15T22:06:56.390 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-decorator. 2021-09-15T22:06:56.406 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../56-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-09-15T22:06:56.465 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-09-15T22:06:56.624 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjq1:amd64. 2021-09-15T22:06:56.641 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../75-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-09-15T22:06:56.690 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-09-15T22:06:56.801 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-09-15T22:06:56.818 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../57-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-09-15T22:06:56.893 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-09-15T22:06:56.993 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package jq. 2021-09-15T22:06:57.011 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../76-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-09-15T22:06:57.051 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-09-15T22:06:57.204 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-scipy. 2021-09-15T22:06:57.220 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../58-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-09-15T22:06:57.296 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-09-15T22:06:57.321 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package socat. 2021-09-15T22:06:57.337 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../77-socat_1.7.3.3-2_amd64.deb ... 2021-09-15T22:06:57.403 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking socat (1.7.3.3-2) ... 2021-09-15T22:06:57.841 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-09-15T22:06:57.860 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../78-libxslt1.1_1.1.34-4_amd64.deb ... 2021-09-15T22:06:57.907 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-09-15T22:06:58.169 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package xmlstarlet. 2021-09-15T22:06:58.186 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../79-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-09-15T22:06:58.227 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-09-15T22:06:58.573 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-test. 2021-09-15T22:06:58.589 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../80-ceph-test_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:06:58.630 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-test (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:06:58.689 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-09-15T22:06:58.706 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../59-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-09-15T22:06:58.756 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-09-15T22:06:59.401 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-joblib. 2021-09-15T22:06:59.421 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../60-python3-joblib_0.14.0-3_all.deb ... 2021-09-15T22:06:59.459 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-09-15T22:06:59.871 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-sklearn. 2021-09-15T22:06:59.890 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../61-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-09-15T22:06:59.929 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-09-15T22:07:00.596 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-09-15T22:07:00.615 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../62-ceph-mgr-diskprediction-local_15.2.14-69-g3bb6dfef-1focal_all.deb ... 2021-09-15T22:07:00.679 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:01.832 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-cachetools. 2021-09-15T22:07:01.850 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../63-python3-cachetools_4.0.0-1_all.deb ... 2021-09-15T22:07:01.892 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-09-15T22:07:02.095 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libcephfs-dev. 2021-09-15T22:07:02.112 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../81-libcephfs-dev_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:07:02.145 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libcephfs-dev (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:02.227 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-pyasn1. 2021-09-15T22:07:02.245 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../64-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-09-15T22:07:02.285 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-09-15T22:07:02.539 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package nvme-cli. 2021-09-15T22:07:02.556 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../82-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-09-15T22:07:02.615 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-09-15T22:07:02.647 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-09-15T22:07:02.663 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../65-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-09-15T22:07:02.705 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-09-15T22:07:03.004 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-atomicwrites. 2021-09-15T22:07:03.023 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../83-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-09-15T22:07:03.033 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-rsa. 2021-09-15T22:07:03.052 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../66-python3-rsa_4.0-3_all.deb ... 2021-09-15T22:07:03.061 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-09-15T22:07:03.091 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-rsa (4.0-3) ... 2021-09-15T22:07:03.373 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-attr. 2021-09-15T22:07:03.389 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../84-python3-attr_19.3.0-2_all.deb ... 2021-09-15T22:07:03.428 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-google-auth. 2021-09-15T22:07:03.444 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../67-python3-google-auth_1.5.1-2_all.deb ... 2021-09-15T22:07:03.447 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-09-15T22:07:03.486 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-09-15T22:07:03.817 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webencodings. 2021-09-15T22:07:03.833 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../85-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-09-15T22:07:03.848 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-blinker. 2021-09-15T22:07:03.864 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../68-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-09-15T22:07:03.900 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-09-15T22:07:03.906 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-09-15T22:07:04.196 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-html5lib. 2021-09-15T22:07:04.216 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../86-python3-html5lib_1.0.1-2_all.deb ... 2021-09-15T22:07:04.217 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-oauthlib. 2021-09-15T22:07:04.237 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../69-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-09-15T22:07:04.253 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-09-15T22:07:04.275 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-09-15T22:07:04.615 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-09-15T22:07:04.629 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-09-15T22:07:04.632 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../87-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-09-15T22:07:04.644 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../70-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-09-15T22:07:04.672 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-09-15T22:07:04.687 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-09-15T22:07:05.057 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-websocket. 2021-09-15T22:07:05.074 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../71-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-09-15T22:07:05.123 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-09-15T22:07:05.143 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-packaging. 2021-09-15T22:07:05.159 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../88-python3-packaging_20.3-1_all.deb ... 2021-09-15T22:07:05.201 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-packaging (20.3-1) ... 2021-09-15T22:07:05.484 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-kubernetes. 2021-09-15T22:07:05.501 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../72-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-09-15T22:07:05.537 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pastescript. 2021-09-15T22:07:05.542 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-09-15T22:07:05.553 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../89-python3-pastescript_2.0.2-4_all.deb ... 2021-09-15T22:07:05.595 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-09-15T22:07:05.940 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pluggy. 2021-09-15T22:07:05.956 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../90-python3-pluggy_0.13.0-2_all.deb ... 2021-09-15T22:07:05.998 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-09-15T22:07:06.134 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-09-15T22:07:06.153 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../73-ceph-mgr-k8sevents_15.2.14-69-g3bb6dfef-1focal_all.deb ... 2021-09-15T22:07:06.197 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking ceph-mgr-k8sevents (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:06.285 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-psutil. 2021-09-15T22:07:06.303 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../91-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-09-15T22:07:06.335 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-09-15T22:07:06.517 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package libonig5:amd64. 2021-09-15T22:07:06.536 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../74-libonig5_6.9.4-1_amd64.deb ... 2021-09-15T22:07:06.583 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-09-15T22:07:06.596 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-py. 2021-09-15T22:07:06.614 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../92-python3-py_1.8.1-1_all.deb ... 2021-09-15T22:07:06.679 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-py (1.8.1-1) ... 2021-09-15T22:07:06.941 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyinotify. 2021-09-15T22:07:06.959 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../93-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-09-15T22:07:06.965 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package libjq1:amd64. 2021-09-15T22:07:06.985 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../75-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-09-15T22:07:06.999 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-09-15T22:07:07.028 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-09-15T22:07:07.306 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package jq. 2021-09-15T22:07:07.325 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../76-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-09-15T22:07:07.335 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-wcwidth. 2021-09-15T22:07:07.352 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../94-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-09-15T22:07:07.389 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-09-15T22:07:07.393 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-09-15T22:07:07.600 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package socat. 2021-09-15T22:07:07.616 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../77-socat_1.7.3.3-2_amd64.deb ... 2021-09-15T22:07:07.650 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking socat (1.7.3.3-2) ... 2021-09-15T22:07:07.721 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pytest. 2021-09-15T22:07:07.738 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../95-python3-pytest_4.6.9-1_all.deb ... 2021-09-15T22:07:07.770 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-09-15T22:07:08.070 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-09-15T22:07:08.087 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../78-libxslt1.1_1.1.34-4_amd64.deb ... 2021-09-15T22:07:08.128 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-09-15T22:07:08.133 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-simplejson. 2021-09-15T22:07:08.151 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../96-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-09-15T22:07:08.191 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-09-15T22:07:08.425 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package xmlstarlet. 2021-09-15T22:07:08.444 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../79-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-09-15T22:07:08.484 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-09-15T22:07:08.644 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package radosgw. 2021-09-15T22:07:08.661 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../97-radosgw_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:07:08.710 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking radosgw (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:08.838 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package ceph-test. 2021-09-15T22:07:08.855 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../80-ceph-test_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:07:08.896 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking ceph-test (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:09.814 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package rbd-fuse. 2021-09-15T22:07:09.830 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../98-rbd-fuse_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:07:09.872 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking rbd-fuse (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:10.207 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-attr (19.3.0-2) ... 2021-09-15T22:07:10.552 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-09-15T22:07:10.678 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-09-15T22:07:10.804 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-09-15T22:07:11.030 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephadm (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:11.641 INFO:teuthology.orchestra.run.smithi184.stdout:Adding system user cephadm....done 2021-09-15T22:07:11.844 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-09-15T22:07:12.204 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-09-15T22:07:12.486 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package libcephfs-dev. 2021-09-15T22:07:12.488 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-09-15T22:07:12.502 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../81-libcephfs-dev_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:07:12.544 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking libcephfs-dev (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:12.614 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-py (1.8.1-1) ... 2021-09-15T22:07:12.958 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-09-15T22:07:12.989 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package nvme-cli. 2021-09-15T22:07:13.006 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../82-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-09-15T22:07:13.064 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-09-15T22:07:13.309 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-09-15T22:07:13.462 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-atomicwrites. 2021-09-15T22:07:13.478 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../83-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-09-15T22:07:13.520 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-09-15T22:07:13.586 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-09-15T22:07:13.848 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-attr. 2021-09-15T22:07:13.863 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../84-python3-attr_19.3.0-2_all.deb ... 2021-09-15T22:07:13.870 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-09-15T22:07:13.906 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-09-15T22:07:14.146 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-09-15T22:07:14.234 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-webencodings. 2021-09-15T22:07:14.253 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../85-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-09-15T22:07:14.292 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-09-15T22:07:14.465 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-ceph-argparse (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:14.545 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-html5lib. 2021-09-15T22:07:14.564 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../86-python3-html5lib_1.0.1-2_all.deb ... 2021-09-15T22:07:14.620 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-09-15T22:07:14.756 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-09-15T22:07:14.874 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-09-15T22:07:14.923 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-09-15T22:07:14.941 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../87-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-09-15T22:07:15.014 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-09-15T22:07:15.142 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-09-15T22:07:15.427 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-09-15T22:07:15.460 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-packaging. 2021-09-15T22:07:15.477 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../88-python3-packaging_20.3-1_all.deb ... 2021-09-15T22:07:15.518 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-packaging (20.3-1) ... 2021-09-15T22:07:15.786 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-09-15T22:07:15.962 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-pastescript. 2021-09-15T22:07:15.981 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../89-python3-pastescript_2.0.2-4_all.deb ... 2021-09-15T22:07:16.062 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-09-15T22:07:16.063 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-09-15T22:07:16.397 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-09-15T22:07:16.408 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-pluggy. 2021-09-15T22:07:16.424 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../90-python3-pluggy_0.13.0-2_all.deb ... 2021-09-15T22:07:16.466 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-09-15T22:07:16.689 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-09-15T22:07:16.811 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-psutil. 2021-09-15T22:07:16.827 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../91-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-09-15T22:07:16.868 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-09-15T22:07:17.032 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-09-15T22:07:17.239 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-py. 2021-09-15T22:07:17.257 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../92-python3-py_1.8.1-1_all.deb ... 2021-09-15T22:07:17.296 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-py (1.8.1-1) ... 2021-09-15T22:07:17.334 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-packaging (20.3-1) ... 2021-09-15T22:07:17.625 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-pyinotify. 2021-09-15T22:07:17.626 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-09-15T22:07:17.644 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../93-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-09-15T22:07:17.683 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-09-15T22:07:17.752 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-09-15T22:07:18.038 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-09-15T22:07:18.053 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-wcwidth. 2021-09-15T22:07:18.070 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../94-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-09-15T22:07:18.111 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-09-15T22:07:18.448 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-09-15T22:07:18.464 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-pytest. 2021-09-15T22:07:18.481 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../95-python3-pytest_4.6.9-1_all.deb ... 2021-09-15T22:07:18.522 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-09-15T22:07:18.813 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-09-15T22:07:18.876 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package python3-simplejson. 2021-09-15T22:07:18.894 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../96-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-09-15T22:07:18.942 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-09-15T22:07:19.216 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up socat (1.7.3.3-2) ... 2021-09-15T22:07:19.342 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-ceph-common (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:19.421 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package radosgw. 2021-09-15T22:07:19.438 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../97-radosgw_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:07:19.481 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking radosgw (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:19.685 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-09-15T22:07:20.036 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-09-15T22:07:20.162 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-09-15T22:07:20.464 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-09-15T22:07:20.558 INFO:teuthology.orchestra.run.smithi180.stdout:Selecting previously unselected package rbd-fuse. 2021-09-15T22:07:20.574 INFO:teuthology.orchestra.run.smithi180.stdout:Preparing to unpack .../98-rbd-fuse_15.2.14-69-g3bb6dfef-1focal_amd64.deb ... 2021-09-15T22:07:20.589 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-09-15T22:07:20.616 INFO:teuthology.orchestra.run.smithi180.stdout:Unpacking rbd-fuse (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:20.924 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-09-15T22:07:20.937 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-attr (19.3.0-2) ... 2021-09-15T22:07:21.251 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-09-15T22:07:21.268 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-09-15T22:07:21.372 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-09-15T22:07:21.498 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-09-15T22:07:21.544 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-09-15T22:07:21.703 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-09-15T22:07:21.725 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up cephadm (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:21.987 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-09-15T22:07:22.280 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-09-15T22:07:22.589 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-09-15T22:07:22.811 INFO:teuthology.orchestra.run.smithi180.stdout:Adding system user cephadm....done 2021-09-15T22:07:22.939 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-09-15T22:07:23.098 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-09-15T22:07:23.370 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-09-15T22:07:23.458 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-09-15T22:07:23.751 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-09-15T22:07:23.793 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-09-15T22:07:23.902 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-py (1.8.1-1) ... 2021-09-15T22:07:24.111 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-09-15T22:07:24.220 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-09-15T22:07:24.471 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-09-15T22:07:24.622 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-09-15T22:07:24.630 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-09-15T22:07:24.748 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-09-15T22:07:24.957 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-09-15T22:07:25.082 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-09-15T22:07:25.266 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-09-15T22:07:25.375 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librados2 (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:25.535 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-09-15T22:07:25.568 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-09-15T22:07:25.860 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-ceph-argparse (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:26.179 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-09-15T22:07:26.305 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-09-15T22:07:26.614 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-09-15T22:07:26.915 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-09-15T22:07:26.966 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librgw2 (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:27.108 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-09-15T22:07:27.234 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-09-15T22:07:27.292 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-09-15T22:07:27.576 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-09-15T22:07:27.636 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-09-15T22:07:27.917 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-09-15T22:07:27.945 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-09-15T22:07:28.204 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-09-15T22:07:28.280 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-09-15T22:07:28.564 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-09-15T22:07:28.614 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libcephfs2 (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:28.765 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-09-15T22:07:28.907 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-packaging (20.3-1) ... 2021-09-15T22:07:29.075 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libradosstriper1 (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:29.198 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-09-15T22:07:29.226 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-09-15T22:07:29.350 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-09-15T22:07:29.561 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-09-15T22:07:29.643 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-09-15T22:07:30.044 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-09-15T22:07:30.421 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-09-15T22:07:30.666 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librbd1 (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:30.765 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up socat (1.7.3.3-2) ... 2021-09-15T22:07:30.792 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-09-15T22:07:30.907 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-ceph-common (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:30.918 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-09-15T22:07:31.076 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-09-15T22:07:31.250 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-09-15T22:07:31.379 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-09-15T22:07:31.496 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rsa (4.0-3) ... 2021-09-15T22:07:31.602 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-09-15T22:07:31.728 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-09-15T22:07:31.814 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-09-15T22:07:32.054 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-09-15T22:07:32.124 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-modules-core (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:32.155 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-09-15T22:07:32.250 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-fuse (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:32.471 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-09-15T22:07:32.471 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-09-15T22:07:32.490 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-09-15T22:07:32.766 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-09-15T22:07:32.951 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libcephfs-dev (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:33.084 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-09-15T22:07:33.087 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-09-15T22:07:33.210 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-09-15T22:07:33.422 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-09-15T22:07:33.503 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-09-15T22:07:33.749 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-09-15T22:07:33.795 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-09-15T22:07:34.113 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-09-15T22:07:34.117 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rados (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:34.260 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rbd (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:34.412 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up rbd-fuse (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:34.478 INFO:teuthology.orchestra.run.smithi180.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-09-15T22:07:34.538 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-routes (2.4.1-2) ... 2021-09-15T22:07:34.741 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-09-15T22:07:34.847 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-09-15T22:07:34.867 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-09-15T22:07:35.185 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rgw (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:35.185 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-09-15T22:07:35.337 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cephfs (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:35.562 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-09-15T22:07:35.671 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-09-15T22:07:35.762 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-09-15T22:07:35.772 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-09-15T22:07:36.082 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-09-15T22:07:36.399 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up librados2 (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:36.525 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-09-15T22:07:36.712 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-common (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:37.282 INFO:teuthology.orchestra.run.smithi184.stdout:Adding group ceph....done 2021-09-15T22:07:37.685 INFO:teuthology.orchestra.run.smithi184.stdout:Adding system user ceph....done 2021-09-15T22:07:37.871 INFO:teuthology.orchestra.run.smithi184.stdout:Setting system user ceph properties....done 2021-09-15T22:07:37.893 INFO:teuthology.orchestra.run.smithi184.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-09-15T22:07:37.974 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up librgw2 (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:38.041 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-09-15T22:07:38.125 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-09-15T22:07:38.259 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-09-15T22:07:38.367 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-09-15T22:07:38.636 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-09-15T22:07:38.817 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-test (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:38.943 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up radosgw (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:38.945 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-09-15T22:07:39.213 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-09-15T22:07:39.249 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-09-15T22:07:39.249 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-09-15T22:07:39.531 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up libcephfs2 (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:39.649 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-09-15T22:07:39.946 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-base (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:40.009 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up libradosstriper1 (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:40.135 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-09-15T22:07:40.257 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-09-15T22:07:40.495 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-09-15T22:07:40.706 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mds (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:40.918 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-09-15T22:07:40.919 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-09-15T22:07:41.365 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:41.551 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up librbd1 (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:41.594 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-09-15T22:07:41.595 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-09-15T22:07:41.676 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-09-15T22:07:41.802 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-09-15T22:07:41.954 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-09-15T22:07:42.042 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:42.185 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-osd (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:42.297 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-09-15T22:07:42.406 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-rsa (4.0-3) ... 2021-09-15T22:07:42.705 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-09-15T22:07:42.820 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-09-15T22:07:42.821 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-09-15T22:07:43.019 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up ceph-mgr-modules-core (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:43.170 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up ceph-fuse (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:43.288 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-k8sevents (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:43.376 INFO:teuthology.orchestra.run.smithi180.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-09-15T22:07:43.376 INFO:teuthology.orchestra.run.smithi180.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-09-15T22:07:43.415 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-diskprediction-local (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:43.558 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mon (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:43.785 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-09-15T22:07:43.786 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-09-15T22:07:43.797 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up libcephfs-dev (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:43.906 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-09-15T22:07:44.208 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-09-15T22:07:44.276 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-cephadm (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:44.411 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:44.517 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-09-15T22:07:44.528 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-dashboard (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:44.672 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-09-15T22:07:44.878 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-rados (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:44.939 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-09-15T22:07:44.991 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-rbd (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:45.117 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up rbd-fuse (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:45.270 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-routes (2.4.1-2) ... 2021-09-15T22:07:45.567 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-09-15T22:07:45.882 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-rgw (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:46.050 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-cephfs (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:46.410 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-09-15T22:07:47.355 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up ceph-common (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:47.884 INFO:teuthology.orchestra.run.smithi180.stdout:Adding group ceph....done 2021-09-15T22:07:47.975 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-09-15T22:07:48.247 INFO:teuthology.orchestra.run.smithi180.stdout:Adding system user ceph....done 2021-09-15T22:07:48.385 INFO:teuthology.orchestra.run.smithi184.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-09-15T22:07:48.388 DEBUG:teuthology.parallel:result is None 2021-09-15T22:07:48.391 INFO:teuthology.orchestra.run.smithi180.stdout:Setting system user ceph properties....done 2021-09-15T22:07:48.414 INFO:teuthology.orchestra.run.smithi180.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-09-15T22:07:48.556 INFO:teuthology.orchestra.run.smithi180.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-09-15T22:07:48.875 INFO:teuthology.orchestra.run.smithi180.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-09-15T22:07:49.329 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up ceph-test (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:49.471 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up radosgw (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:49.720 INFO:teuthology.orchestra.run.smithi180.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-09-15T22:07:49.721 INFO:teuthology.orchestra.run.smithi180.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-09-15T22:07:50.415 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up ceph-base (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:50.752 INFO:teuthology.orchestra.run.smithi180.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-09-15T22:07:51.208 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up ceph-mds (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:51.418 INFO:teuthology.orchestra.run.smithi180.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-09-15T22:07:51.418 INFO:teuthology.orchestra.run.smithi180.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-09-15T22:07:51.910 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up ceph-mgr (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:52.139 INFO:teuthology.orchestra.run.smithi180.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-09-15T22:07:52.139 INFO:teuthology.orchestra.run.smithi180.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-09-15T22:07:52.587 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:52.763 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up ceph-osd (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:53.373 INFO:teuthology.orchestra.run.smithi180.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-09-15T22:07:53.373 INFO:teuthology.orchestra.run.smithi180.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-09-15T22:07:54.158 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up ceph-mgr-k8sevents (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:54.284 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up ceph-mgr-diskprediction-local (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:54.435 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up ceph-mon (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:54.687 INFO:teuthology.orchestra.run.smithi180.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-09-15T22:07:54.688 INFO:teuthology.orchestra.run.smithi180.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-09-15T22:07:55.120 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up ceph-mgr-cephadm (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:55.263 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up ceph (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:55.414 INFO:teuthology.orchestra.run.smithi180.stdout:Setting up ceph-mgr-dashboard (15.2.14-69-g3bb6dfef-1focal) ... 2021-09-15T22:07:55.566 INFO:teuthology.orchestra.run.smithi180.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-09-15T22:07:55.867 INFO:teuthology.orchestra.run.smithi180.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-09-15T22:07:58.904 INFO:teuthology.orchestra.run.smithi180.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-09-15T22:07:59.418 INFO:teuthology.orchestra.run.smithi180.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-09-15T22:07:59.421 DEBUG:teuthology.parallel:result is None 2021-09-15T22:07:59.422 DEBUG:teuthology.orchestra.run.smithi180:> sudo lsb_release -is 2021-09-15T22:07:59.464 INFO:teuthology.orchestra.run.smithi180.stdout:Ubuntu 2021-09-15T22:07:59.469 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-09-15T22:07:59.469 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-09-15T22:07:59.470 INFO:teuthology.packaging:ref: None 2021-09-15T22:07:59.470 INFO:teuthology.packaging:tag: None 2021-09-15T22:07:59.470 INFO:teuthology.packaging:branch: octopus 2021-09-15T22:07:59.471 INFO:teuthology.packaging:sha1: b70647e8796c78a4f551a1edd9ebceb06255dced 2021-09-15T22:07:59.471 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-09-15T22:07:59.706 DEBUG:teuthology.orchestra.run.smithi180:> dpkg-query -W -f '${Version}' ceph 2021-09-15T22:07:59.729 INFO:teuthology.orchestra.run.smithi180.stdout:15.2.14-69-g3bb6dfef-1focal 2021-09-15T22:07:59.730 INFO:teuthology.packaging:The installed version of ceph is 15.2.14-69-g3bb6dfef-1focal 2021-09-15T22:07:59.732 INFO:teuthology.task.install:The correct ceph version 15.2.14-69-g3bb6dfef-1focal is installed. 2021-09-15T22:07:59.732 DEBUG:teuthology.orchestra.run.smithi184:> sudo lsb_release -is 2021-09-15T22:07:59.785 INFO:teuthology.orchestra.run.smithi184.stdout:Ubuntu 2021-09-15T22:07:59.791 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-09-15T22:07:59.791 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-09-15T22:07:59.792 INFO:teuthology.packaging:ref: None 2021-09-15T22:07:59.792 INFO:teuthology.packaging:tag: None 2021-09-15T22:07:59.792 INFO:teuthology.packaging:branch: octopus 2021-09-15T22:07:59.793 INFO:teuthology.packaging:sha1: b70647e8796c78a4f551a1edd9ebceb06255dced 2021-09-15T22:07:59.793 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-09-15T22:08:00.009 DEBUG:teuthology.orchestra.run.smithi184:> dpkg-query -W -f '${Version}' ceph 2021-09-15T22:08:00.088 INFO:teuthology.orchestra.run.smithi184.stdout:15.2.14-69-g3bb6dfef-1focal 2021-09-15T22:08:00.089 INFO:teuthology.packaging:The installed version of ceph is 15.2.14-69-g3bb6dfef-1focal 2021-09-15T22:08:00.089 INFO:teuthology.task.install:The correct ceph version 15.2.14-69-g3bb6dfef-1focal is installed. 2021-09-15T22:08:00.089 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-09-15T22:08:00.090 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:00.091 DEBUG:teuthology.orchestra.run.smithi180:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-09-15T22:08:00.108 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:00.109 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-09-15T22:08:00.125 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-09-15T22:08:00.126 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:00.126 DEBUG:teuthology.orchestra.run.smithi180:> sudo dd of=/usr/bin/daemon-helper 2021-09-15T22:08:00.142 DEBUG:teuthology.orchestra.run.smithi180:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-09-15T22:08:00.201 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:00.201 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2021-09-15T22:08:00.216 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-09-15T22:08:00.232 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-09-15T22:08:00.232 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:00.233 DEBUG:teuthology.orchestra.run.smithi180:> sudo dd of=/usr/bin/adjust-ulimits 2021-09-15T22:08:00.249 DEBUG:teuthology.orchestra.run.smithi180:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-09-15T22:08:00.260 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:00.260 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2021-09-15T22:08:00.274 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-09-15T22:08:00.330 INFO:teuthology.run_tasks:Running task ceph... 2021-09-15T22:08:00.394 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-09-15T22:08:00.395 DEBUG:teuthology.orchestra.run.smithi180:> sudo chmod 777 /var/log/ceph 2021-09-15T22:08:00.397 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /var/log/ceph 2021-09-15T22:08:00.413 INFO:tasks.ceph:Disabling ceph logrotate... 2021-09-15T22:08:00.413 DEBUG:teuthology.orchestra.run.smithi180:> sudo rm -f -- /etc/logrotate.d/ceph 2021-09-15T22:08:00.415 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/logrotate.d/ceph 2021-09-15T22:08:00.426 INFO:tasks.ceph:Creating extra log directories... 2021-09-15T22:08:00.426 DEBUG:teuthology.orchestra.run.smithi180:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-09-15T22:08:00.467 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-09-15T22:08:00.493 INFO:tasks.ceph:Creating ceph cluster c1... 2021-09-15T22:08:00.494 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'cpu_profile': set(), 'cluster': 'c1', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-09-15T22:08:00.494 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2021-09-15_21:37:43-upgrade:octopus-x-master-distro-basic-smithi/6391763', 'branch': 'master', 'description': 'upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '6391763', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2021-09-15_21:37:43-upgrade:octopus-x-master-distro-basic-smithi', 'nuke-on-error': True, 'overrides': {'admin_socket': {'branch': 'master'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b70647e8796c78a4f551a1edd9ebceb06255dced', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'branch': 'octopus', 'sha1': 'b70647e8796c78a4f551a1edd9ebceb06255dced'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}, {'endpoints': ['c2.client.1'], 'is_pubsub': True, 'name': 'test-zone3'}]}]}, 'rgw-multisite-tests': {'args': ['tests.py', 'tests_ps.py'], 'branch': 'octopus', 'repo': 'https://github.com/ceph/ceph.git'}, 'workunit': {'branch': 'master', 'sha1': 'b70647e8796c78a4f551a1edd9ebceb06255dced'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 70, 'repo': 'git://git.ceph.com/ceph.git', 'roles': [['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'], ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']], 'sha1': 'b70647e8796c78a4f551a1edd9ebceb06255dced', 'sleep_before_teardown': 0, 'suite': 'upgrade:octopus-x', 'suite_branch': 'master', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b70647e8796c78a4f551a1edd9ebceb06255dced/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph.git', 'suite_sha1': 'b70647e8796c78a4f551a1edd9ebceb06255dced', 'targets': {'smithi180.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWPvLgA4ep3bwkX4Qg0xlvLShAXjOjtFjDSW1pdclYZl20cXcJyjXEi+aA66hlscTJ2c5zUtPvN+ipMQ8KkCDwr4LGOrMW8OQArlErgF26hq8FKeCEIX6UjbSpiYs+7vG9hrNJY3b7Hf1KTVFXWOkwH6iqVPIWy8mcUmOzMLUqNOfniKWa4qGVGx0KplrOwdAg2Hw6O5tV0+j6aFMmKDb6ozo8bwMzVlk0lD97K1eaPR2RPzyeVN6G9nxKHTU7ka6IDTWaSU5ncTTV4l4n2sjoDeDjJYc39YrrXh/hSAbxC365XgeSLa9Mre/fE+m75pnVIWMbYAmVElUMoYOo+8xt0u5RIO4XdDBVGTdCp4PkBWONNSAD4t+//avEM02xuaTDlbhUSeGKNkAg1t1m8XsbHG5JDd9fX/e3rzbhUIsFWhJe2BNuhm60fdOxjaVxQ8PfgncmNyu2zN8tYrxYLPvwmv6YVbY1B+C59q6+GMlp6X1iV45QMuZ4ms9HZTCyQ2s=', 'smithi184.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMTAxZZG2AEqYXX4LK0VKCAcmcB8fDDlh6kP/ibDpbWHdKaOnqZXkBYEQr9z5JmYb+FhrarWD6jxmQfFgHNu4OQkpGHRls1t/0CZ8VkskjU7BsgycggFMxNUjfci3ebGZ/sCZryWGkN/PvXzoprwXHqksTdMbDZGKXbM7QeA6AQZNPsE81stH6Q0++LKJOGy5Tg53E6yPyhUjJVinqczET1EAlDUSxnFEDyJUm2/MOor5bQucEt+mdKgSShWU9fhn6FN9blcur1qZMsxthr1THTBCLZyFEaREMDpc1Wvjudor/hJNLGnqxYAsS+0Y+zN50GfzqO0N5aur7sTwVreX5dFdzty15yxPJdBCvBB6w3cm6jWyKbgIb3AfTaS8OHsMlmXcG8FDpV/Xez+x+atWH8Tt3hvX3DgrptKYM/HsccrDET76txc/j0Fk2/GKEb5xWmB2knyGQZUON798zLSJeZe10rskQjoRwk2nOr3Idj4fDX26sn3GgQ/VX+tqttn8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b70647e8796c78a4f551a1edd9ebceb06255dced', 'wait-for-scrub': False}}, {'ceph': {'cluster': 'c2'}}, {'parallel': ['upgrade-task']}, {'rgw': {'c1.client.0': {'port': 8000}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 60}}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'b135a4f82b02b966053efba0501e6a47c9d2d793', 'timestamp': '2021-09-15_21:37:43', 'tube': 'smithi', 'upgrade-task': [{'install.upgrade': {'c2.client.0': None, 'c2.client.1': None, 'c2.mgr.x': None, 'c2.mon.a': None, 'c2.osd.0': None, 'c2.osd.1': None, 'c2.osd.2': None}}], 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.30581'} 2021-09-15T22:08:00.495 DEBUG:teuthology.orchestra.run.smithi180:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2021-09-15T22:08:00.498 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2021-09-15T22:08:00.504 DEBUG:teuthology.orchestra.run.smithi180:> sudo install -d -m0777 -- /var/run/ceph 2021-09-15T22:08:00.507 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/run/ceph 2021-09-15T22:08:00.521 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:00.521 DEBUG:teuthology.orchestra.run.smithi180:> dd if=/scratch_devs of=/dev/stdout 2021-09-15T22:08:00.568 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-09-15T22:08:00.568 DEBUG:teuthology.orchestra.run.smithi180:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-09-15T22:08:00.575 INFO:teuthology.orchestra.run.smithi180.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-09-15T22:08:00.576 INFO:teuthology.orchestra.run.smithi180.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-09-15T22:08:00.576 INFO:teuthology.orchestra.run.smithi180.stdout:Device: 6h/6d Inode: 354 Links: 1 2021-09-15T22:08:00.576 INFO:teuthology.orchestra.run.smithi180.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-09-15T22:08:00.576 INFO:teuthology.orchestra.run.smithi180.stdout:Access: 2021-09-15 22:05:23.555997904 +0000 2021-09-15T22:08:00.577 INFO:teuthology.orchestra.run.smithi180.stdout:Modify: 2021-09-15 22:05:23.367997906 +0000 2021-09-15T22:08:00.577 INFO:teuthology.orchestra.run.smithi180.stdout:Change: 2021-09-15 22:05:23.367997906 +0000 2021-09-15T22:08:00.577 INFO:teuthology.orchestra.run.smithi180.stdout: Birth: - 2021-09-15T22:08:00.586 INFO:teuthology.orchestra.run.smithi180.stderr:1+0 records in 2021-09-15T22:08:00.586 INFO:teuthology.orchestra.run.smithi180.stderr:1+0 records out 2021-09-15T22:08:00.586 INFO:teuthology.orchestra.run.smithi180.stderr:512 bytes copied, 0.000273247 s, 1.9 MB/s 2021-09-15T22:08:00.591 DEBUG:teuthology.orchestra.run.smithi180:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-09-15T22:08:00.598 INFO:teuthology.orchestra.run.smithi180.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-09-15T22:08:00.598 INFO:teuthology.orchestra.run.smithi180.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-09-15T22:08:00.599 INFO:teuthology.orchestra.run.smithi180.stdout:Device: 6h/6d Inode: 362 Links: 1 2021-09-15T22:08:00.599 INFO:teuthology.orchestra.run.smithi180.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-09-15T22:08:00.599 INFO:teuthology.orchestra.run.smithi180.stdout:Access: 2021-09-15 22:05:23.939997900 +0000 2021-09-15T22:08:00.599 INFO:teuthology.orchestra.run.smithi180.stdout:Modify: 2021-09-15 22:05:23.787997901 +0000 2021-09-15T22:08:00.600 INFO:teuthology.orchestra.run.smithi180.stdout:Change: 2021-09-15 22:05:23.787997901 +0000 2021-09-15T22:08:00.600 INFO:teuthology.orchestra.run.smithi180.stdout: Birth: - 2021-09-15T22:08:00.605 INFO:teuthology.orchestra.run.smithi180.stderr:1+0 records in 2021-09-15T22:08:00.605 INFO:teuthology.orchestra.run.smithi180.stderr:1+0 records out 2021-09-15T22:08:00.605 INFO:teuthology.orchestra.run.smithi180.stderr:512 bytes copied, 0.00030613 s, 1.7 MB/s 2021-09-15T22:08:00.609 DEBUG:teuthology.orchestra.run.smithi180:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-09-15T22:08:00.660 INFO:teuthology.orchestra.run.smithi180.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-09-15T22:08:00.660 INFO:teuthology.orchestra.run.smithi180.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-09-15T22:08:00.660 INFO:teuthology.orchestra.run.smithi180.stdout:Device: 6h/6d Inode: 368 Links: 1 2021-09-15T22:08:00.661 INFO:teuthology.orchestra.run.smithi180.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-09-15T22:08:00.661 INFO:teuthology.orchestra.run.smithi180.stdout:Access: 2021-09-15 22:05:24.315997896 +0000 2021-09-15T22:08:00.661 INFO:teuthology.orchestra.run.smithi180.stdout:Modify: 2021-09-15 22:05:24.131997898 +0000 2021-09-15T22:08:00.661 INFO:teuthology.orchestra.run.smithi180.stdout:Change: 2021-09-15 22:05:24.131997898 +0000 2021-09-15T22:08:00.662 INFO:teuthology.orchestra.run.smithi180.stdout: Birth: - 2021-09-15T22:08:00.670 INFO:teuthology.orchestra.run.smithi180.stderr:1+0 records in 2021-09-15T22:08:00.670 INFO:teuthology.orchestra.run.smithi180.stderr:1+0 records out 2021-09-15T22:08:00.671 INFO:teuthology.orchestra.run.smithi180.stderr:512 bytes copied, 0.000300737 s, 1.7 MB/s 2021-09-15T22:08:00.675 DEBUG:teuthology.orchestra.run.smithi180:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-09-15T22:08:00.681 INFO:teuthology.orchestra.run.smithi180.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-09-15T22:08:00.682 INFO:teuthology.orchestra.run.smithi180.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-09-15T22:08:00.682 INFO:teuthology.orchestra.run.smithi180.stdout:Device: 6h/6d Inode: 374 Links: 1 2021-09-15T22:08:00.682 INFO:teuthology.orchestra.run.smithi180.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-09-15T22:08:00.682 INFO:teuthology.orchestra.run.smithi180.stdout:Access: 2021-09-15 22:05:24.699997892 +0000 2021-09-15T22:08:00.683 INFO:teuthology.orchestra.run.smithi180.stdout:Modify: 2021-09-15 22:05:24.531997893 +0000 2021-09-15T22:08:00.683 INFO:teuthology.orchestra.run.smithi180.stdout:Change: 2021-09-15 22:05:24.531997893 +0000 2021-09-15T22:08:00.683 INFO:teuthology.orchestra.run.smithi180.stdout: Birth: - 2021-09-15T22:08:00.691 INFO:teuthology.orchestra.run.smithi180.stderr:1+0 records in 2021-09-15T22:08:00.691 INFO:teuthology.orchestra.run.smithi180.stderr:1+0 records out 2021-09-15T22:08:00.691 INFO:teuthology.orchestra.run.smithi180.stderr:512 bytes copied, 0.000215033 s, 2.4 MB/s 2021-09-15T22:08:00.695 INFO:tasks.ceph:osd dev map: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-09-15T22:08:00.695 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi180.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-09-15T22:08:00.696 INFO:tasks.ceph:Generating config... 2021-09-15T22:08:00.697 INFO:tasks.ceph:[client] debug rgw = 20 2021-09-15T22:08:00.697 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2021-09-15T22:08:00.698 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2021-09-15T22:08:00.698 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-09-15T22:08:00.699 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2021-09-15T22:08:00.699 INFO:tasks.ceph:[client] rgw data log num shards = 4 2021-09-15T22:08:00.699 INFO:tasks.ceph:[client] rgw md log max shards = 4 2021-09-15T22:08:00.700 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2021-09-15T22:08:00.700 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2021-09-15T22:08:00.700 INFO:tasks.ceph:[client] setgroup = ceph 2021-09-15T22:08:00.700 INFO:tasks.ceph:[client] setuser = ceph 2021-09-15T22:08:00.701 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-09-15T22:08:00.701 INFO:tasks.ceph:[mgr] debug ms = 1 2021-09-15T22:08:00.701 INFO:tasks.ceph:[mon] debug mon = 20 2021-09-15T22:08:00.702 INFO:tasks.ceph:[mon] debug ms = 1 2021-09-15T22:08:00.702 INFO:tasks.ceph:[mon] debug paxos = 20 2021-09-15T22:08:00.702 INFO:tasks.ceph:[mon] mon_warn_on_insecure_global_id_reclaim = False 2021-09-15T22:08:00.702 INFO:tasks.ceph:[mon] mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-09-15T22:08:00.703 INFO:tasks.ceph:[osd] debug ms = 1 2021-09-15T22:08:00.703 INFO:tasks.ceph:[osd] debug osd = 20 2021-09-15T22:08:00.703 INFO:tasks.ceph:Setting up c1.mon.a... 2021-09-15T22:08:00.704 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c1.keyring 2021-09-15T22:08:00.760 INFO:teuthology.orchestra.run.smithi180.stdout:creating /etc/ceph/c1.keyring 2021-09-15T22:08:00.764 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c1.keyring 2021-09-15T22:08:00.800 DEBUG:teuthology.orchestra.run.smithi180:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-09-15T22:08:00.814 DEBUG:tasks.ceph:Ceph mon addresses: [('c1.mon.a', '172.21.15.180')] 2021-09-15T22:08:00.815 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.180'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2021-09-15T22:08:00.816 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:00.816 DEBUG:teuthology.orchestra.run.smithi180:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-09-15T22:08:00.823 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.180 --print /home/ubuntu/cephtest/c1.monmap 2021-09-15T22:08:00.850 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:08:00.850 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:08:00.851 INFO:teuthology.orchestra.run.smithi180.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c1.monmap 2021-09-15T22:08:00.851 INFO:teuthology.orchestra.run.smithi180.stdout:monmaptool: generated fsid 629c67a5-227f-4042-a582-15d73b0f5e90 2021-09-15T22:08:00.851 INFO:teuthology.orchestra.run.smithi180.stdout:epoch 0 2021-09-15T22:08:00.852 INFO:teuthology.orchestra.run.smithi180.stdout:fsid 629c67a5-227f-4042-a582-15d73b0f5e90 2021-09-15T22:08:00.852 INFO:teuthology.orchestra.run.smithi180.stdout:last_changed 2021-09-15T22:08:00.852986+0000 2021-09-15T22:08:00.852 INFO:teuthology.orchestra.run.smithi180.stdout:created 2021-09-15T22:08:00.852986+0000 2021-09-15T22:08:00.852 INFO:teuthology.orchestra.run.smithi180.stdout:min_mon_release 0 (unknown) 2021-09-15T22:08:00.853 INFO:teuthology.orchestra.run.smithi180.stdout:0: [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] mon.a 2021-09-15T22:08:00.853 INFO:teuthology.orchestra.run.smithi180.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c1.monmap (1 monitors) 2021-09-15T22:08:00.854 DEBUG:teuthology.orchestra.run.smithi180:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-09-15T22:08:00.859 INFO:tasks.ceph:Writing /etc/ceph/c1.conf for FSID 629c67a5-227f-4042-a582-15d73b0f5e90... 2021-09-15T22:08:00.860 DEBUG:teuthology.orchestra.run.smithi180:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2021-09-15T22:08:00.903 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2021-09-15T22:08:00.936 INFO:teuthology.orchestra.run.smithi180.stdout:[global] 2021-09-15T22:08:00.937 INFO:teuthology.orchestra.run.smithi180.stdout: chdir = "" 2021-09-15T22:08:00.937 INFO:teuthology.orchestra.run.smithi180.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-09-15T22:08:00.937 INFO:teuthology.orchestra.run.smithi180.stdout: auth supported = cephx 2021-09-15T22:08:00.937 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.938 INFO:teuthology.orchestra.run.smithi180.stdout: filestore xattr use omap = true 2021-09-15T22:08:00.938 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.938 INFO:teuthology.orchestra.run.smithi180.stdout: mon clock drift allowed = 1.000 2021-09-15T22:08:00.938 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.938 INFO:teuthology.orchestra.run.smithi180.stdout: osd crush chooseleaf type = 0 2021-09-15T22:08:00.939 INFO:teuthology.orchestra.run.smithi180.stdout: auth debug = true 2021-09-15T22:08:00.939 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.939 INFO:teuthology.orchestra.run.smithi180.stdout: ms die on old message = true 2021-09-15T22:08:00.939 INFO:teuthology.orchestra.run.smithi180.stdout: ms die on bug = true 2021-09-15T22:08:00.940 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.940 INFO:teuthology.orchestra.run.smithi180.stdout: mon max pg per osd = 10000 # >= luminous 2021-09-15T22:08:00.940 INFO:teuthology.orchestra.run.smithi180.stdout: mon pg warn max object skew = 0 2021-09-15T22:08:00.940 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.940 INFO:teuthology.orchestra.run.smithi180.stdout: # disable pg_autoscaler by default for new pools 2021-09-15T22:08:00.941 INFO:teuthology.orchestra.run.smithi180.stdout: osd_pool_default_pg_autoscale_mode = off 2021-09-15T22:08:00.941 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.941 INFO:teuthology.orchestra.run.smithi180.stdout: osd pool default size = 2 2021-09-15T22:08:00.941 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.942 INFO:teuthology.orchestra.run.smithi180.stdout: mon osd allow primary affinity = true 2021-09-15T22:08:00.942 INFO:teuthology.orchestra.run.smithi180.stdout: mon osd allow pg remap = true 2021-09-15T22:08:00.942 INFO:teuthology.orchestra.run.smithi180.stdout: mon warn on legacy crush tunables = false 2021-09-15T22:08:00.942 INFO:teuthology.orchestra.run.smithi180.stdout: mon warn on crush straw calc version zero = false 2021-09-15T22:08:00.942 INFO:teuthology.orchestra.run.smithi180.stdout: mon warn on no sortbitwise = false 2021-09-15T22:08:00.943 INFO:teuthology.orchestra.run.smithi180.stdout: mon warn on osd down out interval zero = false 2021-09-15T22:08:00.943 INFO:teuthology.orchestra.run.smithi180.stdout: mon warn on too few osds = false 2021-09-15T22:08:00.943 INFO:teuthology.orchestra.run.smithi180.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-09-15T22:08:00.943 INFO:teuthology.orchestra.run.smithi180.stdout: mon_warn_on_pool_no_redundancy = false 2021-09-15T22:08:00.944 INFO:teuthology.orchestra.run.smithi180.stdout: mon_allow_pool_size_one = true 2021-09-15T22:08:00.944 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.944 INFO:teuthology.orchestra.run.smithi180.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-09-15T22:08:00.944 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.944 INFO:teuthology.orchestra.run.smithi180.stdout: osd default data pool replay window = 5 2021-09-15T22:08:00.945 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.945 INFO:teuthology.orchestra.run.smithi180.stdout: mon allow pool delete = true 2021-09-15T22:08:00.945 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.945 INFO:teuthology.orchestra.run.smithi180.stdout: mon cluster log file level = debug 2021-09-15T22:08:00.946 INFO:teuthology.orchestra.run.smithi180.stdout: debug asserts on shutdown = true 2021-09-15T22:08:00.946 INFO:teuthology.orchestra.run.smithi180.stdout: mon health detail to clog = false 2021-09-15T22:08:00.946 INFO:teuthology.orchestra.run.smithi180.stdout: mon host = 172.21.15.180 2021-09-15T22:08:00.946 INFO:teuthology.orchestra.run.smithi180.stdout: fsid = 629c67a5-227f-4042-a582-15d73b0f5e90 2021-09-15T22:08:00.946 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.947 INFO:teuthology.orchestra.run.smithi180.stdout:[osd] 2021-09-15T22:08:00.947 INFO:teuthology.orchestra.run.smithi180.stdout: osd journal size = 100 2021-09-15T22:08:00.947 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.947 INFO:teuthology.orchestra.run.smithi180.stdout: osd scrub load threshold = 5.0 2021-09-15T22:08:00.948 INFO:teuthology.orchestra.run.smithi180.stdout: osd scrub max interval = 600 2021-09-15T22:08:00.948 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.949 INFO:teuthology.orchestra.run.smithi180.stdout: osd recover clone overlap = true 2021-09-15T22:08:00.949 INFO:teuthology.orchestra.run.smithi180.stdout: osd recovery max chunk = 1048576 2021-09-15T22:08:00.949 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.949 INFO:teuthology.orchestra.run.smithi180.stdout: osd debug shutdown = true 2021-09-15T22:08:00.950 INFO:teuthology.orchestra.run.smithi180.stdout: osd debug op order = true 2021-09-15T22:08:00.950 INFO:teuthology.orchestra.run.smithi180.stdout: osd debug verify stray on activate = true 2021-09-15T22:08:00.950 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.950 INFO:teuthology.orchestra.run.smithi180.stdout: osd open classes on start = true 2021-09-15T22:08:00.950 INFO:teuthology.orchestra.run.smithi180.stdout: osd debug pg log writeout = true 2021-09-15T22:08:00.951 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.951 INFO:teuthology.orchestra.run.smithi180.stdout: osd deep scrub update digest min age = 30 2021-09-15T22:08:00.951 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.951 INFO:teuthology.orchestra.run.smithi180.stdout: osd map max advance = 10 2021-09-15T22:08:00.951 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.952 INFO:teuthology.orchestra.run.smithi180.stdout: journal zero on create = true 2021-09-15T22:08:00.952 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.952 INFO:teuthology.orchestra.run.smithi180.stdout: filestore ondisk finisher threads = 3 2021-09-15T22:08:00.952 INFO:teuthology.orchestra.run.smithi180.stdout: filestore apply finisher threads = 3 2021-09-15T22:08:00.953 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.953 INFO:teuthology.orchestra.run.smithi180.stdout: bdev debug aio = true 2021-09-15T22:08:00.953 INFO:teuthology.orchestra.run.smithi180.stdout: osd debug misdirected ops = true 2021-09-15T22:08:00.953 INFO:teuthology.orchestra.run.smithi180.stdout: debug ms = 1 2021-09-15T22:08:00.953 INFO:teuthology.orchestra.run.smithi180.stdout: debug osd = 20 2021-09-15T22:08:00.954 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.954 INFO:teuthology.orchestra.run.smithi180.stdout:[mgr] 2021-09-15T22:08:00.954 INFO:teuthology.orchestra.run.smithi180.stdout: debug ms = 1 2021-09-15T22:08:00.954 INFO:teuthology.orchestra.run.smithi180.stdout: debug mgr = 20 2021-09-15T22:08:00.954 INFO:teuthology.orchestra.run.smithi180.stdout: debug mon = 20 2021-09-15T22:08:00.955 INFO:teuthology.orchestra.run.smithi180.stdout: debug auth = 20 2021-09-15T22:08:00.955 INFO:teuthology.orchestra.run.smithi180.stdout: mon reweight min pgs per osd = 4 2021-09-15T22:08:00.955 INFO:teuthology.orchestra.run.smithi180.stdout: mon reweight min bytes per osd = 10 2021-09-15T22:08:00.955 INFO:teuthology.orchestra.run.smithi180.stdout: mgr/telemetry/nag = false 2021-09-15T22:08:00.956 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.956 INFO:teuthology.orchestra.run.smithi180.stdout:[mon] 2021-09-15T22:08:00.956 INFO:teuthology.orchestra.run.smithi180.stdout: debug ms = 1 2021-09-15T22:08:00.956 INFO:teuthology.orchestra.run.smithi180.stdout: debug mon = 20 2021-09-15T22:08:00.956 INFO:teuthology.orchestra.run.smithi180.stdout: debug paxos = 20 2021-09-15T22:08:00.957 INFO:teuthology.orchestra.run.smithi180.stdout: debug auth = 20 2021-09-15T22:08:00.957 INFO:teuthology.orchestra.run.smithi180.stdout: mon data avail warn = 5 2021-09-15T22:08:00.957 INFO:teuthology.orchestra.run.smithi180.stdout: mon mgr mkfs grace = 240 2021-09-15T22:08:00.957 INFO:teuthology.orchestra.run.smithi180.stdout: mon reweight min pgs per osd = 4 2021-09-15T22:08:00.957 INFO:teuthology.orchestra.run.smithi180.stdout: mon osd reporter subtree level = osd 2021-09-15T22:08:00.958 INFO:teuthology.orchestra.run.smithi180.stdout: mon osd prime pg temp = true 2021-09-15T22:08:00.958 INFO:teuthology.orchestra.run.smithi180.stdout: mon reweight min bytes per osd = 10 2021-09-15T22:08:00.958 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.958 INFO:teuthology.orchestra.run.smithi180.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-09-15T22:08:00.959 INFO:teuthology.orchestra.run.smithi180.stdout: auth mon ticket ttl = 660 # 11m 2021-09-15T22:08:00.959 INFO:teuthology.orchestra.run.smithi180.stdout: auth service ticket ttl = 240 # 4m 2021-09-15T22:08:00.959 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.959 INFO:teuthology.orchestra.run.smithi180.stdout: # don't complain about insecure global_id in the test suite 2021-09-15T22:08:00.959 INFO:teuthology.orchestra.run.smithi180.stdout: mon_warn_on_insecure_global_id_reclaim = False 2021-09-15T22:08:00.960 INFO:teuthology.orchestra.run.smithi180.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-09-15T22:08:00.960 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:00.960 INFO:teuthology.orchestra.run.smithi180.stdout:[client] 2021-09-15T22:08:00.960 INFO:teuthology.orchestra.run.smithi180.stdout: rgw cache enabled = true 2021-09-15T22:08:00.960 INFO:teuthology.orchestra.run.smithi180.stdout: rgw enable ops log = true 2021-09-15T22:08:00.961 INFO:teuthology.orchestra.run.smithi180.stdout: rgw enable usage log = true 2021-09-15T22:08:00.961 INFO:teuthology.orchestra.run.smithi180.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-09-15T22:08:00.961 INFO:teuthology.orchestra.run.smithi180.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-09-15T22:08:00.961 INFO:teuthology.orchestra.run.smithi180.stdout: debug rgw = 20 2021-09-15T22:08:00.962 INFO:teuthology.orchestra.run.smithi180.stdout: rgw crypt require ssl = False 2021-09-15T22:08:00.962 INFO:teuthology.orchestra.run.smithi180.stdout: rgw crypt s3 kms backend = testing 2021-09-15T22:08:00.962 INFO:teuthology.orchestra.run.smithi180.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-09-15T22:08:00.962 INFO:teuthology.orchestra.run.smithi180.stdout: rgw curl low speed time = 300 2021-09-15T22:08:00.962 INFO:teuthology.orchestra.run.smithi180.stdout: rgw data log num shards = 4 2021-09-15T22:08:00.963 INFO:teuthology.orchestra.run.smithi180.stdout: rgw md log max shards = 4 2021-09-15T22:08:00.963 INFO:teuthology.orchestra.run.smithi180.stdout: rgw sync log trim interval = 0 2021-09-15T22:08:00.963 INFO:teuthology.orchestra.run.smithi180.stdout: rgw sync obj etag verify = True 2021-09-15T22:08:00.963 INFO:teuthology.orchestra.run.smithi180.stdout: setgroup = ceph 2021-09-15T22:08:00.963 INFO:teuthology.orchestra.run.smithi180.stdout: setuser = ceph 2021-09-15T22:08:00.964 INFO:teuthology.orchestra.run.smithi180.stdout:[mon.a] 2021-09-15T22:08:00.965 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2021-09-15T22:08:00.966 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2021-09-15T22:08:00.966 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-09-15T22:08:00.966 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2021-09-15T22:08:00.966 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.967 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2021-09-15T22:08:00.967 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.967 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2021-09-15T22:08:00.967 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.967 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2021-09-15T22:08:00.968 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2021-09-15T22:08:00.968 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.968 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2021-09-15T22:08:00.968 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2021-09-15T22:08:00.969 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.969 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2021-09-15T22:08:00.969 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2021-09-15T22:08:00.969 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.969 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2021-09-15T22:08:00.970 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2021-09-15T22:08:00.970 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.970 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2021-09-15T22:08:00.970 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.970 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2021-09-15T22:08:00.971 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2021-09-15T22:08:00.971 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2021-09-15T22:08:00.971 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2021-09-15T22:08:00.971 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2021-09-15T22:08:00.972 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2021-09-15T22:08:00.972 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2021-09-15T22:08:00.972 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-09-15T22:08:00.972 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2021-09-15T22:08:00.972 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2021-09-15T22:08:00.973 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.973 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-09-15T22:08:00.973 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.973 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2021-09-15T22:08:00.974 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.974 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2021-09-15T22:08:00.974 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.974 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2021-09-15T22:08:00.974 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2021-09-15T22:08:00.975 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2021-09-15T22:08:00.975 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = 172.21.15.180 2021-09-15T22:08:00.975 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = 629c67a5-227f-4042-a582-15d73b0f5e90 2021-09-15T22:08:00.975 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.976 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2021-09-15T22:08:00.976 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2021-09-15T22:08:00.976 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.976 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2021-09-15T22:08:00.976 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2021-09-15T22:08:00.977 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.977 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2021-09-15T22:08:00.977 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2021-09-15T22:08:00.977 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.977 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2021-09-15T22:08:00.978 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2021-09-15T22:08:00.978 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2021-09-15T22:08:00.978 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.978 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2021-09-15T22:08:00.978 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2021-09-15T22:08:00.979 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.979 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2021-09-15T22:08:00.979 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.979 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2021-09-15T22:08:00.979 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.980 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2021-09-15T22:08:00.980 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.980 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2021-09-15T22:08:00.980 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2021-09-15T22:08:00.980 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.981 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2021-09-15T22:08:00.981 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2021-09-15T22:08:00.981 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2021-09-15T22:08:00.981 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2021-09-15T22:08:00.982 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.982 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2021-09-15T22:08:00.982 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2021-09-15T22:08:00.982 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2021-09-15T22:08:00.983 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2021-09-15T22:08:00.983 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2021-09-15T22:08:00.983 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2021-09-15T22:08:00.983 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2021-09-15T22:08:00.983 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2021-09-15T22:08:00.984 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.984 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2021-09-15T22:08:00.984 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2021-09-15T22:08:00.984 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2021-09-15T22:08:00.984 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2021-09-15T22:08:00.985 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2021-09-15T22:08:00.985 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2021-09-15T22:08:00.985 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2021-09-15T22:08:00.985 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2021-09-15T22:08:00.986 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2021-09-15T22:08:00.986 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2021-09-15T22:08:00.986 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2021-09-15T22:08:00.986 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.986 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-09-15T22:08:00.987 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2021-09-15T22:08:00.987 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2021-09-15T22:08:00.987 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.987 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2021-09-15T22:08:00.987 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = False 2021-09-15T22:08:00.988 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-09-15T22:08:00.988 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:00.988 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2021-09-15T22:08:00.988 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2021-09-15T22:08:00.989 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2021-09-15T22:08:00.989 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2021-09-15T22:08:00.989 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-09-15T22:08:00.989 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-09-15T22:08:00.989 INFO:teuthology.orchestra.run.smithi184.stdout: debug rgw = 20 2021-09-15T22:08:00.990 INFO:teuthology.orchestra.run.smithi184.stdout: rgw crypt require ssl = False 2021-09-15T22:08:00.990 INFO:teuthology.orchestra.run.smithi184.stdout: rgw crypt s3 kms backend = testing 2021-09-15T22:08:00.990 INFO:teuthology.orchestra.run.smithi184.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-09-15T22:08:00.990 INFO:teuthology.orchestra.run.smithi184.stdout: rgw curl low speed time = 300 2021-09-15T22:08:00.990 INFO:teuthology.orchestra.run.smithi184.stdout: rgw data log num shards = 4 2021-09-15T22:08:00.991 INFO:teuthology.orchestra.run.smithi184.stdout: rgw md log max shards = 4 2021-09-15T22:08:00.991 INFO:teuthology.orchestra.run.smithi184.stdout: rgw sync log trim interval = 0 2021-09-15T22:08:00.991 INFO:teuthology.orchestra.run.smithi184.stdout: rgw sync obj etag verify = True 2021-09-15T22:08:00.992 INFO:teuthology.orchestra.run.smithi184.stdout: setgroup = ceph 2021-09-15T22:08:00.992 INFO:teuthology.orchestra.run.smithi184.stdout: setuser = ceph 2021-09-15T22:08:00.992 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2021-09-15T22:08:00.993 INFO:tasks.ceph:Creating admin key on c1.mon.a... 2021-09-15T22:08:00.993 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c1.keyring 2021-09-15T22:08:01.041 INFO:tasks.ceph:Copying monmap to all nodes... 2021-09-15T22:08:01.041 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:01.042 DEBUG:teuthology.orchestra.run.smithi180:> dd if=/etc/ceph/c1.keyring of=/dev/stdout 2021-09-15T22:08:01.048 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:01.049 DEBUG:teuthology.orchestra.run.smithi180:> dd if=/home/ubuntu/cephtest/c1.monmap of=/dev/stdout 2021-09-15T22:08:01.055 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi180.front.sepia.ceph.com 2021-09-15T22:08:01.055 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:01.056 DEBUG:teuthology.orchestra.run.smithi180:> sudo dd of=/etc/ceph/c1.keyring 2021-09-15T22:08:01.056 DEBUG:teuthology.orchestra.run.smithi180:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-09-15T22:08:01.081 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:01.081 DEBUG:teuthology.orchestra.run.smithi180:> dd of=/home/ubuntu/cephtest/c1.monmap 2021-09-15T22:08:01.128 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi184.front.sepia.ceph.com 2021-09-15T22:08:01.128 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:01.129 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/c1.keyring 2021-09-15T22:08:01.129 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-09-15T22:08:01.156 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:01.156 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/c1.monmap 2021-09-15T22:08:01.205 INFO:tasks.ceph:Setting up mon nodes... 2021-09-15T22:08:01.205 INFO:tasks.ceph:Setting up mgr nodes... 2021-09-15T22:08:01.205 DEBUG:teuthology.orchestra.run.smithi180:> sudo mkdir -p /var/lib/ceph/mgr/c1-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c1-x/keyring 2021-09-15T22:08:01.249 INFO:teuthology.orchestra.run.smithi180.stdout:creating /var/lib/ceph/mgr/c1-x/keyring 2021-09-15T22:08:01.251 INFO:tasks.ceph:Setting up mds nodes... 2021-09-15T22:08:01.251 INFO:tasks.ceph_client:Setting up client nodes... 2021-09-15T22:08:01.252 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c1.client.0.keyring && sudo chmod 0644 /etc/ceph/c1.client.0.keyring 2021-09-15T22:08:01.280 INFO:teuthology.orchestra.run.smithi180.stdout:creating /etc/ceph/c1.client.0.keyring 2021-09-15T22:08:01.292 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-09-15T22:08:01.293 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi180.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-09-15T22:08:01.293 DEBUG:teuthology.orchestra.run.smithi180:> sudo mkdir -p /var/lib/ceph/osd/c1-0 2021-09-15T22:08:01.350 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-09-15T22:08:01.350 INFO:tasks.ceph:role: c1.osd.0 2021-09-15T22:08:01.351 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi180.front.sepia.ceph.com 2021-09-15T22:08:01.351 DEBUG:teuthology.orchestra.run.smithi180:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-09-15T22:08:01.392 INFO:teuthology.orchestra.run.smithi180.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-09-15T22:08:01.393 INFO:teuthology.orchestra.run.smithi180.stdout: = sectsz=512 attr=2, projid32bit=1 2021-09-15T22:08:01.393 INFO:teuthology.orchestra.run.smithi180.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-09-15T22:08:01.393 INFO:teuthology.orchestra.run.smithi180.stdout: = reflink=1 2021-09-15T22:08:01.394 INFO:teuthology.orchestra.run.smithi180.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-09-15T22:08:01.394 INFO:teuthology.orchestra.run.smithi180.stdout: = sunit=0 swidth=0 blks 2021-09-15T22:08:01.394 INFO:teuthology.orchestra.run.smithi180.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-09-15T22:08:01.394 INFO:teuthology.orchestra.run.smithi180.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-09-15T22:08:01.395 INFO:teuthology.orchestra.run.smithi180.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-09-15T22:08:01.395 INFO:teuthology.orchestra.run.smithi180.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-09-15T22:08:01.396 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi180.front.sepia.ceph.com -o noatime 2021-09-15T22:08:01.396 DEBUG:teuthology.orchestra.run.smithi180:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c1-0 2021-09-15T22:08:01.415 DEBUG:teuthology.orchestra.run.smithi180:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-0 2021-09-15T22:08:01.424 INFO:teuthology.orchestra.run.smithi180.stderr:sudo: /sbin/restorecon: command not found 2021-09-15T22:08:01.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-09-15T22:08:01.425 DEBUG:teuthology.orchestra.run.smithi180:> sudo mkdir -p /var/lib/ceph/osd/c1-1 2021-09-15T22:08:01.485 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-09-15T22:08:01.486 INFO:tasks.ceph:role: c1.osd.1 2021-09-15T22:08:01.486 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi180.front.sepia.ceph.com 2021-09-15T22:08:01.486 DEBUG:teuthology.orchestra.run.smithi180:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-09-15T22:08:01.528 INFO:teuthology.orchestra.run.smithi180.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-09-15T22:08:01.528 INFO:teuthology.orchestra.run.smithi180.stdout: = sectsz=512 attr=2, projid32bit=1 2021-09-15T22:08:01.529 INFO:teuthology.orchestra.run.smithi180.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-09-15T22:08:01.529 INFO:teuthology.orchestra.run.smithi180.stdout: = reflink=1 2021-09-15T22:08:01.529 INFO:teuthology.orchestra.run.smithi180.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-09-15T22:08:01.529 INFO:teuthology.orchestra.run.smithi180.stdout: = sunit=0 swidth=0 blks 2021-09-15T22:08:01.530 INFO:teuthology.orchestra.run.smithi180.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-09-15T22:08:01.530 INFO:teuthology.orchestra.run.smithi180.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-09-15T22:08:01.530 INFO:teuthology.orchestra.run.smithi180.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-09-15T22:08:01.530 INFO:teuthology.orchestra.run.smithi180.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-09-15T22:08:01.531 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi180.front.sepia.ceph.com -o noatime 2021-09-15T22:08:01.532 DEBUG:teuthology.orchestra.run.smithi180:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c1-1 2021-09-15T22:08:01.593 DEBUG:teuthology.orchestra.run.smithi180:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-1 2021-09-15T22:08:01.605 INFO:teuthology.orchestra.run.smithi180.stderr:sudo: /sbin/restorecon: command not found 2021-09-15T22:08:01.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-09-15T22:08:01.607 DEBUG:teuthology.orchestra.run.smithi180:> sudo mkdir -p /var/lib/ceph/osd/c1-2 2021-09-15T22:08:01.617 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-09-15T22:08:01.617 INFO:tasks.ceph:role: c1.osd.2 2021-09-15T22:08:01.618 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi180.front.sepia.ceph.com 2021-09-15T22:08:01.618 DEBUG:teuthology.orchestra.run.smithi180:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-09-15T22:08:01.704 INFO:teuthology.orchestra.run.smithi180.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-09-15T22:08:01.705 INFO:teuthology.orchestra.run.smithi180.stdout: = sectsz=512 attr=2, projid32bit=1 2021-09-15T22:08:01.705 INFO:teuthology.orchestra.run.smithi180.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-09-15T22:08:01.705 INFO:teuthology.orchestra.run.smithi180.stdout: = reflink=1 2021-09-15T22:08:01.705 INFO:teuthology.orchestra.run.smithi180.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-09-15T22:08:01.705 INFO:teuthology.orchestra.run.smithi180.stdout: = sunit=0 swidth=0 blks 2021-09-15T22:08:01.706 INFO:teuthology.orchestra.run.smithi180.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-09-15T22:08:01.706 INFO:teuthology.orchestra.run.smithi180.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-09-15T22:08:01.706 INFO:teuthology.orchestra.run.smithi180.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-09-15T22:08:01.706 INFO:teuthology.orchestra.run.smithi180.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-09-15T22:08:01.708 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi180.front.sepia.ceph.com -o noatime 2021-09-15T22:08:01.708 DEBUG:teuthology.orchestra.run.smithi180:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c1-2 2021-09-15T22:08:01.726 DEBUG:teuthology.orchestra.run.smithi180:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-2 2021-09-15T22:08:01.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-09-15T22:08:01.736 INFO:teuthology.orchestra.run.smithi180.stderr:sudo: /sbin/restorecon: command not found 2021-09-15T22:08:01.737 DEBUG:teuthology.orchestra.run.smithi180:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c1.monmap 2021-09-15T22:08:01.842 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:01.839+0000 7f1da8f47d80 -1 auth: error reading file: /var/lib/ceph/osd/c1-0/keyring: can't open /var/lib/ceph/osd/c1-0/keyring: (2) No such file or directory 2021-09-15T22:08:01.842 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:01.839+0000 7f1da8f47d80 -1 created new key in keyring /var/lib/ceph/osd/c1-0/keyring 2021-09-15T22:08:01.843 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:01.839+0000 7f1da8f47d80 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-09-15T22:08:01.843 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:01.839+0000 7f1da8f47d80 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-09-15T22:08:01.843 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:01.839+0000 7f1da8f47d80 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-09-15T22:08:01.843 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:01.839+0000 7f1da8f47d80 -1 bluestore(/var/lib/ceph/osd/c1-0) _read_fsid unparsable uuid 2021-09-15T22:08:01.858 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:01.859+0000 7f1da8f47d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-09-15T22:08:03.760 DEBUG:teuthology.orchestra.run.smithi180:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-0 2021-09-15T22:08:03.778 DEBUG:teuthology.orchestra.run.smithi180:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c1.monmap 2021-09-15T22:08:03.819 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:03.819+0000 7fd52d29bd80 -1 auth: error reading file: /var/lib/ceph/osd/c1-1/keyring: can't open /var/lib/ceph/osd/c1-1/keyring: (2) No such file or directory 2021-09-15T22:08:03.819 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:03.819+0000 7fd52d29bd80 -1 created new key in keyring /var/lib/ceph/osd/c1-1/keyring 2021-09-15T22:08:03.820 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:03.819+0000 7fd52d29bd80 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-09-15T22:08:03.820 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:03.819+0000 7fd52d29bd80 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-09-15T22:08:03.820 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:03.819+0000 7fd52d29bd80 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-09-15T22:08:03.820 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:03.819+0000 7fd52d29bd80 -1 bluestore(/var/lib/ceph/osd/c1-1) _read_fsid unparsable uuid 2021-09-15T22:08:03.833 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:03.831+0000 7fd52d29bd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-09-15T22:08:05.732 DEBUG:teuthology.orchestra.run.smithi180:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-1 2021-09-15T22:08:05.788 DEBUG:teuthology.orchestra.run.smithi180:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c1.monmap 2021-09-15T22:08:05.827 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:05.827+0000 7fba67683d80 -1 auth: error reading file: /var/lib/ceph/osd/c1-2/keyring: can't open /var/lib/ceph/osd/c1-2/keyring: (2) No such file or directory 2021-09-15T22:08:05.827 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:05.827+0000 7fba67683d80 -1 created new key in keyring /var/lib/ceph/osd/c1-2/keyring 2021-09-15T22:08:05.827 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:05.827+0000 7fba67683d80 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-09-15T22:08:05.828 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:05.827+0000 7fba67683d80 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-09-15T22:08:05.828 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:05.827+0000 7fba67683d80 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-09-15T22:08:05.828 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:05.827+0000 7fba67683d80 -1 bluestore(/var/lib/ceph/osd/c1-2) _read_fsid unparsable uuid 2021-09-15T22:08:05.841 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:08:05.839+0000 7fba67683d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-09-15T22:08:07.739 DEBUG:teuthology.orchestra.run.smithi180:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-2 2021-09-15T22:08:07.756 INFO:tasks.ceph:Reading keys from all nodes... 2021-09-15T22:08:07.757 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:07.757 DEBUG:teuthology.orchestra.run.smithi180:> sudo dd if=/var/lib/ceph/mgr/c1-x/keyring of=/dev/stdout 2021-09-15T22:08:07.773 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:07.774 DEBUG:teuthology.orchestra.run.smithi180:> sudo dd if=/var/lib/ceph/osd/c1-0/keyring of=/dev/stdout 2021-09-15T22:08:07.833 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:07.833 DEBUG:teuthology.orchestra.run.smithi180:> sudo dd if=/var/lib/ceph/osd/c1-1/keyring of=/dev/stdout 2021-09-15T22:08:07.843 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:07.843 DEBUG:teuthology.orchestra.run.smithi180:> sudo dd if=/var/lib/ceph/osd/c1-2/keyring of=/dev/stdout 2021-09-15T22:08:07.858 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:07.858 DEBUG:teuthology.orchestra.run.smithi180:> dd if=/etc/ceph/c1.client.0.keyring of=/dev/stdout 2021-09-15T22:08:07.907 INFO:tasks.ceph:Adding keys to all mons... 2021-09-15T22:08:07.907 DEBUG:teuthology.orchestra.run.smithi180:> sudo tee -a /etc/ceph/c1.keyring 2021-09-15T22:08:07.918 INFO:teuthology.orchestra.run.smithi180.stdout:[mgr.x] 2021-09-15T22:08:07.919 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQDBbkJhiLH2DhAAyPdWDlRhTqkJak8wcU79Tg== 2021-09-15T22:08:07.919 INFO:teuthology.orchestra.run.smithi180.stdout:[osd.0] 2021-09-15T22:08:07.919 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQDBbkJhZfI6MhAAwpwIgRLIiFY5e/j62fjbsA== 2021-09-15T22:08:07.919 INFO:teuthology.orchestra.run.smithi180.stdout:[osd.1] 2021-09-15T22:08:07.920 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQDDbkJhslXuMBAABzTbQly1+6MlP2LslN6R4w== 2021-09-15T22:08:07.920 INFO:teuthology.orchestra.run.smithi180.stdout:[osd.2] 2021-09-15T22:08:07.920 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQDFbkJhtqhmMRAAJnlr2faWfw/zI2v+/PSksw== 2021-09-15T22:08:07.920 INFO:teuthology.orchestra.run.smithi180.stdout:[client.0] 2021-09-15T22:08:07.921 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQDBbkJh8THfEBAADdoVTJqJXc7BoJTaLOzQRQ== 2021-09-15T22:08:07.922 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-09-15T22:08:07.962 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2021-09-15T22:08:07.999 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2021-09-15T22:08:08.084 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2021-09-15T22:08:08.125 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-09-15T22:08:08.170 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-09-15T22:08:08.171 DEBUG:teuthology.orchestra.run.smithi180:> sudo mkdir -p /var/lib/ceph/mon/c1-a 2021-09-15T22:08:08.187 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c1 --mkfs -i a --monmap /home/ubuntu/cephtest/c1.monmap --keyring /etc/ceph/c1.keyring 2021-09-15T22:08:08.240 DEBUG:teuthology.orchestra.run.smithi180:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c1-a 2021-09-15T22:08:08.253 DEBUG:teuthology.orchestra.run.smithi180:> rm -- /home/ubuntu/cephtest/c1.monmap 2021-09-15T22:08:08.303 INFO:tasks.ceph:Starting mon daemons in cluster c1... 2021-09-15T22:08:08.304 INFO:tasks.ceph.c1.mon.a:Restarting daemon 2021-09-15T22:08:08.304 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c1 -i a 2021-09-15T22:08:08.307 INFO:tasks.ceph.c1.mon.a:Started 2021-09-15T22:08:08.307 INFO:tasks.ceph:Starting mgr daemons in cluster c1... 2021-09-15T22:08:08.308 INFO:tasks.ceph.c1.mgr.x:Restarting daemon 2021-09-15T22:08:08.308 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c1 -i x 2021-09-15T22:08:08.310 INFO:tasks.ceph.c1.mgr.x:Started 2021-09-15T22:08:08.311 INFO:tasks.ceph:Setting crush tunables to default 2021-09-15T22:08:08.311 DEBUG:teuthology.orchestra.run.smithi180:> sudo ceph --cluster c1 osd crush tunables default 2021-09-15T22:08:08.524 INFO:teuthology.orchestra.run.smithi180.stderr:adjusted tunables profile to default 2021-09-15T22:08:08.538 INFO:tasks.ceph:Starting osd daemons in cluster c1... 2021-09-15T22:08:08.539 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:08.539 DEBUG:teuthology.orchestra.run.smithi180:> sudo dd if=/var/lib/ceph/osd/c1-0/fsid of=/dev/stdout 2021-09-15T22:08:08.549 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:08.550 DEBUG:teuthology.orchestra.run.smithi180:> sudo dd if=/var/lib/ceph/osd/c1-1/fsid of=/dev/stdout 2021-09-15T22:08:08.562 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:08.563 DEBUG:teuthology.orchestra.run.smithi180:> sudo dd if=/var/lib/ceph/osd/c1-2/fsid of=/dev/stdout 2021-09-15T22:08:08.618 DEBUG:teuthology.orchestra.run.smithi180:> sudo ceph --cluster c1 osd new 709d1364-1d3d-48a3-bc6f-36506320aa42 0 2021-09-15T22:08:08.817 INFO:teuthology.orchestra.run.smithi180.stdout:0 2021-09-15T22:08:08.828 DEBUG:teuthology.orchestra.run.smithi180:> sudo ceph --cluster c1 osd new 59b8973e-df7b-4256-9a57-ffeaef4fd9bc 1 2021-09-15T22:08:09.010 INFO:teuthology.orchestra.run.smithi180.stdout:1 2021-09-15T22:08:09.026 DEBUG:teuthology.orchestra.run.smithi180:> sudo ceph --cluster c1 osd new cdee6104-7a2f-4ef5-b56a-e26f38d9bf1a 2 2021-09-15T22:08:09.205 INFO:teuthology.orchestra.run.smithi180.stdout:2 2021-09-15T22:08:09.217 INFO:tasks.ceph.c1.osd.0:Restarting daemon 2021-09-15T22:08:09.218 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 0 2021-09-15T22:08:09.220 INFO:tasks.ceph.c1.osd.0:Started 2021-09-15T22:08:09.220 INFO:tasks.ceph.c1.osd.1:Restarting daemon 2021-09-15T22:08:09.221 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 1 2021-09-15T22:08:09.223 INFO:tasks.ceph.c1.osd.1:Started 2021-09-15T22:08:09.223 INFO:tasks.ceph.c1.osd.2:Restarting daemon 2021-09-15T22:08:09.224 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 2 2021-09-15T22:08:09.226 INFO:tasks.ceph.c1.osd.2:Started 2021-09-15T22:08:09.226 INFO:tasks.ceph:Waiting for OSDs to come up 2021-09-15T22:08:09.529 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2021-09-15T22:08:09.588 INFO:tasks.ceph.c1.osd.0.smithi180.stderr:2021-09-15T22:08:09.587+0000 7f68eb28ed80 -1 Falling back to public interface 2021-09-15T22:08:09.684 INFO:teuthology.misc.health.smithi180.stdout: 2021-09-15T22:08:09.685 INFO:teuthology.misc.health.smithi180.stdout:{"epoch":5,"fsid":"629c67a5-227f-4042-a582-15d73b0f5e90","created":"2021-09-15T22:08:08.424233+0000","modified":"2021-09-15T22:08:09.205019+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"709d1364-1d3d-48a3-bc6f-36506320aa42","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"59b8973e-df7b-4256-9a57-ffeaef4fd9bc","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cdee6104-7a2f-4ef5-b56a-e26f38d9bf1a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-09-15T22:08:09.700 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-09-15T22:08:09.823 INFO:tasks.ceph.c1.osd.1.smithi180.stderr:2021-09-15T22:08:09.823+0000 7fb2bf366d80 -1 Falling back to public interface 2021-09-15T22:08:09.840 INFO:tasks.ceph.c1.osd.2.smithi180.stderr:2021-09-15T22:08:09.839+0000 7f38b7a05d80 -1 Falling back to public interface 2021-09-15T22:08:10.221 INFO:tasks.ceph.c1.osd.0.smithi180.stderr:2021-09-15T22:08:10.219+0000 7f68eb28ed80 -1 osd.0 0 log_to_monitors {default=true} 2021-09-15T22:08:10.481 INFO:tasks.ceph.c1.osd.1.smithi180.stderr:2021-09-15T22:08:10.479+0000 7fb2bf366d80 -1 osd.1 0 log_to_monitors {default=true} 2021-09-15T22:08:10.493 INFO:tasks.ceph.c1.osd.2.smithi180.stderr:2021-09-15T22:08:10.491+0000 7f38b7a05d80 -1 osd.2 0 log_to_monitors {default=true} 2021-09-15T22:08:11.453 INFO:tasks.ceph.c1.osd.0.smithi180.stderr:2021-09-15T22:08:11.455+0000 7f68dd348700 -1 osd.0 0 waiting for initial osdmap 2021-09-15T22:08:11.458 INFO:tasks.ceph.c1.osd.0.smithi180.stderr:2021-09-15T22:08:11.459+0000 7f68e47b1700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-09-15T22:08:12.461 INFO:tasks.ceph.c1.osd.1.smithi180.stderr:2021-09-15T22:08:12.459+0000 7fb2b1420700 -1 osd.1 0 waiting for initial osdmap 2021-09-15T22:08:12.462 INFO:tasks.ceph.c1.osd.2.smithi180.stderr:2021-09-15T22:08:12.459+0000 7f38a9abf700 -1 osd.2 0 waiting for initial osdmap 2021-09-15T22:08:12.464 INFO:tasks.ceph.c1.osd.2.smithi180.stderr:2021-09-15T22:08:12.463+0000 7f38b0f28700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-09-15T22:08:12.465 INFO:tasks.ceph.c1.osd.1.smithi180.stderr:2021-09-15T22:08:12.467+0000 7fb2b8889700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-09-15T22:08:16.004 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2021-09-15T22:08:16.245 INFO:teuthology.misc.health.smithi180.stdout: 2021-09-15T22:08:16.246 INFO:teuthology.misc.health.smithi180.stdout:{"epoch":11,"fsid":"629c67a5-227f-4042-a582-15d73b0f5e90","created":"2021-09-15T22:08:08.424233+0000","modified":"2021-09-15T22:08:15.470271+0000","last_up_change":"2021-09-15T22:08:13.455032+0000","last_in_change":"2021-09-15T22:08:13.455032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-09-15T22:08:11.329637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"709d1364-1d3d-48a3-bc6f-36506320aa42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":8,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6800","nonce":12115},{"type":"v1","addr":"172.21.15.180:6801","nonce":12115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6802","nonce":12115},{"type":"v1","addr":"172.21.15.180:6803","nonce":12115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6806","nonce":12115},{"type":"v1","addr":"172.21.15.180:6807","nonce":12115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6804","nonce":12115},{"type":"v1","addr":"172.21.15.180:6805","nonce":12115}]},"public_addr":"172.21.15.180:6801/12115","cluster_addr":"172.21.15.180:6803/12115","heartbeat_back_addr":"172.21.15.180:6807/12115","heartbeat_front_addr":"172.21.15.180:6805/12115","state":["exists","up"]},{"osd":1,"uuid":"59b8973e-df7b-4256-9a57-ffeaef4fd9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6808","nonce":12116},{"type":"v1","addr":"172.21.15.180:6809","nonce":12116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6810","nonce":12116},{"type":"v1","addr":"172.21.15.180:6811","nonce":12116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6814","nonce":12116},{"type":"v1","addr":"172.21.15.180:6815","nonce":12116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6812","nonce":12116},{"type":"v1","addr":"172.21.15.180:6813","nonce":12116}]},"public_addr":"172.21.15.180:6809/12116","cluster_addr":"172.21.15.180:6811/12116","heartbeat_back_addr":"172.21.15.180:6815/12116","heartbeat_front_addr":"172.21.15.180:6813/12116","state":["exists","up"]},{"osd":2,"uuid":"cdee6104-7a2f-4ef5-b56a-e26f38d9bf1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6816","nonce":12117},{"type":"v1","addr":"172.21.15.180:6817","nonce":12117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6818","nonce":12117},{"type":"v1","addr":"172.21.15.180:6819","nonce":12117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6822","nonce":12117},{"type":"v1","addr":"172.21.15.180:6823","nonce":12117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6820","nonce":12117},{"type":"v1","addr":"172.21.15.180:6821","nonce":12117}]},"public_addr":"172.21.15.180:6817/12117","cluster_addr":"172.21.15.180:6819/12117","heartbeat_back_addr":"172.21.15.180:6823/12117","heartbeat_front_addr":"172.21.15.180:6821/12117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:11.216708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:11.443630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:11.523055+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-09-15T22:08:16.256 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-09-15T22:08:16.257 INFO:tasks.ceph:Creating RBD pool 2021-09-15T22:08:16.257 DEBUG:teuthology.orchestra.run.smithi180:> sudo ceph --cluster c1 osd pool create rbd 8 2021-09-15T22:08:17.492 INFO:teuthology.orchestra.run.smithi180.stderr:pool 'rbd' created 2021-09-15T22:08:17.504 DEBUG:teuthology.orchestra.run.smithi180:> sudo ceph --cluster c1 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-09-15T22:08:18.502 INFO:teuthology.orchestra.run.smithi180.stderr:enabled application 'rbd' on pool 'rbd' 2021-09-15T22:08:18.512 INFO:tasks.ceph:Starting mds daemons in cluster c1... 2021-09-15T22:08:18.513 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2021-09-15T22:08:18.513 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-09-15T22:08:18.753 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:18.754 INFO:teuthology.orchestra.run.smithi180.stdout:{"epoch":13,"fsid":"629c67a5-227f-4042-a582-15d73b0f5e90","created":"2021-09-15T22:08:08.424233+0000","modified":"2021-09-15T22:08:18.484903+0000","last_up_change":"2021-09-15T22:08:13.455032+0000","last_in_change":"2021-09-15T22:08:13.455032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-09-15T22:08:11.329637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-09-15T22:08:16.564526+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"709d1364-1d3d-48a3-bc6f-36506320aa42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6800","nonce":12115},{"type":"v1","addr":"172.21.15.180:6801","nonce":12115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6802","nonce":12115},{"type":"v1","addr":"172.21.15.180:6803","nonce":12115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6806","nonce":12115},{"type":"v1","addr":"172.21.15.180:6807","nonce":12115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6804","nonce":12115},{"type":"v1","addr":"172.21.15.180:6805","nonce":12115}]},"public_addr":"172.21.15.180:6801/12115","cluster_addr":"172.21.15.180:6803/12115","heartbeat_back_addr":"172.21.15.180:6807/12115","heartbeat_front_addr":"172.21.15.180:6805/12115","state":["exists","up"]},{"osd":1,"uuid":"59b8973e-df7b-4256-9a57-ffeaef4fd9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6808","nonce":12116},{"type":"v1","addr":"172.21.15.180:6809","nonce":12116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6810","nonce":12116},{"type":"v1","addr":"172.21.15.180:6811","nonce":12116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6814","nonce":12116},{"type":"v1","addr":"172.21.15.180:6815","nonce":12116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6812","nonce":12116},{"type":"v1","addr":"172.21.15.180:6813","nonce":12116}]},"public_addr":"172.21.15.180:6809/12116","cluster_addr":"172.21.15.180:6811/12116","heartbeat_back_addr":"172.21.15.180:6815/12116","heartbeat_front_addr":"172.21.15.180:6813/12116","state":["exists","up"]},{"osd":2,"uuid":"cdee6104-7a2f-4ef5-b56a-e26f38d9bf1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6816","nonce":12117},{"type":"v1","addr":"172.21.15.180:6817","nonce":12117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6818","nonce":12117},{"type":"v1","addr":"172.21.15.180:6819","nonce":12117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6822","nonce":12117},{"type":"v1","addr":"172.21.15.180:6823","nonce":12117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6820","nonce":12117},{"type":"v1","addr":"172.21.15.180:6821","nonce":12117}]},"public_addr":"172.21.15.180:6817/12117","cluster_addr":"172.21.15.180:6819/12117","heartbeat_back_addr":"172.21.15.180:6823/12117","heartbeat_front_addr":"172.21.15.180:6821/12117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:11.216708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:11.443630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:11.523055+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-09-15T22:08:18.766 INFO:tasks.ceph.ceph_manager.c1:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-09-15T22:08:11.329637+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-09-15T22:08:16.564526+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-09-15T22:08:18.767 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd pool get device_health_metrics pg_num 2021-09-15T22:08:19.023 INFO:teuthology.orchestra.run.smithi180.stdout:pg_num: 1 2021-09-15T22:08:19.036 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd pool get rbd pg_num 2021-09-15T22:08:19.285 INFO:teuthology.orchestra.run.smithi180.stdout:pg_num: 8 2021-09-15T22:08:19.298 INFO:tasks.ceph:Waiting until c1 daemons up and pgs clean... 2021-09-15T22:08:19.298 INFO:tasks.ceph.ceph_manager.c1:waiting for mgr available 2021-09-15T22:08:19.299 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 mgr dump --format=json 2021-09-15T22:08:19.573 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:19.584 INFO:teuthology.orchestra.run.smithi180.stdout:{"epoch":4,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6824","nonce":11929},{"type":"v1","addr":"172.21.15.180:6825","nonce":11929}]},"active_addr":"172.21.15.180:6825/11929","active_change":"2021-09-15T22:08:11.249781+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.180:0","nonce":3393163518}]},{"addrvec":[{"type":"v2","addr":"172.21.15.180:0","nonce":3313577270}]},{"addrvec":[{"type":"v2","addr":"172.21.15.180:0","nonce":3073478795}]}]}} 2021-09-15T22:08:19.590 INFO:tasks.ceph.ceph_manager.c1:mgr available! 2021-09-15T22:08:19.590 INFO:tasks.ceph.ceph_manager.c1:waiting for all up 2021-09-15T22:08:19.590 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2021-09-15T22:08:19.829 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:19.829 INFO:teuthology.orchestra.run.smithi180.stdout:{"epoch":14,"fsid":"629c67a5-227f-4042-a582-15d73b0f5e90","created":"2021-09-15T22:08:08.424233+0000","modified":"2021-09-15T22:08:19.490641+0000","last_up_change":"2021-09-15T22:08:13.455032+0000","last_in_change":"2021-09-15T22:08:13.455032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-09-15T22:08:11.329637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-09-15T22:08:16.564526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"709d1364-1d3d-48a3-bc6f-36506320aa42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6800","nonce":12115},{"type":"v1","addr":"172.21.15.180:6801","nonce":12115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6802","nonce":12115},{"type":"v1","addr":"172.21.15.180:6803","nonce":12115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6806","nonce":12115},{"type":"v1","addr":"172.21.15.180:6807","nonce":12115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6804","nonce":12115},{"type":"v1","addr":"172.21.15.180:6805","nonce":12115}]},"public_addr":"172.21.15.180:6801/12115","cluster_addr":"172.21.15.180:6803/12115","heartbeat_back_addr":"172.21.15.180:6807/12115","heartbeat_front_addr":"172.21.15.180:6805/12115","state":["exists","up"]},{"osd":1,"uuid":"59b8973e-df7b-4256-9a57-ffeaef4fd9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6808","nonce":12116},{"type":"v1","addr":"172.21.15.180:6809","nonce":12116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6810","nonce":12116},{"type":"v1","addr":"172.21.15.180:6811","nonce":12116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6814","nonce":12116},{"type":"v1","addr":"172.21.15.180:6815","nonce":12116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6812","nonce":12116},{"type":"v1","addr":"172.21.15.180:6813","nonce":12116}]},"public_addr":"172.21.15.180:6809/12116","cluster_addr":"172.21.15.180:6811/12116","heartbeat_back_addr":"172.21.15.180:6815/12116","heartbeat_front_addr":"172.21.15.180:6813/12116","state":["exists","up"]},{"osd":2,"uuid":"cdee6104-7a2f-4ef5-b56a-e26f38d9bf1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6816","nonce":12117},{"type":"v1","addr":"172.21.15.180:6817","nonce":12117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6818","nonce":12117},{"type":"v1","addr":"172.21.15.180:6819","nonce":12117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6822","nonce":12117},{"type":"v1","addr":"172.21.15.180:6823","nonce":12117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6820","nonce":12117},{"type":"v1","addr":"172.21.15.180:6821","nonce":12117}]},"public_addr":"172.21.15.180:6817/12117","cluster_addr":"172.21.15.180:6819/12117","heartbeat_back_addr":"172.21.15.180:6823/12117","heartbeat_front_addr":"172.21.15.180:6821/12117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:11.216708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:11.443630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:11.523055+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-09-15T22:08:19.842 INFO:tasks.ceph.ceph_manager.c1:all up! 2021-09-15T22:08:19.843 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2021-09-15T22:08:20.090 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:20.090 INFO:teuthology.orchestra.run.smithi180.stdout:{"epoch":14,"fsid":"629c67a5-227f-4042-a582-15d73b0f5e90","created":"2021-09-15T22:08:08.424233+0000","modified":"2021-09-15T22:08:19.490641+0000","last_up_change":"2021-09-15T22:08:13.455032+0000","last_in_change":"2021-09-15T22:08:13.455032+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-09-15T22:08:11.329637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-09-15T22:08:16.564526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"709d1364-1d3d-48a3-bc6f-36506320aa42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6800","nonce":12115},{"type":"v1","addr":"172.21.15.180:6801","nonce":12115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6802","nonce":12115},{"type":"v1","addr":"172.21.15.180:6803","nonce":12115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6806","nonce":12115},{"type":"v1","addr":"172.21.15.180:6807","nonce":12115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6804","nonce":12115},{"type":"v1","addr":"172.21.15.180:6805","nonce":12115}]},"public_addr":"172.21.15.180:6801/12115","cluster_addr":"172.21.15.180:6803/12115","heartbeat_back_addr":"172.21.15.180:6807/12115","heartbeat_front_addr":"172.21.15.180:6805/12115","state":["exists","up"]},{"osd":1,"uuid":"59b8973e-df7b-4256-9a57-ffeaef4fd9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6808","nonce":12116},{"type":"v1","addr":"172.21.15.180:6809","nonce":12116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6810","nonce":12116},{"type":"v1","addr":"172.21.15.180:6811","nonce":12116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6814","nonce":12116},{"type":"v1","addr":"172.21.15.180:6815","nonce":12116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6812","nonce":12116},{"type":"v1","addr":"172.21.15.180:6813","nonce":12116}]},"public_addr":"172.21.15.180:6809/12116","cluster_addr":"172.21.15.180:6811/12116","heartbeat_back_addr":"172.21.15.180:6815/12116","heartbeat_front_addr":"172.21.15.180:6813/12116","state":["exists","up"]},{"osd":2,"uuid":"cdee6104-7a2f-4ef5-b56a-e26f38d9bf1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6816","nonce":12117},{"type":"v1","addr":"172.21.15.180:6817","nonce":12117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6818","nonce":12117},{"type":"v1","addr":"172.21.15.180:6819","nonce":12117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6822","nonce":12117},{"type":"v1","addr":"172.21.15.180:6823","nonce":12117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6820","nonce":12117},{"type":"v1","addr":"172.21.15.180:6821","nonce":12117}]},"public_addr":"172.21.15.180:6817/12117","cluster_addr":"172.21.15.180:6819/12117","heartbeat_back_addr":"172.21.15.180:6823/12117","heartbeat_front_addr":"172.21.15.180:6821/12117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:11.216708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:11.443630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:11.523055+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-09-15T22:08:20.103 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.0 flush_pg_stats 2021-09-15T22:08:20.248 INFO:teuthology.orchestra.run.smithi180.stdout:34359738371 2021-09-15T22:08:20.249 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.1 flush_pg_stats 2021-09-15T22:08:20.400 INFO:teuthology.orchestra.run.smithi180.stdout:38654705668 2021-09-15T22:08:20.401 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.2 flush_pg_stats 2021-09-15T22:08:20.548 INFO:teuthology.orchestra.run.smithi180.stdout:38654705667 2021-09-15T22:08:20.549 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2021-09-15T22:08:20.796 INFO:teuthology.orchestra.run.smithi180.stdout:34359738370 2021-09-15T22:08:20.809 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738371 got 34359738370 for osd.0 2021-09-15T22:08:21.810 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2021-09-15T22:08:22.063 INFO:teuthology.orchestra.run.smithi180.stdout:34359738371 2021-09-15T22:08:22.076 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738371 got 34359738371 for osd.0 2021-09-15T22:08:22.076 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.1 2021-09-15T22:08:22.320 INFO:teuthology.orchestra.run.smithi180.stdout:38654705668 2021-09-15T22:08:22.331 INFO:tasks.ceph.ceph_manager.c1:need seq 38654705668 got 38654705668 for osd.1 2021-09-15T22:08:22.332 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.2 2021-09-15T22:08:22.568 INFO:teuthology.orchestra.run.smithi180.stdout:38654705667 2021-09-15T22:08:22.581 INFO:tasks.ceph.ceph_manager.c1:need seq 38654705667 got 38654705667 for osd.2 2021-09-15T22:08:22.581 INFO:tasks.ceph.ceph_manager.c1:waiting for clean 2021-09-15T22:08:22.582 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2021-09-15T22:08:22.821 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:22.823 INFO:teuthology.orchestra.run.smithi180.stderr:dumped all 2021-09-15T22:08:22.833 INFO:teuthology.orchestra.run.smithi180.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2021-09-15T22:08:21.259909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146104,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426696,"statfs":{"total":322122547200,"available":318900936704,"internally_reserved":3221225472,"allocated":360448,"data_stored":102738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.768985"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.504662+0000","last_change":"2021-09-15T22:08:18.503718+0000","last_active":"2021-09-15T22:08:18.504662+0000","last_peered":"2021-09-15T22:08:18.504662+0000","last_clean":"2021-09-15T22:08:18.504662+0000","last_became_active":"2021-09-15T22:08:18.502780+0000","last_became_peered":"2021-09-15T22:08:18.502780+0000","last_unstale":"2021-09-15T22:08:18.504662+0000","last_undegraded":"2021-09-15T22:08:18.504662+0000","last_fullsized":"2021-09-15T22:08:18.504662+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_clean_scrub_stamp":"2021-09-15T22:08:17.478310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.504653+0000","last_change":"2021-09-15T22:08:18.503674+0000","last_active":"2021-09-15T22:08:18.504653+0000","last_peered":"2021-09-15T22:08:18.504653+0000","last_clean":"2021-09-15T22:08:18.504653+0000","last_became_active":"2021-09-15T22:08:18.503249+0000","last_became_peered":"2021-09-15T22:08:18.503249+0000","last_unstale":"2021-09-15T22:08:18.504653+0000","last_undegraded":"2021-09-15T22:08:18.504653+0000","last_fullsized":"2021-09-15T22:08:18.504653+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_clean_scrub_stamp":"2021-09-15T22:08:17.478310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.502551+0000","last_change":"2021-09-15T22:08:18.501524+0000","last_active":"2021-09-15T22:08:18.502551+0000","last_peered":"2021-09-15T22:08:18.502551+0000","last_clean":"2021-09-15T22:08:18.502551+0000","last_became_active":"2021-09-15T22:08:18.500967+0000","last_became_peered":"2021-09-15T22:08:18.500967+0000","last_unstale":"2021-09-15T22:08:18.502551+0000","last_undegraded":"2021-09-15T22:08:18.502551+0000","last_fullsized":"2021-09-15T22:08:18.502551+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_clean_scrub_stamp":"2021-09-15T22:08:17.478310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.504612+0000","last_change":"2021-09-15T22:08:18.503467+0000","last_active":"2021-09-15T22:08:18.504612+0000","last_peered":"2021-09-15T22:08:18.504612+0000","last_clean":"2021-09-15T22:08:18.504612+0000","last_became_active":"2021-09-15T22:08:18.503079+0000","last_became_peered":"2021-09-15T22:08:18.503079+0000","last_unstale":"2021-09-15T22:08:18.504612+0000","last_undegraded":"2021-09-15T22:08:18.504612+0000","last_fullsized":"2021-09-15T22:08:18.504612+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_clean_scrub_stamp":"2021-09-15T22:08:17.478310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.504243+0000","last_change":"2021-09-15T22:08:18.503673+0000","last_active":"2021-09-15T22:08:18.504243+0000","last_peered":"2021-09-15T22:08:18.504243+0000","last_clean":"2021-09-15T22:08:18.504243+0000","last_became_active":"2021-09-15T22:08:18.503162+0000","last_became_peered":"2021-09-15T22:08:18.503162+0000","last_unstale":"2021-09-15T22:08:18.504243+0000","last_undegraded":"2021-09-15T22:08:18.504243+0000","last_fullsized":"2021-09-15T22:08:18.504243+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_clean_scrub_stamp":"2021-09-15T22:08:17.478310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.504100+0000","last_change":"2021-09-15T22:08:18.503460+0000","last_active":"2021-09-15T22:08:18.504100+0000","last_peered":"2021-09-15T22:08:18.504100+0000","last_clean":"2021-09-15T22:08:18.504100+0000","last_became_active":"2021-09-15T22:08:18.503058+0000","last_became_peered":"2021-09-15T22:08:18.503058+0000","last_unstale":"2021-09-15T22:08:18.504100+0000","last_undegraded":"2021-09-15T22:08:18.504100+0000","last_fullsized":"2021-09-15T22:08:18.504100+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_clean_scrub_stamp":"2021-09-15T22:08:17.478310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.504341+0000","last_change":"2021-09-15T22:08:18.503521+0000","last_active":"2021-09-15T22:08:18.504341+0000","last_peered":"2021-09-15T22:08:18.504341+0000","last_clean":"2021-09-15T22:08:18.504341+0000","last_became_active":"2021-09-15T22:08:18.503127+0000","last_became_peered":"2021-09-15T22:08:18.503127+0000","last_unstale":"2021-09-15T22:08:18.504341+0000","last_undegraded":"2021-09-15T22:08:18.504341+0000","last_fullsized":"2021-09-15T22:08:18.504341+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_clean_scrub_stamp":"2021-09-15T22:08:17.478310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.502486+0000","last_change":"2021-09-15T22:08:18.501438+0000","last_active":"2021-09-15T22:08:18.502486+0000","last_peered":"2021-09-15T22:08:18.502486+0000","last_clean":"2021-09-15T22:08:18.502486+0000","last_became_active":"2021-09-15T22:08:18.500420+0000","last_became_peered":"2021-09-15T22:08:18.500420+0000","last_unstale":"2021-09-15T22:08:18.502486+0000","last_undegraded":"2021-09-15T22:08:18.502486+0000","last_fullsized":"2021-09-15T22:08:18.502486+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_clean_scrub_stamp":"2021-09-15T22:08:17.478310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":13,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.492762+0000","last_change":"2021-09-15T22:08:14.478489+0000","last_active":"2021-09-15T22:08:18.492762+0000","last_peered":"2021-09-15T22:08:18.492762+0000","last_clean":"2021-09-15T22:08:18.492762+0000","last_became_active":"2021-09-15T22:08:14.477200+0000","last_became_peered":"2021-09-15T22:08:14.477200+0000","last_unstale":"2021-09-15T22:08:18.492762+0000","last_undegraded":"2021-09-15T22:08:18.492762+0000","last_fullsized":"2021-09-15T22:08:18.492762+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:11.440339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:11.440339+0000","last_clean_scrub_stamp":"2021-09-15T22:08:11.440339+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048704,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808896,"statfs":{"total":107374182400,"available":106300309504,"internally_reserved":1073741824,"allocated":122880,"data_stored":35406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048704,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808896,"statfs":{"total":107374182400,"available":106300309504,"internally_reserved":1073741824,"allocated":122880,"data_stored":35406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":31926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]}]}]}} 2021-09-15T22:08:22.835 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2021-09-15T22:08:23.073 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.076 INFO:teuthology.orchestra.run.smithi180.stderr:dumped all 2021-09-15T22:08:23.085 INFO:teuthology.orchestra.run.smithi180.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2021-09-15T22:08:21.259909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146104,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426696,"statfs":{"total":322122547200,"available":318900936704,"internally_reserved":3221225472,"allocated":360448,"data_stored":102738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.768985"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.504662+0000","last_change":"2021-09-15T22:08:18.503718+0000","last_active":"2021-09-15T22:08:18.504662+0000","last_peered":"2021-09-15T22:08:18.504662+0000","last_clean":"2021-09-15T22:08:18.504662+0000","last_became_active":"2021-09-15T22:08:18.502780+0000","last_became_peered":"2021-09-15T22:08:18.502780+0000","last_unstale":"2021-09-15T22:08:18.504662+0000","last_undegraded":"2021-09-15T22:08:18.504662+0000","last_fullsized":"2021-09-15T22:08:18.504662+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_clean_scrub_stamp":"2021-09-15T22:08:17.478310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.504653+0000","last_change":"2021-09-15T22:08:18.503674+0000","last_active":"2021-09-15T22:08:18.504653+0000","last_peered":"2021-09-15T22:08:18.504653+0000","last_clean":"2021-09-15T22:08:18.504653+0000","last_became_active":"2021-09-15T22:08:18.503249+0000","last_became_peered":"2021-09-15T22:08:18.503249+0000","last_unstale":"2021-09-15T22:08:18.504653+0000","last_undegraded":"2021-09-15T22:08:18.504653+0000","last_fullsized":"2021-09-15T22:08:18.504653+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_clean_scrub_stamp":"2021-09-15T22:08:17.478310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.502551+0000","last_change":"2021-09-15T22:08:18.501524+0000","last_active":"2021-09-15T22:08:18.502551+0000","last_peered":"2021-09-15T22:08:18.502551+0000","last_clean":"2021-09-15T22:08:18.502551+0000","last_became_active":"2021-09-15T22:08:18.500967+0000","last_became_peered":"2021-09-15T22:08:18.500967+0000","last_unstale":"2021-09-15T22:08:18.502551+0000","last_undegraded":"2021-09-15T22:08:18.502551+0000","last_fullsized":"2021-09-15T22:08:18.502551+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_clean_scrub_stamp":"2021-09-15T22:08:17.478310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.504612+0000","last_change":"2021-09-15T22:08:18.503467+0000","last_active":"2021-09-15T22:08:18.504612+0000","last_peered":"2021-09-15T22:08:18.504612+0000","last_clean":"2021-09-15T22:08:18.504612+0000","last_became_active":"2021-09-15T22:08:18.503079+0000","last_became_peered":"2021-09-15T22:08:18.503079+0000","last_unstale":"2021-09-15T22:08:18.504612+0000","last_undegraded":"2021-09-15T22:08:18.504612+0000","last_fullsized":"2021-09-15T22:08:18.504612+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_clean_scrub_stamp":"2021-09-15T22:08:17.478310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.504243+0000","last_change":"2021-09-15T22:08:18.503673+0000","last_active":"2021-09-15T22:08:18.504243+0000","last_peered":"2021-09-15T22:08:18.504243+0000","last_clean":"2021-09-15T22:08:18.504243+0000","last_became_active":"2021-09-15T22:08:18.503162+0000","last_became_peered":"2021-09-15T22:08:18.503162+0000","last_unstale":"2021-09-15T22:08:18.504243+0000","last_undegraded":"2021-09-15T22:08:18.504243+0000","last_fullsized":"2021-09-15T22:08:18.504243+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_clean_scrub_stamp":"2021-09-15T22:08:17.478310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.504100+0000","last_change":"2021-09-15T22:08:18.503460+0000","last_active":"2021-09-15T22:08:18.504100+0000","last_peered":"2021-09-15T22:08:18.504100+0000","last_clean":"2021-09-15T22:08:18.504100+0000","last_became_active":"2021-09-15T22:08:18.503058+0000","last_became_peered":"2021-09-15T22:08:18.503058+0000","last_unstale":"2021-09-15T22:08:18.504100+0000","last_undegraded":"2021-09-15T22:08:18.504100+0000","last_fullsized":"2021-09-15T22:08:18.504100+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_clean_scrub_stamp":"2021-09-15T22:08:17.478310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.504341+0000","last_change":"2021-09-15T22:08:18.503521+0000","last_active":"2021-09-15T22:08:18.504341+0000","last_peered":"2021-09-15T22:08:18.504341+0000","last_clean":"2021-09-15T22:08:18.504341+0000","last_became_active":"2021-09-15T22:08:18.503127+0000","last_became_peered":"2021-09-15T22:08:18.503127+0000","last_unstale":"2021-09-15T22:08:18.504341+0000","last_undegraded":"2021-09-15T22:08:18.504341+0000","last_fullsized":"2021-09-15T22:08:18.504341+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_clean_scrub_stamp":"2021-09-15T22:08:17.478310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.502486+0000","last_change":"2021-09-15T22:08:18.501438+0000","last_active":"2021-09-15T22:08:18.502486+0000","last_peered":"2021-09-15T22:08:18.502486+0000","last_clean":"2021-09-15T22:08:18.502486+0000","last_became_active":"2021-09-15T22:08:18.500420+0000","last_became_peered":"2021-09-15T22:08:18.500420+0000","last_unstale":"2021-09-15T22:08:18.502486+0000","last_undegraded":"2021-09-15T22:08:18.502486+0000","last_fullsized":"2021-09-15T22:08:18.502486+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:17.478310+0000","last_clean_scrub_stamp":"2021-09-15T22:08:17.478310+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":13,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-09-15T22:08:18.492762+0000","last_change":"2021-09-15T22:08:14.478489+0000","last_active":"2021-09-15T22:08:18.492762+0000","last_peered":"2021-09-15T22:08:18.492762+0000","last_clean":"2021-09-15T22:08:18.492762+0000","last_became_active":"2021-09-15T22:08:14.477200+0000","last_became_peered":"2021-09-15T22:08:14.477200+0000","last_unstale":"2021-09-15T22:08:18.492762+0000","last_undegraded":"2021-09-15T22:08:18.492762+0000","last_fullsized":"2021-09-15T22:08:18.492762+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:11.440339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:11.440339+0000","last_clean_scrub_stamp":"2021-09-15T22:08:11.440339+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048704,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808896,"statfs":{"total":107374182400,"available":106300309504,"internally_reserved":1073741824,"allocated":122880,"data_stored":35406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048704,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808896,"statfs":{"total":107374182400,"available":106300309504,"internally_reserved":1073741824,"allocated":122880,"data_stored":35406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":31926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]}]}]}} 2021-09-15T22:08:23.086 INFO:tasks.ceph.ceph_manager.c1:clean! 2021-09-15T22:08:23.086 INFO:tasks.ceph:Waiting until ceph cluster c1 is healthy... 2021-09-15T22:08:23.086 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy 2021-09-15T22:08:23.087 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 health --format=json 2021-09-15T22:08:23.366 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.380 INFO:teuthology.orchestra.run.smithi180.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-09-15T22:08:23.380 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy done 2021-09-15T22:08:23.381 INFO:teuthology.run_tasks:Running task ceph... 2021-09-15T22:08:23.395 INFO:tasks.ceph:Creating ceph cluster c2... 2021-09-15T22:08:23.395 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'cpu_profile': set(), 'cluster': 'c2', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-09-15T22:08:23.396 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2021-09-15_21:37:43-upgrade:octopus-x-master-distro-basic-smithi/6391763', 'branch': 'master', 'description': 'upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '6391763', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2021-09-15_21:37:43-upgrade:octopus-x-master-distro-basic-smithi', 'nuke-on-error': True, 'overrides': {'admin_socket': {'branch': 'master'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b70647e8796c78a4f551a1edd9ebceb06255dced', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'branch': 'octopus', 'sha1': 'b70647e8796c78a4f551a1edd9ebceb06255dced'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}, {'endpoints': ['c2.client.1'], 'is_pubsub': True, 'name': 'test-zone3'}]}]}, 'rgw-multisite-tests': {'args': ['tests.py', 'tests_ps.py'], 'branch': 'octopus', 'repo': 'https://github.com/ceph/ceph.git'}, 'workunit': {'branch': 'master', 'sha1': 'b70647e8796c78a4f551a1edd9ebceb06255dced'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 70, 'repo': 'git://git.ceph.com/ceph.git', 'roles': [['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'], ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']], 'sha1': 'b70647e8796c78a4f551a1edd9ebceb06255dced', 'sleep_before_teardown': 0, 'suite': 'upgrade:octopus-x', 'suite_branch': 'master', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b70647e8796c78a4f551a1edd9ebceb06255dced/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph.git', 'suite_sha1': 'b70647e8796c78a4f551a1edd9ebceb06255dced', 'targets': {'smithi180.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWPvLgA4ep3bwkX4Qg0xlvLShAXjOjtFjDSW1pdclYZl20cXcJyjXEi+aA66hlscTJ2c5zUtPvN+ipMQ8KkCDwr4LGOrMW8OQArlErgF26hq8FKeCEIX6UjbSpiYs+7vG9hrNJY3b7Hf1KTVFXWOkwH6iqVPIWy8mcUmOzMLUqNOfniKWa4qGVGx0KplrOwdAg2Hw6O5tV0+j6aFMmKDb6ozo8bwMzVlk0lD97K1eaPR2RPzyeVN6G9nxKHTU7ka6IDTWaSU5ncTTV4l4n2sjoDeDjJYc39YrrXh/hSAbxC365XgeSLa9Mre/fE+m75pnVIWMbYAmVElUMoYOo+8xt0u5RIO4XdDBVGTdCp4PkBWONNSAD4t+//avEM02xuaTDlbhUSeGKNkAg1t1m8XsbHG5JDd9fX/e3rzbhUIsFWhJe2BNuhm60fdOxjaVxQ8PfgncmNyu2zN8tYrxYLPvwmv6YVbY1B+C59q6+GMlp6X1iV45QMuZ4ms9HZTCyQ2s=', 'smithi184.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMTAxZZG2AEqYXX4LK0VKCAcmcB8fDDlh6kP/ibDpbWHdKaOnqZXkBYEQr9z5JmYb+FhrarWD6jxmQfFgHNu4OQkpGHRls1t/0CZ8VkskjU7BsgycggFMxNUjfci3ebGZ/sCZryWGkN/PvXzoprwXHqksTdMbDZGKXbM7QeA6AQZNPsE81stH6Q0++LKJOGy5Tg53E6yPyhUjJVinqczET1EAlDUSxnFEDyJUm2/MOor5bQucEt+mdKgSShWU9fhn6FN9blcur1qZMsxthr1THTBCLZyFEaREMDpc1Wvjudor/hJNLGnqxYAsS+0Y+zN50GfzqO0N5aur7sTwVreX5dFdzty15yxPJdBCvBB6w3cm6jWyKbgIb3AfTaS8OHsMlmXcG8FDpV/Xez+x+atWH8Tt3hvX3DgrptKYM/HsccrDET76txc/j0Fk2/GKEb5xWmB2knyGQZUON798zLSJeZe10rskQjoRwk2nOr3Idj4fDX26sn3GgQ/VX+tqttn8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b70647e8796c78a4f551a1edd9ebceb06255dced', 'wait-for-scrub': False}}, {'ceph': {'cluster': 'c2', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b70647e8796c78a4f551a1edd9ebceb06255dced', 'wait-for-scrub': False}}, {'parallel': ['upgrade-task']}, {'rgw': {'c1.client.0': {'port': 8000}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 60}}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'b135a4f82b02b966053efba0501e6a47c9d2d793', 'timestamp': '2021-09-15_21:37:43', 'tube': 'smithi', 'upgrade-task': [{'install.upgrade': {'c2.client.0': None, 'c2.client.1': None, 'c2.mgr.x': None, 'c2.mon.a': None, 'c2.osd.0': None, 'c2.osd.1': None, 'c2.osd.2': None}}], 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.30581'} 2021-09-15T22:08:23.397 DEBUG:teuthology.orchestra.run.smithi180:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2021-09-15T22:08:23.399 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2021-09-15T22:08:23.407 DEBUG:teuthology.orchestra.run.smithi180:> sudo install -d -m0777 -- /var/run/ceph 2021-09-15T22:08:23.409 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/run/ceph 2021-09-15T22:08:23.424 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:23.425 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2021-09-15T22:08:23.473 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-09-15T22:08:23.474 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-09-15T22:08:23.481 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-09-15T22:08:23.481 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-09-15T22:08:23.481 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 348 Links: 1 2021-09-15T22:08:23.482 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-09-15T22:08:23.482 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2021-09-15 22:05:23.380005989 +0000 2021-09-15T22:08:23.482 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2021-09-15 22:05:23.228005984 +0000 2021-09-15T22:08:23.483 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2021-09-15 22:05:23.228005984 +0000 2021-09-15T22:08:23.483 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2021-09-15T22:08:23.491 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2021-09-15T22:08:23.492 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2021-09-15T22:08:23.492 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.00039948 s, 1.3 MB/s 2021-09-15T22:08:23.497 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-09-15T22:08:23.502 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-09-15T22:08:23.502 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-09-15T22:08:23.503 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 355 Links: 1 2021-09-15T22:08:23.503 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-09-15T22:08:23.503 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2021-09-15 22:05:23.776006002 +0000 2021-09-15T22:08:23.503 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2021-09-15 22:05:23.628005997 +0000 2021-09-15T22:08:23.504 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2021-09-15 22:05:23.628005997 +0000 2021-09-15T22:08:23.504 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2021-09-15T22:08:23.512 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2021-09-15T22:08:23.513 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2021-09-15T22:08:23.513 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.00036947 s, 1.4 MB/s 2021-09-15T22:08:23.517 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-09-15T22:08:23.523 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-09-15T22:08:23.524 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-09-15T22:08:23.524 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-09-15T22:08:23.524 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-09-15T22:08:23.524 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2021-09-15 22:05:23.996006009 +0000 2021-09-15T22:08:23.524 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2021-09-15 22:05:23.992006009 +0000 2021-09-15T22:08:23.525 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2021-09-15 22:05:23.992006009 +0000 2021-09-15T22:08:23.525 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2021-09-15T22:08:23.538 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2021-09-15T22:08:23.539 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2021-09-15T22:08:23.539 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000327547 s, 1.6 MB/s 2021-09-15T22:08:23.540 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-09-15T22:08:23.590 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-09-15T22:08:23.590 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-09-15T22:08:23.590 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 366 Links: 1 2021-09-15T22:08:23.591 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-09-15T22:08:23.591 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2021-09-15 22:05:24.412006023 +0000 2021-09-15T22:08:23.591 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2021-09-15 22:05:24.408006022 +0000 2021-09-15T22:08:23.592 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2021-09-15 22:05:24.408006022 +0000 2021-09-15T22:08:23.592 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2021-09-15T22:08:23.600 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2021-09-15T22:08:23.600 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2021-09-15T22:08:23.601 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000407624 s, 1.3 MB/s 2021-09-15T22:08:23.605 INFO:tasks.ceph:osd dev map: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-09-15T22:08:23.605 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-09-15T22:08:23.605 INFO:tasks.ceph:Generating config... 2021-09-15T22:08:23.607 INFO:tasks.ceph:[client] debug rgw = 20 2021-09-15T22:08:23.607 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2021-09-15T22:08:23.607 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2021-09-15T22:08:23.608 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-09-15T22:08:23.608 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2021-09-15T22:08:23.608 INFO:tasks.ceph:[client] rgw data log num shards = 4 2021-09-15T22:08:23.609 INFO:tasks.ceph:[client] rgw md log max shards = 4 2021-09-15T22:08:23.609 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2021-09-15T22:08:23.609 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2021-09-15T22:08:23.610 INFO:tasks.ceph:[client] setgroup = ceph 2021-09-15T22:08:23.611 INFO:tasks.ceph:[client] setuser = ceph 2021-09-15T22:08:23.612 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-09-15T22:08:23.612 INFO:tasks.ceph:[mgr] debug ms = 1 2021-09-15T22:08:23.613 INFO:tasks.ceph:[mon] debug mon = 20 2021-09-15T22:08:23.613 INFO:tasks.ceph:[mon] debug ms = 1 2021-09-15T22:08:23.613 INFO:tasks.ceph:[mon] debug paxos = 20 2021-09-15T22:08:23.613 INFO:tasks.ceph:[mon] mon_warn_on_insecure_global_id_reclaim = False 2021-09-15T22:08:23.614 INFO:tasks.ceph:[mon] mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-09-15T22:08:23.614 INFO:tasks.ceph:[osd] debug ms = 1 2021-09-15T22:08:23.614 INFO:tasks.ceph:[osd] debug osd = 20 2021-09-15T22:08:23.615 INFO:tasks.ceph:Setting up c2.mon.a... 2021-09-15T22:08:23.615 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c2.keyring 2021-09-15T22:08:23.674 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/c2.keyring 2021-09-15T22:08:23.678 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c2.keyring 2021-09-15T22:08:23.713 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-09-15T22:08:23.770 DEBUG:tasks.ceph:Ceph mon addresses: [('c2.mon.a', '172.21.15.184')] 2021-09-15T22:08:23.771 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.184'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2021-09-15T22:08:23.772 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:23.772 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-09-15T22:08:23.777 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.184 --print /home/ubuntu/cephtest/c2.monmap 2021-09-15T22:08:23.853 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:08:23.854 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:08:23.854 INFO:teuthology.orchestra.run.smithi184.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c2.monmap 2021-09-15T22:08:23.855 INFO:teuthology.orchestra.run.smithi184.stdout:monmaptool: generated fsid df5d323c-023d-4c59-a7f9-9ebdf7ad7f8f 2021-09-15T22:08:23.855 INFO:teuthology.orchestra.run.smithi184.stdout:epoch 0 2021-09-15T22:08:23.855 INFO:teuthology.orchestra.run.smithi184.stdout:fsid df5d323c-023d-4c59-a7f9-9ebdf7ad7f8f 2021-09-15T22:08:23.855 INFO:teuthology.orchestra.run.smithi184.stdout:last_changed 2021-09-15T22:08:23.854851+0000 2021-09-15T22:08:23.856 INFO:teuthology.orchestra.run.smithi184.stdout:created 2021-09-15T22:08:23.854851+0000 2021-09-15T22:08:23.856 INFO:teuthology.orchestra.run.smithi184.stdout:min_mon_release 0 (unknown) 2021-09-15T22:08:23.856 INFO:teuthology.orchestra.run.smithi184.stdout:0: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.a 2021-09-15T22:08:23.856 INFO:teuthology.orchestra.run.smithi184.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c2.monmap (1 monitors) 2021-09-15T22:08:23.857 DEBUG:teuthology.orchestra.run.smithi184:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-09-15T22:08:23.862 INFO:tasks.ceph:Writing /etc/ceph/c2.conf for FSID df5d323c-023d-4c59-a7f9-9ebdf7ad7f8f... 2021-09-15T22:08:23.863 DEBUG:teuthology.orchestra.run.smithi180:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2021-09-15T22:08:23.865 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2021-09-15T22:08:23.899 INFO:teuthology.orchestra.run.smithi180.stdout:[global] 2021-09-15T22:08:23.899 INFO:teuthology.orchestra.run.smithi180.stdout: chdir = "" 2021-09-15T22:08:23.900 INFO:teuthology.orchestra.run.smithi180.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-09-15T22:08:23.900 INFO:teuthology.orchestra.run.smithi180.stdout: auth supported = cephx 2021-09-15T22:08:23.900 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.900 INFO:teuthology.orchestra.run.smithi180.stdout: filestore xattr use omap = true 2021-09-15T22:08:23.900 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.901 INFO:teuthology.orchestra.run.smithi180.stdout: mon clock drift allowed = 1.000 2021-09-15T22:08:23.901 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.901 INFO:teuthology.orchestra.run.smithi180.stdout: osd crush chooseleaf type = 0 2021-09-15T22:08:23.901 INFO:teuthology.orchestra.run.smithi180.stdout: auth debug = true 2021-09-15T22:08:23.901 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.902 INFO:teuthology.orchestra.run.smithi180.stdout: ms die on old message = true 2021-09-15T22:08:23.902 INFO:teuthology.orchestra.run.smithi180.stdout: ms die on bug = true 2021-09-15T22:08:23.902 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.902 INFO:teuthology.orchestra.run.smithi180.stdout: mon max pg per osd = 10000 # >= luminous 2021-09-15T22:08:23.903 INFO:teuthology.orchestra.run.smithi180.stdout: mon pg warn max object skew = 0 2021-09-15T22:08:23.903 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.903 INFO:teuthology.orchestra.run.smithi180.stdout: # disable pg_autoscaler by default for new pools 2021-09-15T22:08:23.903 INFO:teuthology.orchestra.run.smithi180.stdout: osd_pool_default_pg_autoscale_mode = off 2021-09-15T22:08:23.903 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.904 INFO:teuthology.orchestra.run.smithi180.stdout: osd pool default size = 2 2021-09-15T22:08:23.904 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.904 INFO:teuthology.orchestra.run.smithi180.stdout: mon osd allow primary affinity = true 2021-09-15T22:08:23.904 INFO:teuthology.orchestra.run.smithi180.stdout: mon osd allow pg remap = true 2021-09-15T22:08:23.905 INFO:teuthology.orchestra.run.smithi180.stdout: mon warn on legacy crush tunables = false 2021-09-15T22:08:23.905 INFO:teuthology.orchestra.run.smithi180.stdout: mon warn on crush straw calc version zero = false 2021-09-15T22:08:23.905 INFO:teuthology.orchestra.run.smithi180.stdout: mon warn on no sortbitwise = false 2021-09-15T22:08:23.906 INFO:teuthology.orchestra.run.smithi180.stdout: mon warn on osd down out interval zero = false 2021-09-15T22:08:23.906 INFO:teuthology.orchestra.run.smithi180.stdout: mon warn on too few osds = false 2021-09-15T22:08:23.906 INFO:teuthology.orchestra.run.smithi180.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-09-15T22:08:23.907 INFO:teuthology.orchestra.run.smithi180.stdout: mon_warn_on_pool_no_redundancy = false 2021-09-15T22:08:23.907 INFO:teuthology.orchestra.run.smithi180.stdout: mon_allow_pool_size_one = true 2021-09-15T22:08:23.907 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.907 INFO:teuthology.orchestra.run.smithi180.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-09-15T22:08:23.908 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.908 INFO:teuthology.orchestra.run.smithi180.stdout: osd default data pool replay window = 5 2021-09-15T22:08:23.909 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.909 INFO:teuthology.orchestra.run.smithi180.stdout: mon allow pool delete = true 2021-09-15T22:08:23.909 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.909 INFO:teuthology.orchestra.run.smithi180.stdout: mon cluster log file level = debug 2021-09-15T22:08:23.909 INFO:teuthology.orchestra.run.smithi180.stdout: debug asserts on shutdown = true 2021-09-15T22:08:23.910 INFO:teuthology.orchestra.run.smithi180.stdout: mon health detail to clog = false 2021-09-15T22:08:23.910 INFO:teuthology.orchestra.run.smithi180.stdout: mon host = 172.21.15.184 2021-09-15T22:08:23.910 INFO:teuthology.orchestra.run.smithi180.stdout: fsid = df5d323c-023d-4c59-a7f9-9ebdf7ad7f8f 2021-09-15T22:08:23.911 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.911 INFO:teuthology.orchestra.run.smithi180.stdout:[osd] 2021-09-15T22:08:23.912 INFO:teuthology.orchestra.run.smithi180.stdout: osd journal size = 100 2021-09-15T22:08:23.912 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.912 INFO:teuthology.orchestra.run.smithi180.stdout: osd scrub load threshold = 5.0 2021-09-15T22:08:23.912 INFO:teuthology.orchestra.run.smithi180.stdout: osd scrub max interval = 600 2021-09-15T22:08:23.912 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.913 INFO:teuthology.orchestra.run.smithi180.stdout: osd recover clone overlap = true 2021-09-15T22:08:23.913 INFO:teuthology.orchestra.run.smithi180.stdout: osd recovery max chunk = 1048576 2021-09-15T22:08:23.913 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.913 INFO:teuthology.orchestra.run.smithi180.stdout: osd debug shutdown = true 2021-09-15T22:08:23.914 INFO:teuthology.orchestra.run.smithi180.stdout: osd debug op order = true 2021-09-15T22:08:23.914 INFO:teuthology.orchestra.run.smithi180.stdout: osd debug verify stray on activate = true 2021-09-15T22:08:23.914 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.915 INFO:teuthology.orchestra.run.smithi180.stdout: osd open classes on start = true 2021-09-15T22:08:23.915 INFO:teuthology.orchestra.run.smithi180.stdout: osd debug pg log writeout = true 2021-09-15T22:08:23.915 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.915 INFO:teuthology.orchestra.run.smithi180.stdout: osd deep scrub update digest min age = 30 2021-09-15T22:08:23.915 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.916 INFO:teuthology.orchestra.run.smithi180.stdout: osd map max advance = 10 2021-09-15T22:08:23.916 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.916 INFO:teuthology.orchestra.run.smithi180.stdout: journal zero on create = true 2021-09-15T22:08:23.916 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.916 INFO:teuthology.orchestra.run.smithi180.stdout: filestore ondisk finisher threads = 3 2021-09-15T22:08:23.917 INFO:teuthology.orchestra.run.smithi180.stdout: filestore apply finisher threads = 3 2021-09-15T22:08:23.917 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.917 INFO:teuthology.orchestra.run.smithi180.stdout: bdev debug aio = true 2021-09-15T22:08:23.917 INFO:teuthology.orchestra.run.smithi180.stdout: osd debug misdirected ops = true 2021-09-15T22:08:23.918 INFO:teuthology.orchestra.run.smithi180.stdout: debug ms = 1 2021-09-15T22:08:23.918 INFO:teuthology.orchestra.run.smithi180.stdout: debug osd = 20 2021-09-15T22:08:23.919 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.919 INFO:teuthology.orchestra.run.smithi180.stdout:[mgr] 2021-09-15T22:08:23.919 INFO:teuthology.orchestra.run.smithi180.stdout: debug ms = 1 2021-09-15T22:08:23.919 INFO:teuthology.orchestra.run.smithi180.stdout: debug mgr = 20 2021-09-15T22:08:23.919 INFO:teuthology.orchestra.run.smithi180.stdout: debug mon = 20 2021-09-15T22:08:23.920 INFO:teuthology.orchestra.run.smithi180.stdout: debug auth = 20 2021-09-15T22:08:23.920 INFO:teuthology.orchestra.run.smithi180.stdout: mon reweight min pgs per osd = 4 2021-09-15T22:08:23.920 INFO:teuthology.orchestra.run.smithi180.stdout: mon reweight min bytes per osd = 10 2021-09-15T22:08:23.920 INFO:teuthology.orchestra.run.smithi180.stdout: mgr/telemetry/nag = false 2021-09-15T22:08:23.921 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.921 INFO:teuthology.orchestra.run.smithi180.stdout:[mon] 2021-09-15T22:08:23.921 INFO:teuthology.orchestra.run.smithi180.stdout: debug ms = 1 2021-09-15T22:08:23.921 INFO:teuthology.orchestra.run.smithi180.stdout: debug mon = 20 2021-09-15T22:08:23.921 INFO:teuthology.orchestra.run.smithi180.stdout: debug paxos = 20 2021-09-15T22:08:23.922 INFO:teuthology.orchestra.run.smithi180.stdout: debug auth = 20 2021-09-15T22:08:23.922 INFO:teuthology.orchestra.run.smithi180.stdout: mon data avail warn = 5 2021-09-15T22:08:23.922 INFO:teuthology.orchestra.run.smithi180.stdout: mon mgr mkfs grace = 240 2021-09-15T22:08:23.922 INFO:teuthology.orchestra.run.smithi180.stdout: mon reweight min pgs per osd = 4 2021-09-15T22:08:23.923 INFO:teuthology.orchestra.run.smithi180.stdout: mon osd reporter subtree level = osd 2021-09-15T22:08:23.923 INFO:teuthology.orchestra.run.smithi180.stdout: mon osd prime pg temp = true 2021-09-15T22:08:23.923 INFO:teuthology.orchestra.run.smithi180.stdout: mon reweight min bytes per osd = 10 2021-09-15T22:08:23.923 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.924 INFO:teuthology.orchestra.run.smithi180.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-09-15T22:08:23.924 INFO:teuthology.orchestra.run.smithi180.stdout: auth mon ticket ttl = 660 # 11m 2021-09-15T22:08:23.924 INFO:teuthology.orchestra.run.smithi180.stdout: auth service ticket ttl = 240 # 4m 2021-09-15T22:08:23.925 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.925 INFO:teuthology.orchestra.run.smithi180.stdout: # don't complain about insecure global_id in the test suite 2021-09-15T22:08:23.925 INFO:teuthology.orchestra.run.smithi180.stdout: mon_warn_on_insecure_global_id_reclaim = False 2021-09-15T22:08:23.925 INFO:teuthology.orchestra.run.smithi180.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-09-15T22:08:23.926 INFO:teuthology.orchestra.run.smithi180.stdout: 2021-09-15T22:08:23.926 INFO:teuthology.orchestra.run.smithi180.stdout:[client] 2021-09-15T22:08:23.926 INFO:teuthology.orchestra.run.smithi180.stdout: rgw cache enabled = true 2021-09-15T22:08:23.926 INFO:teuthology.orchestra.run.smithi180.stdout: rgw enable ops log = true 2021-09-15T22:08:23.927 INFO:teuthology.orchestra.run.smithi180.stdout: rgw enable usage log = true 2021-09-15T22:08:23.927 INFO:teuthology.orchestra.run.smithi180.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-09-15T22:08:23.927 INFO:teuthology.orchestra.run.smithi180.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-09-15T22:08:23.927 INFO:teuthology.orchestra.run.smithi180.stdout: debug rgw = 20 2021-09-15T22:08:23.927 INFO:teuthology.orchestra.run.smithi180.stdout: rgw crypt require ssl = False 2021-09-15T22:08:23.928 INFO:teuthology.orchestra.run.smithi180.stdout: rgw crypt s3 kms backend = testing 2021-09-15T22:08:23.928 INFO:teuthology.orchestra.run.smithi180.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-09-15T22:08:23.928 INFO:teuthology.orchestra.run.smithi180.stdout: rgw curl low speed time = 300 2021-09-15T22:08:23.928 INFO:teuthology.orchestra.run.smithi180.stdout: rgw data log num shards = 4 2021-09-15T22:08:23.929 INFO:teuthology.orchestra.run.smithi180.stdout: rgw md log max shards = 4 2021-09-15T22:08:23.929 INFO:teuthology.orchestra.run.smithi180.stdout: rgw sync log trim interval = 0 2021-09-15T22:08:23.929 INFO:teuthology.orchestra.run.smithi180.stdout: rgw sync obj etag verify = True 2021-09-15T22:08:23.929 INFO:teuthology.orchestra.run.smithi180.stdout: setgroup = ceph 2021-09-15T22:08:23.930 INFO:teuthology.orchestra.run.smithi180.stdout: setuser = ceph 2021-09-15T22:08:23.930 INFO:teuthology.orchestra.run.smithi180.stdout:[mon.a] 2021-09-15T22:08:23.932 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2021-09-15T22:08:23.932 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2021-09-15T22:08:23.932 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-09-15T22:08:23.932 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2021-09-15T22:08:23.933 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.933 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2021-09-15T22:08:23.933 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.933 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2021-09-15T22:08:23.934 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.934 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2021-09-15T22:08:23.934 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2021-09-15T22:08:23.934 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.934 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2021-09-15T22:08:23.935 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2021-09-15T22:08:23.935 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.935 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2021-09-15T22:08:23.935 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2021-09-15T22:08:23.936 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.936 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2021-09-15T22:08:23.936 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2021-09-15T22:08:23.936 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.936 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2021-09-15T22:08:23.937 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.937 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2021-09-15T22:08:23.937 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2021-09-15T22:08:23.937 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2021-09-15T22:08:23.938 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2021-09-15T22:08:23.938 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2021-09-15T22:08:23.938 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2021-09-15T22:08:23.938 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2021-09-15T22:08:23.938 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-09-15T22:08:23.939 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2021-09-15T22:08:23.939 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2021-09-15T22:08:23.940 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.940 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-09-15T22:08:23.940 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.940 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2021-09-15T22:08:23.941 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.941 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2021-09-15T22:08:23.941 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.941 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2021-09-15T22:08:23.942 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2021-09-15T22:08:23.942 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2021-09-15T22:08:23.942 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = 172.21.15.184 2021-09-15T22:08:23.942 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = df5d323c-023d-4c59-a7f9-9ebdf7ad7f8f 2021-09-15T22:08:23.942 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.943 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2021-09-15T22:08:23.943 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2021-09-15T22:08:23.943 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.943 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2021-09-15T22:08:23.944 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2021-09-15T22:08:23.944 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.944 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2021-09-15T22:08:23.944 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2021-09-15T22:08:23.945 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.946 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2021-09-15T22:08:23.946 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2021-09-15T22:08:23.946 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2021-09-15T22:08:23.946 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.947 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2021-09-15T22:08:23.947 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2021-09-15T22:08:23.947 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.947 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2021-09-15T22:08:23.947 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.948 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2021-09-15T22:08:23.948 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.948 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2021-09-15T22:08:23.949 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.949 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2021-09-15T22:08:23.949 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2021-09-15T22:08:23.950 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.950 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2021-09-15T22:08:23.950 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2021-09-15T22:08:23.951 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2021-09-15T22:08:23.951 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2021-09-15T22:08:23.951 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.951 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2021-09-15T22:08:23.952 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2021-09-15T22:08:23.952 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2021-09-15T22:08:23.952 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2021-09-15T22:08:23.952 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2021-09-15T22:08:23.953 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2021-09-15T22:08:23.953 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2021-09-15T22:08:23.953 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2021-09-15T22:08:23.953 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.953 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2021-09-15T22:08:23.954 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2021-09-15T22:08:23.954 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2021-09-15T22:08:23.954 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2021-09-15T22:08:23.954 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2021-09-15T22:08:23.955 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2021-09-15T22:08:23.955 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2021-09-15T22:08:23.955 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2021-09-15T22:08:23.955 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2021-09-15T22:08:23.955 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2021-09-15T22:08:23.956 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2021-09-15T22:08:23.956 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.956 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-09-15T22:08:23.956 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2021-09-15T22:08:23.957 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2021-09-15T22:08:23.957 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.957 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2021-09-15T22:08:23.957 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = False 2021-09-15T22:08:23.957 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-09-15T22:08:23.958 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:23.958 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2021-09-15T22:08:23.958 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2021-09-15T22:08:23.958 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2021-09-15T22:08:23.958 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2021-09-15T22:08:23.959 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-09-15T22:08:23.959 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-09-15T22:08:23.959 INFO:teuthology.orchestra.run.smithi184.stdout: debug rgw = 20 2021-09-15T22:08:23.959 INFO:teuthology.orchestra.run.smithi184.stdout: rgw crypt require ssl = False 2021-09-15T22:08:23.960 INFO:teuthology.orchestra.run.smithi184.stdout: rgw crypt s3 kms backend = testing 2021-09-15T22:08:23.960 INFO:teuthology.orchestra.run.smithi184.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-09-15T22:08:23.960 INFO:teuthology.orchestra.run.smithi184.stdout: rgw curl low speed time = 300 2021-09-15T22:08:23.960 INFO:teuthology.orchestra.run.smithi184.stdout: rgw data log num shards = 4 2021-09-15T22:08:23.960 INFO:teuthology.orchestra.run.smithi184.stdout: rgw md log max shards = 4 2021-09-15T22:08:23.961 INFO:teuthology.orchestra.run.smithi184.stdout: rgw sync log trim interval = 0 2021-09-15T22:08:23.961 INFO:teuthology.orchestra.run.smithi184.stdout: rgw sync obj etag verify = True 2021-09-15T22:08:23.961 INFO:teuthology.orchestra.run.smithi184.stdout: setgroup = ceph 2021-09-15T22:08:23.961 INFO:teuthology.orchestra.run.smithi184.stdout: setuser = ceph 2021-09-15T22:08:23.962 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2021-09-15T22:08:23.962 INFO:tasks.ceph:Creating admin key on c2.mon.a... 2021-09-15T22:08:23.962 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c2.keyring 2021-09-15T22:08:24.019 INFO:tasks.ceph:Copying monmap to all nodes... 2021-09-15T22:08:24.019 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:24.020 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/c2.keyring of=/dev/stdout 2021-09-15T22:08:24.027 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:24.027 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/home/ubuntu/cephtest/c2.monmap of=/dev/stdout 2021-09-15T22:08:24.034 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi180.front.sepia.ceph.com 2021-09-15T22:08:24.035 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:24.035 DEBUG:teuthology.orchestra.run.smithi180:> sudo dd of=/etc/ceph/c2.keyring 2021-09-15T22:08:24.035 DEBUG:teuthology.orchestra.run.smithi180:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-09-15T22:08:24.061 DEBUG:teuthology.orchestra.run.smithi180:> set -ex 2021-09-15T22:08:24.062 DEBUG:teuthology.orchestra.run.smithi180:> dd of=/home/ubuntu/cephtest/c2.monmap 2021-09-15T22:08:24.111 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi184.front.sepia.ceph.com 2021-09-15T22:08:24.112 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:24.112 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/c2.keyring 2021-09-15T22:08:24.112 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-09-15T22:08:24.139 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:24.139 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/c2.monmap 2021-09-15T22:08:24.145 INFO:tasks.ceph:Setting up mon nodes... 2021-09-15T22:08:24.145 INFO:tasks.ceph:Setting up mgr nodes... 2021-09-15T22:08:24.146 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mgr/c2-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c2-x/keyring 2021-09-15T22:08:24.228 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mgr/c2-x/keyring 2021-09-15T22:08:24.230 INFO:tasks.ceph:Setting up mds nodes... 2021-09-15T22:08:24.231 INFO:tasks.ceph_client:Setting up client nodes... 2021-09-15T22:08:24.231 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c2.client.0.keyring && sudo chmod 0644 /etc/ceph/c2.client.0.keyring 2021-09-15T22:08:24.261 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/c2.client.0.keyring 2021-09-15T22:08:24.272 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/c2.client.1.keyring && sudo chmod 0644 /etc/ceph/c2.client.1.keyring 2021-09-15T22:08:24.302 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/c2.client.1.keyring 2021-09-15T22:08:24.315 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-09-15T22:08:24.316 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi180.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-09-15T22:08:24.316 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/c2-0 2021-09-15T22:08:24.374 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-09-15T22:08:24.375 INFO:tasks.ceph:role: c2.osd.0 2021-09-15T22:08:24.375 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com 2021-09-15T22:08:24.376 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-09-15T22:08:24.913 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-09-15T22:08:24.913 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2021-09-15T22:08:24.913 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-09-15T22:08:24.914 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2021-09-15T22:08:24.914 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-09-15T22:08:24.914 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2021-09-15T22:08:24.914 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-09-15T22:08:24.915 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-09-15T22:08:24.915 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-09-15T22:08:24.915 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-09-15T22:08:24.916 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2021-09-15T22:08:24.917 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c2-0 2021-09-15T22:08:25.008 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-0 2021-09-15T22:08:25.020 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2021-09-15T22:08:25.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-09-15T22:08:25.022 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/c2-1 2021-09-15T22:08:25.035 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-09-15T22:08:25.036 INFO:tasks.ceph:role: c2.osd.1 2021-09-15T22:08:25.037 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com 2021-09-15T22:08:25.037 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-09-15T22:08:25.563 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-09-15T22:08:25.778 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2021-09-15T22:08:25.778 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-09-15T22:08:25.778 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2021-09-15T22:08:25.779 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-09-15T22:08:25.779 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2021-09-15T22:08:25.779 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-09-15T22:08:25.779 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-09-15T22:08:25.779 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-09-15T22:08:25.780 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-09-15T22:08:25.781 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2021-09-15T22:08:25.782 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c2-1 2021-09-15T22:08:25.810 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-1 2021-09-15T22:08:25.823 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2021-09-15T22:08:25.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-09-15T22:08:25.824 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/c2-2 2021-09-15T22:08:25.835 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-09-15T22:08:25.835 INFO:tasks.ceph:role: c2.osd.2 2021-09-15T22:08:25.835 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com 2021-09-15T22:08:25.836 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-09-15T22:08:26.362 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-09-15T22:08:26.362 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2021-09-15T22:08:26.362 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-09-15T22:08:26.363 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2021-09-15T22:08:26.363 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-09-15T22:08:26.363 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2021-09-15T22:08:26.363 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-09-15T22:08:26.363 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-09-15T22:08:26.364 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-09-15T22:08:26.364 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-09-15T22:08:26.365 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2021-09-15T22:08:26.365 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c2-2 2021-09-15T22:08:26.427 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-2 2021-09-15T22:08:26.440 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2021-09-15T22:08:26.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-09-15T22:08:26.441 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c2.monmap 2021-09-15T22:08:26.562 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:26.558+0000 7f83be00ed80 -1 auth: error reading file: /var/lib/ceph/osd/c2-0/keyring: can't open /var/lib/ceph/osd/c2-0/keyring: (2) No such file or directory 2021-09-15T22:08:26.562 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:26.558+0000 7f83be00ed80 -1 created new key in keyring /var/lib/ceph/osd/c2-0/keyring 2021-09-15T22:08:26.563 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:26.558+0000 7f83be00ed80 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-09-15T22:08:26.563 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:26.558+0000 7f83be00ed80 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-09-15T22:08:26.563 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:26.558+0000 7f83be00ed80 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-09-15T22:08:26.564 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:26.562+0000 7f83be00ed80 -1 bluestore(/var/lib/ceph/osd/c2-0) _read_fsid unparsable uuid 2021-09-15T22:08:26.589 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:26.586+0000 7f83be00ed80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-09-15T22:08:28.521 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-0 2021-09-15T22:08:28.540 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c2.monmap 2021-09-15T22:08:28.575 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:28.570+0000 7fb31a768d80 -1 auth: error reading file: /var/lib/ceph/osd/c2-1/keyring: can't open /var/lib/ceph/osd/c2-1/keyring: (2) No such file or directory 2021-09-15T22:08:28.576 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:28.570+0000 7fb31a768d80 -1 created new key in keyring /var/lib/ceph/osd/c2-1/keyring 2021-09-15T22:08:28.577 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:28.570+0000 7fb31a768d80 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-09-15T22:08:28.577 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:28.570+0000 7fb31a768d80 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-09-15T22:08:28.578 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:28.570+0000 7fb31a768d80 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-09-15T22:08:28.579 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:28.574+0000 7fb31a768d80 -1 bluestore(/var/lib/ceph/osd/c2-1) _read_fsid unparsable uuid 2021-09-15T22:08:28.589 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:28.586+0000 7fb31a768d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-09-15T22:08:30.493 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-1 2021-09-15T22:08:30.556 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c2.monmap 2021-09-15T22:08:30.594 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:30.590+0000 7f05ad6a5d80 -1 auth: error reading file: /var/lib/ceph/osd/c2-2/keyring: can't open /var/lib/ceph/osd/c2-2/keyring: (2) No such file or directory 2021-09-15T22:08:30.594 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:30.590+0000 7f05ad6a5d80 -1 created new key in keyring /var/lib/ceph/osd/c2-2/keyring 2021-09-15T22:08:30.594 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:30.590+0000 7f05ad6a5d80 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-09-15T22:08:30.594 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:30.590+0000 7f05ad6a5d80 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-09-15T22:08:30.595 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:30.590+0000 7f05ad6a5d80 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-09-15T22:08:30.595 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:30.590+0000 7f05ad6a5d80 -1 bluestore(/var/lib/ceph/osd/c2-2) _read_fsid unparsable uuid 2021-09-15T22:08:30.614 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:08:30.610+0000 7f05ad6a5d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-09-15T22:08:32.509 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-2 2021-09-15T22:08:32.526 INFO:tasks.ceph:Reading keys from all nodes... 2021-09-15T22:08:32.527 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:32.528 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mgr/c2-x/keyring of=/dev/stdout 2021-09-15T22:08:32.544 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:32.545 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/c2-0/keyring of=/dev/stdout 2021-09-15T22:08:32.600 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:32.601 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/c2-1/keyring of=/dev/stdout 2021-09-15T22:08:32.614 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:32.614 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/c2-2/keyring of=/dev/stdout 2021-09-15T22:08:32.629 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:32.630 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/c2.client.0.keyring of=/dev/stdout 2021-09-15T22:08:32.638 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:32.638 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/c2.client.1.keyring of=/dev/stdout 2021-09-15T22:08:32.685 INFO:tasks.ceph:Adding keys to all mons... 2021-09-15T22:08:32.686 DEBUG:teuthology.orchestra.run.smithi184:> sudo tee -a /etc/ceph/c2.keyring 2021-09-15T22:08:32.699 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.x] 2021-09-15T22:08:32.699 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDYbkJhTU+nDRAAg15soMwwFjIlvhqlWu4eYw== 2021-09-15T22:08:32.700 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.0] 2021-09-15T22:08:32.700 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDabkJh1PqAIRAA4X/Po8qBIajiX6zxxHCdmg== 2021-09-15T22:08:32.700 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.1] 2021-09-15T22:08:32.700 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDcbkJhiuFIIhAA3LbBdagk4ZMXT8hi8gQ26Q== 2021-09-15T22:08:32.701 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.2] 2021-09-15T22:08:32.701 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDebkJhtkdpIxAAxwOflHQpNW8HqfJD/4uehA== 2021-09-15T22:08:32.701 INFO:teuthology.orchestra.run.smithi184.stdout:[client.0] 2021-09-15T22:08:32.701 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDYbkJhdbeeDxAADSfkLpp0p7BoRI0hSaBi5A== 2021-09-15T22:08:32.702 INFO:teuthology.orchestra.run.smithi184.stdout:[client.1] 2021-09-15T22:08:32.702 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDYbkJhmugTEhAAX4uDLBjozRaUqq8PblMwag== 2021-09-15T22:08:32.703 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-09-15T22:08:32.741 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2021-09-15T22:08:32.827 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2021-09-15T22:08:32.868 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2021-09-15T22:08:32.907 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-09-15T22:08:32.951 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-09-15T22:08:33.046 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-09-15T22:08:33.047 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/c2-a 2021-09-15T22:08:33.061 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c2 --mkfs -i a --monmap /home/ubuntu/cephtest/c2.monmap --keyring /etc/ceph/c2.keyring 2021-09-15T22:08:33.115 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c2-a 2021-09-15T22:08:33.132 DEBUG:teuthology.orchestra.run.smithi184:> rm -- /home/ubuntu/cephtest/c2.monmap 2021-09-15T22:08:33.181 INFO:tasks.ceph:Starting mon daemons in cluster c2... 2021-09-15T22:08:33.181 INFO:tasks.ceph.c2.mon.a:Restarting daemon 2021-09-15T22:08:33.182 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c2 -i a 2021-09-15T22:08:33.184 INFO:tasks.ceph.c2.mon.a:Started 2021-09-15T22:08:33.184 INFO:tasks.ceph:Starting mgr daemons in cluster c2... 2021-09-15T22:08:33.185 INFO:tasks.ceph.c2.mgr.x:Restarting daemon 2021-09-15T22:08:33.185 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c2 -i x 2021-09-15T22:08:33.188 INFO:tasks.ceph.c2.mgr.x:Started 2021-09-15T22:08:33.188 INFO:tasks.ceph:Setting crush tunables to default 2021-09-15T22:08:33.188 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster c2 osd crush tunables default 2021-09-15T22:08:33.407 INFO:teuthology.orchestra.run.smithi184.stderr:adjusted tunables profile to default 2021-09-15T22:08:33.418 INFO:tasks.ceph:Starting osd daemons in cluster c2... 2021-09-15T22:08:33.418 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:33.419 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/c2-0/fsid of=/dev/stdout 2021-09-15T22:08:33.429 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:33.430 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/c2-1/fsid of=/dev/stdout 2021-09-15T22:08:33.443 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:33.443 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/c2-2/fsid of=/dev/stdout 2021-09-15T22:08:33.453 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster c2 osd new f3f102e3-de80-470b-9780-7fd3691b15e8 0 2021-09-15T22:08:33.634 INFO:teuthology.orchestra.run.smithi184.stdout:0 2021-09-15T22:08:33.645 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster c2 osd new 94cd45aa-0a98-48b7-a2f3-c105769cf95b 1 2021-09-15T22:08:33.825 INFO:teuthology.orchestra.run.smithi184.stdout:1 2021-09-15T22:08:33.841 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster c2 osd new c470f3f3-6266-44b0-87e7-f74bf81a95fc 2 2021-09-15T22:08:34.017 INFO:teuthology.orchestra.run.smithi184.stdout:2 2021-09-15T22:08:34.032 INFO:tasks.ceph.c2.osd.0:Restarting daemon 2021-09-15T22:08:34.033 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 0 2021-09-15T22:08:34.036 INFO:tasks.ceph.c2.osd.0:Started 2021-09-15T22:08:34.037 INFO:tasks.ceph.c2.osd.1:Restarting daemon 2021-09-15T22:08:34.037 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 1 2021-09-15T22:08:34.040 INFO:tasks.ceph.c2.osd.1:Started 2021-09-15T22:08:34.041 INFO:tasks.ceph.c2.osd.2:Restarting daemon 2021-09-15T22:08:34.042 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 2 2021-09-15T22:08:34.045 INFO:tasks.ceph.c2.osd.2:Started 2021-09-15T22:08:34.045 INFO:tasks.ceph:Waiting for OSDs to come up 2021-09-15T22:08:34.348 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2021-09-15T22:08:34.409 INFO:tasks.ceph.c2.osd.2.smithi184.stderr:2021-09-15T22:08:34.406+0000 7fa908e41d80 -1 Falling back to public interface 2021-09-15T22:08:34.432 INFO:tasks.ceph.c2.osd.1.smithi184.stderr:2021-09-15T22:08:34.430+0000 7fadc60c5d80 -1 Falling back to public interface 2021-09-15T22:08:34.495 INFO:teuthology.misc.health.smithi184.stdout: 2021-09-15T22:08:34.496 INFO:teuthology.misc.health.smithi184.stdout:{"epoch":5,"fsid":"df5d323c-023d-4c59-a7f9-9ebdf7ad7f8f","created":"2021-09-15T22:08:33.302842+0000","modified":"2021-09-15T22:08:34.013832+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"f3f102e3-de80-470b-9780-7fd3691b15e8","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"94cd45aa-0a98-48b7-a2f3-c105769cf95b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c470f3f3-6266-44b0-87e7-f74bf81a95fc","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-09-15T22:08:34.506 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-09-15T22:08:34.649 INFO:tasks.ceph.c2.osd.0.smithi184.stderr:2021-09-15T22:08:34.646+0000 7f56ca837d80 -1 Falling back to public interface 2021-09-15T22:08:35.063 INFO:tasks.ceph.c2.osd.2.smithi184.stderr:2021-09-15T22:08:35.062+0000 7fa908e41d80 -1 osd.2 0 log_to_monitors {default=true} 2021-09-15T22:08:35.089 INFO:tasks.ceph.c2.osd.1.smithi184.stderr:2021-09-15T22:08:35.086+0000 7fadc60c5d80 -1 osd.1 0 log_to_monitors {default=true} 2021-09-15T22:08:35.286 INFO:tasks.ceph.c2.osd.0.smithi184.stderr:2021-09-15T22:08:35.282+0000 7f56ca837d80 -1 osd.0 0 log_to_monitors {default=true} 2021-09-15T22:08:36.338 INFO:tasks.ceph.c2.osd.2.smithi184.stderr:2021-09-15T22:08:36.334+0000 7fa8faefb700 -1 osd.2 0 waiting for initial osdmap 2021-09-15T22:08:36.339 INFO:tasks.ceph.c2.osd.1.smithi184.stderr:2021-09-15T22:08:36.334+0000 7fadb817f700 -1 osd.1 0 waiting for initial osdmap 2021-09-15T22:08:36.339 INFO:tasks.ceph.c2.osd.0.smithi184.stderr:2021-09-15T22:08:36.334+0000 7f56bc8f1700 -1 osd.0 0 waiting for initial osdmap 2021-09-15T22:08:36.347 INFO:tasks.ceph.c2.osd.0.smithi184.stderr:2021-09-15T22:08:36.346+0000 7f56c3d5a700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-09-15T22:08:36.347 INFO:tasks.ceph.c2.osd.2.smithi184.stderr:2021-09-15T22:08:36.346+0000 7fa902364700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-09-15T22:08:36.348 INFO:tasks.ceph.c2.osd.1.smithi184.stderr:2021-09-15T22:08:36.346+0000 7fadbf5e8700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-09-15T22:08:40.810 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2021-09-15T22:08:41.044 INFO:teuthology.misc.health.smithi184.stdout: 2021-09-15T22:08:41.045 INFO:teuthology.misc.health.smithi184.stdout:{"epoch":10,"fsid":"df5d323c-023d-4c59-a7f9-9ebdf7ad7f8f","created":"2021-09-15T22:08:33.302842+0000","modified":"2021-09-15T22:08:39.349110+0000","last_up_change":"2021-09-15T22:08:37.332409+0000","last_in_change":"2021-09-15T22:08:37.332409+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-09-15T22:08:36.188855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"f3f102e3-de80-470b-9780-7fd3691b15e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":12135},{"type":"v1","addr":"172.21.15.184:6817","nonce":12135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":12135},{"type":"v1","addr":"172.21.15.184:6819","nonce":12135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":12135},{"type":"v1","addr":"172.21.15.184:6823","nonce":12135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":12135},{"type":"v1","addr":"172.21.15.184:6821","nonce":12135}]},"public_addr":"172.21.15.184:6817/12135","cluster_addr":"172.21.15.184:6819/12135","heartbeat_back_addr":"172.21.15.184:6823/12135","heartbeat_front_addr":"172.21.15.184:6821/12135","state":["exists","up"]},{"osd":1,"uuid":"94cd45aa-0a98-48b7-a2f3-c105769cf95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":8,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":12137},{"type":"v1","addr":"172.21.15.184:6809","nonce":12137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":12137},{"type":"v1","addr":"172.21.15.184:6811","nonce":12137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":12137},{"type":"v1","addr":"172.21.15.184:6815","nonce":12137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":12137},{"type":"v1","addr":"172.21.15.184:6813","nonce":12137}]},"public_addr":"172.21.15.184:6809/12137","cluster_addr":"172.21.15.184:6811/12137","heartbeat_back_addr":"172.21.15.184:6815/12137","heartbeat_front_addr":"172.21.15.184:6813/12137","state":["exists","up"]},{"osd":2,"uuid":"c470f3f3-6266-44b0-87e7-f74bf81a95fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":12136},{"type":"v1","addr":"172.21.15.184:6801","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":12136},{"type":"v1","addr":"172.21.15.184:6803","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":12136},{"type":"v1","addr":"172.21.15.184:6807","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":12136},{"type":"v1","addr":"172.21.15.184:6805","nonce":12136}]},"public_addr":"172.21.15.184:6801/12136","cluster_addr":"172.21.15.184:6803/12136","heartbeat_back_addr":"172.21.15.184:6807/12136","heartbeat_front_addr":"172.21.15.184:6805/12136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:36.285822+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:36.120383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:36.094405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-09-15T22:08:41.061 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-09-15T22:08:41.062 INFO:tasks.ceph:Creating RBD pool 2021-09-15T22:08:41.062 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster c2 osd pool create rbd 8 2021-09-15T22:08:41.435 INFO:teuthology.orchestra.run.smithi184.stderr:pool 'rbd' created 2021-09-15T22:08:41.445 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster c2 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-09-15T22:08:42.444 INFO:teuthology.orchestra.run.smithi184.stderr:enabled application 'rbd' on pool 'rbd' 2021-09-15T22:08:42.455 INFO:tasks.ceph:Starting mds daemons in cluster c2... 2021-09-15T22:08:42.455 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2021-09-15T22:08:42.456 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-09-15T22:08:42.696 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:42.696 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":12,"fsid":"df5d323c-023d-4c59-a7f9-9ebdf7ad7f8f","created":"2021-09-15T22:08:33.302842+0000","modified":"2021-09-15T22:08:42.425125+0000","last_up_change":"2021-09-15T22:08:37.332409+0000","last_in_change":"2021-09-15T22:08:37.332409+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-09-15T22:08:36.188855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-09-15T22:08:41.372423+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f3f102e3-de80-470b-9780-7fd3691b15e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":12135},{"type":"v1","addr":"172.21.15.184:6817","nonce":12135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":12135},{"type":"v1","addr":"172.21.15.184:6819","nonce":12135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":12135},{"type":"v1","addr":"172.21.15.184:6823","nonce":12135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":12135},{"type":"v1","addr":"172.21.15.184:6821","nonce":12135}]},"public_addr":"172.21.15.184:6817/12135","cluster_addr":"172.21.15.184:6819/12135","heartbeat_back_addr":"172.21.15.184:6823/12135","heartbeat_front_addr":"172.21.15.184:6821/12135","state":["exists","up"]},{"osd":1,"uuid":"94cd45aa-0a98-48b7-a2f3-c105769cf95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":12137},{"type":"v1","addr":"172.21.15.184:6809","nonce":12137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":12137},{"type":"v1","addr":"172.21.15.184:6811","nonce":12137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":12137},{"type":"v1","addr":"172.21.15.184:6815","nonce":12137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":12137},{"type":"v1","addr":"172.21.15.184:6813","nonce":12137}]},"public_addr":"172.21.15.184:6809/12137","cluster_addr":"172.21.15.184:6811/12137","heartbeat_back_addr":"172.21.15.184:6815/12137","heartbeat_front_addr":"172.21.15.184:6813/12137","state":["exists","up"]},{"osd":2,"uuid":"c470f3f3-6266-44b0-87e7-f74bf81a95fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":12136},{"type":"v1","addr":"172.21.15.184:6801","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":12136},{"type":"v1","addr":"172.21.15.184:6803","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":12136},{"type":"v1","addr":"172.21.15.184:6807","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":12136},{"type":"v1","addr":"172.21.15.184:6805","nonce":12136}]},"public_addr":"172.21.15.184:6801/12136","cluster_addr":"172.21.15.184:6803/12136","heartbeat_back_addr":"172.21.15.184:6807/12136","heartbeat_front_addr":"172.21.15.184:6805/12136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:36.285822+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:36.120383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:36.094405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-09-15T22:08:42.708 INFO:tasks.ceph.ceph_manager.c2:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-09-15T22:08:36.188855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-09-15T22:08:41.372423+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-09-15T22:08:42.709 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd pool get device_health_metrics pg_num 2021-09-15T22:08:42.951 INFO:teuthology.orchestra.run.smithi184.stdout:pg_num: 1 2021-09-15T22:08:42.963 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd pool get rbd pg_num 2021-09-15T22:08:43.209 INFO:teuthology.orchestra.run.smithi184.stdout:pg_num: 8 2021-09-15T22:08:43.222 INFO:tasks.ceph:Waiting until c2 daemons up and pgs clean... 2021-09-15T22:08:43.222 INFO:tasks.ceph.ceph_manager.c2:waiting for mgr available 2021-09-15T22:08:43.223 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 mgr dump --format=json 2021-09-15T22:08:43.489 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:43.501 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":4,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":11949},{"type":"v1","addr":"172.21.15.184:6825","nonce":11949}]},"active_addr":"172.21.15.184:6825/11949","active_change":"2021-09-15T22:08:36.105339+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":1002368397}]},{"addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":1609968504}]},{"addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":1651682385}]}]}} 2021-09-15T22:08:43.503 INFO:tasks.ceph.ceph_manager.c2:mgr available! 2021-09-15T22:08:43.503 INFO:tasks.ceph.ceph_manager.c2:waiting for all up 2021-09-15T22:08:43.504 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2021-09-15T22:08:43.743 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:43.743 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":13,"fsid":"df5d323c-023d-4c59-a7f9-9ebdf7ad7f8f","created":"2021-09-15T22:08:33.302842+0000","modified":"2021-09-15T22:08:43.430537+0000","last_up_change":"2021-09-15T22:08:37.332409+0000","last_in_change":"2021-09-15T22:08:37.332409+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-09-15T22:08:36.188855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-09-15T22:08:41.372423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f3f102e3-de80-470b-9780-7fd3691b15e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":12135},{"type":"v1","addr":"172.21.15.184:6817","nonce":12135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":12135},{"type":"v1","addr":"172.21.15.184:6819","nonce":12135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":12135},{"type":"v1","addr":"172.21.15.184:6823","nonce":12135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":12135},{"type":"v1","addr":"172.21.15.184:6821","nonce":12135}]},"public_addr":"172.21.15.184:6817/12135","cluster_addr":"172.21.15.184:6819/12135","heartbeat_back_addr":"172.21.15.184:6823/12135","heartbeat_front_addr":"172.21.15.184:6821/12135","state":["exists","up"]},{"osd":1,"uuid":"94cd45aa-0a98-48b7-a2f3-c105769cf95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":12137},{"type":"v1","addr":"172.21.15.184:6809","nonce":12137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":12137},{"type":"v1","addr":"172.21.15.184:6811","nonce":12137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":12137},{"type":"v1","addr":"172.21.15.184:6815","nonce":12137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":12137},{"type":"v1","addr":"172.21.15.184:6813","nonce":12137}]},"public_addr":"172.21.15.184:6809/12137","cluster_addr":"172.21.15.184:6811/12137","heartbeat_back_addr":"172.21.15.184:6815/12137","heartbeat_front_addr":"172.21.15.184:6813/12137","state":["exists","up"]},{"osd":2,"uuid":"c470f3f3-6266-44b0-87e7-f74bf81a95fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":12136},{"type":"v1","addr":"172.21.15.184:6801","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":12136},{"type":"v1","addr":"172.21.15.184:6803","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":12136},{"type":"v1","addr":"172.21.15.184:6807","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":12136},{"type":"v1","addr":"172.21.15.184:6805","nonce":12136}]},"public_addr":"172.21.15.184:6801/12136","cluster_addr":"172.21.15.184:6803/12136","heartbeat_back_addr":"172.21.15.184:6807/12136","heartbeat_front_addr":"172.21.15.184:6805/12136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:36.285822+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:36.120383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:36.094405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-09-15T22:08:43.755 INFO:tasks.ceph.ceph_manager.c2:all up! 2021-09-15T22:08:43.756 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2021-09-15T22:08:43.995 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:43.996 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":13,"fsid":"df5d323c-023d-4c59-a7f9-9ebdf7ad7f8f","created":"2021-09-15T22:08:33.302842+0000","modified":"2021-09-15T22:08:43.430537+0000","last_up_change":"2021-09-15T22:08:37.332409+0000","last_in_change":"2021-09-15T22:08:37.332409+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-09-15T22:08:36.188855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-09-15T22:08:41.372423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f3f102e3-de80-470b-9780-7fd3691b15e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":12135},{"type":"v1","addr":"172.21.15.184:6817","nonce":12135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":12135},{"type":"v1","addr":"172.21.15.184:6819","nonce":12135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":12135},{"type":"v1","addr":"172.21.15.184:6823","nonce":12135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":12135},{"type":"v1","addr":"172.21.15.184:6821","nonce":12135}]},"public_addr":"172.21.15.184:6817/12135","cluster_addr":"172.21.15.184:6819/12135","heartbeat_back_addr":"172.21.15.184:6823/12135","heartbeat_front_addr":"172.21.15.184:6821/12135","state":["exists","up"]},{"osd":1,"uuid":"94cd45aa-0a98-48b7-a2f3-c105769cf95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":12137},{"type":"v1","addr":"172.21.15.184:6809","nonce":12137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":12137},{"type":"v1","addr":"172.21.15.184:6811","nonce":12137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":12137},{"type":"v1","addr":"172.21.15.184:6815","nonce":12137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":12137},{"type":"v1","addr":"172.21.15.184:6813","nonce":12137}]},"public_addr":"172.21.15.184:6809/12137","cluster_addr":"172.21.15.184:6811/12137","heartbeat_back_addr":"172.21.15.184:6815/12137","heartbeat_front_addr":"172.21.15.184:6813/12137","state":["exists","up"]},{"osd":2,"uuid":"c470f3f3-6266-44b0-87e7-f74bf81a95fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":12136},{"type":"v1","addr":"172.21.15.184:6801","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":12136},{"type":"v1","addr":"172.21.15.184:6803","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":12136},{"type":"v1","addr":"172.21.15.184:6807","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":12136},{"type":"v1","addr":"172.21.15.184:6805","nonce":12136}]},"public_addr":"172.21.15.184:6801/12136","cluster_addr":"172.21.15.184:6803/12136","heartbeat_back_addr":"172.21.15.184:6807/12136","heartbeat_front_addr":"172.21.15.184:6805/12136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:36.285822+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:36.120383+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-09-15T22:08:36.094405+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-09-15T22:08:44.007 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.0 flush_pg_stats 2021-09-15T22:08:44.154 INFO:teuthology.orchestra.run.smithi184.stdout:34359738371 2021-09-15T22:08:44.154 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.1 flush_pg_stats 2021-09-15T22:08:44.298 INFO:teuthology.orchestra.run.smithi184.stdout:34359738372 2021-09-15T22:08:44.299 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.2 flush_pg_stats 2021-09-15T22:08:44.451 INFO:teuthology.orchestra.run.smithi184.stdout:34359738371 2021-09-15T22:08:44.452 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2021-09-15T22:08:44.694 INFO:teuthology.orchestra.run.smithi184.stdout:34359738370 2021-09-15T22:08:44.706 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738371 got 34359738370 for osd.0 2021-09-15T22:08:45.708 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2021-09-15T22:08:45.960 INFO:teuthology.orchestra.run.smithi184.stdout:34359738370 2021-09-15T22:08:45.972 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738371 got 34359738370 for osd.0 2021-09-15T22:08:46.973 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2021-09-15T22:08:47.228 INFO:teuthology.orchestra.run.smithi184.stdout:34359738371 2021-09-15T22:08:47.241 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738371 got 34359738371 for osd.0 2021-09-15T22:08:47.241 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.1 2021-09-15T22:08:47.482 INFO:teuthology.orchestra.run.smithi184.stdout:34359738372 2021-09-15T22:08:47.494 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738372 for osd.1 2021-09-15T22:08:47.495 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.2 2021-09-15T22:08:47.735 INFO:teuthology.orchestra.run.smithi184.stdout:34359738371 2021-09-15T22:08:47.747 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738371 got 34359738371 for osd.2 2021-09-15T22:08:47.748 INFO:tasks.ceph.ceph_manager.c2:waiting for clean 2021-09-15T22:08:47.748 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2021-09-15T22:08:47.991 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:47.994 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2021-09-15T22:08:48.004 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2021-09-15T22:08:46.114374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146080,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426720,"statfs":{"total":322122547200,"available":318900961280,"internally_reserved":3221225472,"allocated":335872,"data_stored":94542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.677618"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.445097+0000","last_change":"2021-09-15T22:08:42.444569+0000","last_active":"2021-09-15T22:08:42.445097+0000","last_peered":"2021-09-15T22:08:42.445097+0000","last_clean":"2021-09-15T22:08:42.445097+0000","last_became_active":"2021-09-15T22:08:42.443026+0000","last_became_peered":"2021-09-15T22:08:42.443026+0000","last_unstale":"2021-09-15T22:08:42.445097+0000","last_undegraded":"2021-09-15T22:08:42.445097+0000","last_fullsized":"2021-09-15T22:08:42.445097+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_clean_scrub_stamp":"2021-09-15T22:08:41.422625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.444863+0000","last_change":"2021-09-15T22:08:42.443706+0000","last_active":"2021-09-15T22:08:42.444863+0000","last_peered":"2021-09-15T22:08:42.444863+0000","last_clean":"2021-09-15T22:08:42.444863+0000","last_became_active":"2021-09-15T22:08:42.443274+0000","last_became_peered":"2021-09-15T22:08:42.443274+0000","last_unstale":"2021-09-15T22:08:42.444863+0000","last_undegraded":"2021-09-15T22:08:42.444863+0000","last_fullsized":"2021-09-15T22:08:42.444863+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_clean_scrub_stamp":"2021-09-15T22:08:41.422625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.443925+0000","last_change":"2021-09-15T22:08:42.442330+0000","last_active":"2021-09-15T22:08:42.443925+0000","last_peered":"2021-09-15T22:08:42.443925+0000","last_clean":"2021-09-15T22:08:42.443925+0000","last_became_active":"2021-09-15T22:08:42.441819+0000","last_became_peered":"2021-09-15T22:08:42.441819+0000","last_unstale":"2021-09-15T22:08:42.443925+0000","last_undegraded":"2021-09-15T22:08:42.443925+0000","last_fullsized":"2021-09-15T22:08:42.443925+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_clean_scrub_stamp":"2021-09-15T22:08:41.422625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.444826+0000","last_change":"2021-09-15T22:08:42.443532+0000","last_active":"2021-09-15T22:08:42.444826+0000","last_peered":"2021-09-15T22:08:42.444826+0000","last_clean":"2021-09-15T22:08:42.444826+0000","last_became_active":"2021-09-15T22:08:42.443054+0000","last_became_peered":"2021-09-15T22:08:42.443054+0000","last_unstale":"2021-09-15T22:08:42.444826+0000","last_undegraded":"2021-09-15T22:08:42.444826+0000","last_fullsized":"2021-09-15T22:08:42.444826+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_clean_scrub_stamp":"2021-09-15T22:08:41.422625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.444811+0000","last_change":"2021-09-15T22:08:42.443442+0000","last_active":"2021-09-15T22:08:42.444811+0000","last_peered":"2021-09-15T22:08:42.444811+0000","last_clean":"2021-09-15T22:08:42.444811+0000","last_became_active":"2021-09-15T22:08:42.442873+0000","last_became_peered":"2021-09-15T22:08:42.442873+0000","last_unstale":"2021-09-15T22:08:42.444811+0000","last_undegraded":"2021-09-15T22:08:42.444811+0000","last_fullsized":"2021-09-15T22:08:42.444811+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_clean_scrub_stamp":"2021-09-15T22:08:41.422625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.443408+0000","last_change":"2021-09-15T22:08:42.442113+0000","last_active":"2021-09-15T22:08:42.443408+0000","last_peered":"2021-09-15T22:08:42.443408+0000","last_clean":"2021-09-15T22:08:42.443408+0000","last_became_active":"2021-09-15T22:08:42.441732+0000","last_became_peered":"2021-09-15T22:08:42.441732+0000","last_unstale":"2021-09-15T22:08:42.443408+0000","last_undegraded":"2021-09-15T22:08:42.443408+0000","last_fullsized":"2021-09-15T22:08:42.443408+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_clean_scrub_stamp":"2021-09-15T22:08:41.422625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.443466+0000","last_change":"2021-09-15T22:08:42.441162+0000","last_active":"2021-09-15T22:08:42.443466+0000","last_peered":"2021-09-15T22:08:42.443466+0000","last_clean":"2021-09-15T22:08:42.443466+0000","last_became_active":"2021-09-15T22:08:42.440590+0000","last_became_peered":"2021-09-15T22:08:42.440590+0000","last_unstale":"2021-09-15T22:08:42.443466+0000","last_undegraded":"2021-09-15T22:08:42.443466+0000","last_fullsized":"2021-09-15T22:08:42.443466+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_clean_scrub_stamp":"2021-09-15T22:08:41.422625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.443683+0000","last_change":"2021-09-15T22:08:42.441922+0000","last_active":"2021-09-15T22:08:42.443683+0000","last_peered":"2021-09-15T22:08:42.443683+0000","last_clean":"2021-09-15T22:08:42.443683+0000","last_became_active":"2021-09-15T22:08:42.441655+0000","last_became_peered":"2021-09-15T22:08:42.441655+0000","last_unstale":"2021-09-15T22:08:42.443683+0000","last_undegraded":"2021-09-15T22:08:42.443683+0000","last_fullsized":"2021-09-15T22:08:42.443683+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_clean_scrub_stamp":"2021-09-15T22:08:41.422625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"9'1","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.439958+0000","last_change":"2021-09-15T22:08:38.599581+0000","last_active":"2021-09-15T22:08:42.439958+0000","last_peered":"2021-09-15T22:08:42.439958+0000","last_clean":"2021-09-15T22:08:42.439958+0000","last_became_active":"2021-09-15T22:08:38.598157+0000","last_became_peered":"2021-09-15T22:08:38.598157+0000","last_unstale":"2021-09-15T22:08:42.439958+0000","last_undegraded":"2021-09-15T22:08:42.439958+0000","last_fullsized":"2021-09-15T22:08:42.439958+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:36.320249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:36.320249+0000","last_clean_scrub_stamp":"2021-09-15T22:08:36.320249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":32674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":32674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808912,"statfs":{"total":107374182400,"available":106300325888,"internally_reserved":1073741824,"allocated":106496,"data_stored":29194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]}]}} 2021-09-15T22:08:48.005 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2021-09-15T22:08:48.240 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:48.242 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2021-09-15T22:08:48.251 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2021-09-15T22:08:48.114834+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146080,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426720,"statfs":{"total":322122547200,"available":318900961280,"internally_reserved":3221225472,"allocated":335872,"data_stored":94542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.678078"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.445097+0000","last_change":"2021-09-15T22:08:42.444569+0000","last_active":"2021-09-15T22:08:42.445097+0000","last_peered":"2021-09-15T22:08:42.445097+0000","last_clean":"2021-09-15T22:08:42.445097+0000","last_became_active":"2021-09-15T22:08:42.443026+0000","last_became_peered":"2021-09-15T22:08:42.443026+0000","last_unstale":"2021-09-15T22:08:42.445097+0000","last_undegraded":"2021-09-15T22:08:42.445097+0000","last_fullsized":"2021-09-15T22:08:42.445097+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_clean_scrub_stamp":"2021-09-15T22:08:41.422625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.444863+0000","last_change":"2021-09-15T22:08:42.443706+0000","last_active":"2021-09-15T22:08:42.444863+0000","last_peered":"2021-09-15T22:08:42.444863+0000","last_clean":"2021-09-15T22:08:42.444863+0000","last_became_active":"2021-09-15T22:08:42.443274+0000","last_became_peered":"2021-09-15T22:08:42.443274+0000","last_unstale":"2021-09-15T22:08:42.444863+0000","last_undegraded":"2021-09-15T22:08:42.444863+0000","last_fullsized":"2021-09-15T22:08:42.444863+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_clean_scrub_stamp":"2021-09-15T22:08:41.422625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.443925+0000","last_change":"2021-09-15T22:08:42.442330+0000","last_active":"2021-09-15T22:08:42.443925+0000","last_peered":"2021-09-15T22:08:42.443925+0000","last_clean":"2021-09-15T22:08:42.443925+0000","last_became_active":"2021-09-15T22:08:42.441819+0000","last_became_peered":"2021-09-15T22:08:42.441819+0000","last_unstale":"2021-09-15T22:08:42.443925+0000","last_undegraded":"2021-09-15T22:08:42.443925+0000","last_fullsized":"2021-09-15T22:08:42.443925+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_clean_scrub_stamp":"2021-09-15T22:08:41.422625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.444826+0000","last_change":"2021-09-15T22:08:42.443532+0000","last_active":"2021-09-15T22:08:42.444826+0000","last_peered":"2021-09-15T22:08:42.444826+0000","last_clean":"2021-09-15T22:08:42.444826+0000","last_became_active":"2021-09-15T22:08:42.443054+0000","last_became_peered":"2021-09-15T22:08:42.443054+0000","last_unstale":"2021-09-15T22:08:42.444826+0000","last_undegraded":"2021-09-15T22:08:42.444826+0000","last_fullsized":"2021-09-15T22:08:42.444826+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_clean_scrub_stamp":"2021-09-15T22:08:41.422625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.444811+0000","last_change":"2021-09-15T22:08:42.443442+0000","last_active":"2021-09-15T22:08:42.444811+0000","last_peered":"2021-09-15T22:08:42.444811+0000","last_clean":"2021-09-15T22:08:42.444811+0000","last_became_active":"2021-09-15T22:08:42.442873+0000","last_became_peered":"2021-09-15T22:08:42.442873+0000","last_unstale":"2021-09-15T22:08:42.444811+0000","last_undegraded":"2021-09-15T22:08:42.444811+0000","last_fullsized":"2021-09-15T22:08:42.444811+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_clean_scrub_stamp":"2021-09-15T22:08:41.422625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.443408+0000","last_change":"2021-09-15T22:08:42.442113+0000","last_active":"2021-09-15T22:08:42.443408+0000","last_peered":"2021-09-15T22:08:42.443408+0000","last_clean":"2021-09-15T22:08:42.443408+0000","last_became_active":"2021-09-15T22:08:42.441732+0000","last_became_peered":"2021-09-15T22:08:42.441732+0000","last_unstale":"2021-09-15T22:08:42.443408+0000","last_undegraded":"2021-09-15T22:08:42.443408+0000","last_fullsized":"2021-09-15T22:08:42.443408+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_clean_scrub_stamp":"2021-09-15T22:08:41.422625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.443466+0000","last_change":"2021-09-15T22:08:42.441162+0000","last_active":"2021-09-15T22:08:42.443466+0000","last_peered":"2021-09-15T22:08:42.443466+0000","last_clean":"2021-09-15T22:08:42.443466+0000","last_became_active":"2021-09-15T22:08:42.440590+0000","last_became_peered":"2021-09-15T22:08:42.440590+0000","last_unstale":"2021-09-15T22:08:42.443466+0000","last_undegraded":"2021-09-15T22:08:42.443466+0000","last_fullsized":"2021-09-15T22:08:42.443466+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_clean_scrub_stamp":"2021-09-15T22:08:41.422625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.443683+0000","last_change":"2021-09-15T22:08:42.441922+0000","last_active":"2021-09-15T22:08:42.443683+0000","last_peered":"2021-09-15T22:08:42.443683+0000","last_clean":"2021-09-15T22:08:42.443683+0000","last_became_active":"2021-09-15T22:08:42.441655+0000","last_became_peered":"2021-09-15T22:08:42.441655+0000","last_unstale":"2021-09-15T22:08:42.443683+0000","last_undegraded":"2021-09-15T22:08:42.443683+0000","last_fullsized":"2021-09-15T22:08:42.443683+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:41.422625+0000","last_clean_scrub_stamp":"2021-09-15T22:08:41.422625+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"9'1","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-09-15T22:08:42.439958+0000","last_change":"2021-09-15T22:08:38.599581+0000","last_active":"2021-09-15T22:08:42.439958+0000","last_peered":"2021-09-15T22:08:42.439958+0000","last_clean":"2021-09-15T22:08:42.439958+0000","last_became_active":"2021-09-15T22:08:38.598157+0000","last_became_peered":"2021-09-15T22:08:38.598157+0000","last_unstale":"2021-09-15T22:08:42.439958+0000","last_undegraded":"2021-09-15T22:08:42.439958+0000","last_fullsized":"2021-09-15T22:08:42.439958+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-09-15T22:08:36.320249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-09-15T22:08:36.320249+0000","last_clean_scrub_stamp":"2021-09-15T22:08:36.320249+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":32674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":32674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808912,"statfs":{"total":107374182400,"available":106300325888,"internally_reserved":1073741824,"allocated":106496,"data_stored":29194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]}]}} 2021-09-15T22:08:48.252 INFO:tasks.ceph.ceph_manager.c2:clean! 2021-09-15T22:08:48.252 INFO:tasks.ceph:Waiting until ceph cluster c2 is healthy... 2021-09-15T22:08:48.253 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy 2021-09-15T22:08:48.253 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 health --format=json 2021-09-15T22:08:48.529 INFO:teuthology.orchestra.run.smithi184.stdout: 2021-09-15T22:08:48.542 INFO:teuthology.orchestra.run.smithi184.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-09-15T22:08:48.542 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy done 2021-09-15T22:08:48.543 INFO:teuthology.run_tasks:Running task parallel... 2021-09-15T22:08:48.560 INFO:teuthology.task.parallel:starting parallel... 2021-09-15T22:08:48.560 INFO:teuthology.task.parallel:In parallel, running task sequential... 2021-09-15T22:08:48.561 INFO:teuthology.task.sequential:In sequential, running task install.upgrade... 2021-09-15T22:08:48.561 INFO:teuthology.task.install:project ceph config {'c2.client.0': None, 'c2.client.1': None, 'c2.mgr.x': None, 'c2.mon.a': None, 'c2.osd.0': None, 'c2.osd.1': None, 'c2.osd.2': None} overrides {'branch': 'octopus', 'sha1': 'b70647e8796c78a4f551a1edd9ebceb06255dced'} 2021-09-15T22:08:48.562 WARNING:teuthology.task.install:remote ubuntu@smithi184.front.sepia.ceph.com came up twice (role c2.client.1) 2021-09-15T22:08:48.562 WARNING:teuthology.task.install:remote ubuntu@smithi184.front.sepia.ceph.com came up twice (role c2.mgr.x) 2021-09-15T22:08:48.563 WARNING:teuthology.task.install:remote ubuntu@smithi184.front.sepia.ceph.com came up twice (role c2.mon.a) 2021-09-15T22:08:48.563 WARNING:teuthology.task.install:remote ubuntu@smithi184.front.sepia.ceph.com came up twice (role c2.osd.0) 2021-09-15T22:08:48.563 WARNING:teuthology.task.install:remote ubuntu@smithi184.front.sepia.ceph.com came up twice (role c2.osd.1) 2021-09-15T22:08:48.564 WARNING:teuthology.task.install:remote ubuntu@smithi184.front.sepia.ceph.com came up twice (role c2.osd.2) 2021-09-15T22:08:48.564 INFO:teuthology.task.install:remote ubuntu@smithi184.front.sepia.ceph.com config {'branch': 'octopus', 'sha1': 'b70647e8796c78a4f551a1edd9ebceb06255dced'} 2021-09-15T22:08:48.564 INFO:teuthology.task.install:extra packages: [] 2021-09-15T22:08:48.565 DEBUG:teuthology.orchestra.run.smithi184:> sudo lsb_release -is 2021-09-15T22:08:48.614 INFO:teuthology.orchestra.run.smithi184.stdout:Ubuntu 2021-09-15T22:08:48.618 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-09-15T22:08:48.625 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-09-15T22:08:48.626 INFO:teuthology.task.install:Upgrading ceph deb packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse 2021-09-15T22:08:48.626 DEBUG:teuthology.orchestra.run.smithi184:> dpkg-query -W -f '${Version}' ceph-common 2021-09-15T22:08:48.649 INFO:teuthology.orchestra.run.smithi184.stdout:15.2.14-69-g3bb6dfef-1focal 2021-09-15T22:08:48.650 INFO:teuthology.packaging:The installed version of ceph-common is 15.2.14-69-g3bb6dfef-1focal 2021-09-15T22:08:48.650 DEBUG:teuthology.orchestra.run.smithi184:> sudo lsb_release -is 2021-09-15T22:08:48.694 INFO:teuthology.orchestra.run.smithi184.stdout:Ubuntu 2021-09-15T22:08:48.699 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-09-15T22:08:48.700 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-09-15T22:08:48.700 INFO:teuthology.packaging:ref: None 2021-09-15T22:08:48.700 INFO:teuthology.packaging:tag: None 2021-09-15T22:08:48.701 INFO:teuthology.packaging:branch: octopus 2021-09-15T22:08:48.701 INFO:teuthology.packaging:sha1: b70647e8796c78a4f551a1edd9ebceb06255dced 2021-09-15T22:08:48.701 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-09-15T22:08:48.906 INFO:teuthology.task.install:Ceph deb upgrade from 15.2.14-69-g3bb6dfef-1focal to 15.2.14-69-g3bb6dfef-1focal 2021-09-15T22:08:48.907 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-key list | grep Ceph 2021-09-15T22:08:49.011 INFO:teuthology.orchestra.run.smithi184.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-09-15T22:08:49.065 INFO:teuthology.orchestra.run.smithi184.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-09-15T22:08:49.065 INFO:teuthology.orchestra.run.smithi184.stdout:uid [ unknown] Ceph.com (release key) 2021-09-15T22:08:49.066 DEBUG:teuthology.orchestra.run.smithi184:> sudo lsb_release -is 2021-09-15T22:08:49.113 INFO:teuthology.orchestra.run.smithi184.stdout:Ubuntu 2021-09-15T22:08:49.118 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-09-15T22:08:49.119 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-09-15T22:08:49.119 INFO:teuthology.packaging:ref: None 2021-09-15T22:08:49.119 INFO:teuthology.packaging:tag: None 2021-09-15T22:08:49.120 INFO:teuthology.packaging:branch: octopus 2021-09-15T22:08:49.120 INFO:teuthology.packaging:sha1: b70647e8796c78a4f551a1edd9ebceb06255dced 2021-09-15T22:08:49.120 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-09-15T22:08:49.328 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default/ 2021-09-15T22:08:49.329 INFO:teuthology.task.install.deb:Package version is 15.2.14-69-g3bb6dfef-1focal 2021-09-15T22:08:49.451 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2021-09-15T22:08:49.452 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-09-15T22:08:49.469 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get update 2021-09-15T22:08:49.605 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-09-15T22:08:49.667 INFO:teuthology.orchestra.run.smithi184.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal InRelease 2021-09-15T22:08:49.691 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:3 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal Release 2021-09-15T22:08:49.715 INFO:teuthology.orchestra.run.smithi184.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/octopus/3bb6dfef60c759eba3da031acb0f1cd05ff3875f/ubuntu/focal/flavors/default focal Release.gpg 2021-09-15T22:08:49.742 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-09-15T22:08:49.825 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-09-15T22:08:49.907 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-09-15T22:08:51.049 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2021-09-15T22:08:51.071 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.14-69-g3bb6dfef-1focal cephadm=15.2.14-69-g3bb6dfef-1focal ceph-mds=15.2.14-69-g3bb6dfef-1focal ceph-mgr=15.2.14-69-g3bb6dfef-1focal ceph-common=15.2.14-69-g3bb6dfef-1focal ceph-fuse=15.2.14-69-g3bb6dfef-1focal ceph-test=15.2.14-69-g3bb6dfef-1focal radosgw=15.2.14-69-g3bb6dfef-1focal python3-rados=15.2.14-69-g3bb6dfef-1focal python3-rgw=15.2.14-69-g3bb6dfef-1focal python3-cephfs=15.2.14-69-g3bb6dfef-1focal python3-rbd=15.2.14-69-g3bb6dfef-1focal libcephfs2=15.2.14-69-g3bb6dfef-1focal libcephfs-dev=15.2.14-69-g3bb6dfef-1focal librados2=15.2.14-69-g3bb6dfef-1focal librbd1=15.2.14-69-g3bb6dfef-1focal rbd-fuse=15.2.14-69-g3bb6dfef-1focal 2021-09-15T22:08:51.135 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2021-09-15T22:08:51.283 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2021-09-15T22:08:51.283 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2021-09-15T22:08:51.405 INFO:teuthology.orchestra.run.smithi184.stdout:ceph is already the newest version (15.2.14-69-g3bb6dfef-1focal). 2021-09-15T22:08:51.406 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-common is already the newest version (15.2.14-69-g3bb6dfef-1focal). 2021-09-15T22:08:51.406 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-fuse is already the newest version (15.2.14-69-g3bb6dfef-1focal). 2021-09-15T22:08:51.406 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-mds is already the newest version (15.2.14-69-g3bb6dfef-1focal). 2021-09-15T22:08:51.407 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-mgr is already the newest version (15.2.14-69-g3bb6dfef-1focal). 2021-09-15T22:08:51.407 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-test is already the newest version (15.2.14-69-g3bb6dfef-1focal). 2021-09-15T22:08:51.407 INFO:teuthology.orchestra.run.smithi184.stdout:cephadm is already the newest version (15.2.14-69-g3bb6dfef-1focal). 2021-09-15T22:08:51.407 INFO:teuthology.orchestra.run.smithi184.stdout:libcephfs-dev is already the newest version (15.2.14-69-g3bb6dfef-1focal). 2021-09-15T22:08:51.408 INFO:teuthology.orchestra.run.smithi184.stdout:libcephfs2 is already the newest version (15.2.14-69-g3bb6dfef-1focal). 2021-09-15T22:08:51.408 INFO:teuthology.orchestra.run.smithi184.stdout:librados2 is already the newest version (15.2.14-69-g3bb6dfef-1focal). 2021-09-15T22:08:51.408 INFO:teuthology.orchestra.run.smithi184.stdout:librados2 set to manually installed. 2021-09-15T22:08:51.408 INFO:teuthology.orchestra.run.smithi184.stdout:librbd1 is already the newest version (15.2.14-69-g3bb6dfef-1focal). 2021-09-15T22:08:51.408 INFO:teuthology.orchestra.run.smithi184.stdout:librbd1 set to manually installed. 2021-09-15T22:08:51.409 INFO:teuthology.orchestra.run.smithi184.stdout:python3-cephfs is already the newest version (15.2.14-69-g3bb6dfef-1focal). 2021-09-15T22:08:51.409 INFO:teuthology.orchestra.run.smithi184.stdout:python3-rados is already the newest version (15.2.14-69-g3bb6dfef-1focal). 2021-09-15T22:08:51.409 INFO:teuthology.orchestra.run.smithi184.stdout:python3-rbd is already the newest version (15.2.14-69-g3bb6dfef-1focal). 2021-09-15T22:08:51.409 INFO:teuthology.orchestra.run.smithi184.stdout:python3-rgw is already the newest version (15.2.14-69-g3bb6dfef-1focal). 2021-09-15T22:08:51.409 INFO:teuthology.orchestra.run.smithi184.stdout:radosgw is already the newest version (15.2.14-69-g3bb6dfef-1focal). 2021-09-15T22:08:51.410 INFO:teuthology.orchestra.run.smithi184.stdout:rbd-fuse is already the newest version (15.2.14-69-g3bb6dfef-1focal). 2021-09-15T22:08:51.410 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages were automatically installed and are no longer required: 2021-09-15T22:08:51.410 INFO:teuthology.orchestra.run.smithi184.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-09-15T22:08:51.411 INFO:teuthology.orchestra.run.smithi184.stdout:Use 'sudo apt autoremove' to remove them. 2021-09-15T22:08:51.432 INFO:teuthology.orchestra.run.smithi184.stdout:0 upgraded, 0 newly installed, 0 to remove and 166 not upgraded. 2021-09-15T22:08:51.432 INFO:teuthology.orchestra.run.smithi184.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-09-15T22:08:51.434 DEBUG:teuthology.orchestra.run.smithi184:> sudo lsb_release -is 2021-09-15T22:08:51.475 INFO:teuthology.orchestra.run.smithi184.stdout:Ubuntu 2021-09-15T22:08:51.479 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-09-15T22:08:51.479 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-09-15T22:08:51.479 INFO:teuthology.packaging:ref: None 2021-09-15T22:08:51.480 INFO:teuthology.packaging:tag: None 2021-09-15T22:08:51.480 INFO:teuthology.packaging:branch: octopus 2021-09-15T22:08:51.480 INFO:teuthology.packaging:sha1: b70647e8796c78a4f551a1edd9ebceb06255dced 2021-09-15T22:08:51.481 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-09-15T22:08:51.694 DEBUG:teuthology.orchestra.run.smithi184:> dpkg-query -W -f '${Version}' ceph 2021-09-15T22:08:51.717 INFO:teuthology.orchestra.run.smithi184.stdout:15.2.14-69-g3bb6dfef-1focal 2021-09-15T22:08:51.718 INFO:teuthology.packaging:The installed version of ceph is 15.2.14-69-g3bb6dfef-1focal 2021-09-15T22:08:51.718 INFO:teuthology.task.install:The correct ceph version 15.2.14-69-g3bb6dfef-1focal is installed. 2021-09-15T22:08:51.718 DEBUG:teuthology.parallel:result is None 2021-09-15T22:08:51.719 INFO:teuthology.run_tasks:Running task rgw... 2021-09-15T22:08:51.733 DEBUG:tasks.rgw:config is {'c1.client.0': {'port': 8000}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}} 2021-09-15T22:08:51.734 DEBUG:tasks.rgw:client list is dict_keys(['c1.client.0', 'c2.client.0', 'c2.client.1']) 2021-09-15T22:08:51.734 INFO:tasks.rgw:Creating data pools 2021-09-15T22:08:51.734 DEBUG:tasks.rgw:Obtaining remote for client c1.client.0 2021-09-15T22:08:51.735 DEBUG:teuthology.orchestra.run.smithi180:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c1 2021-09-15T22:08:52.567 INFO:teuthology.orchestra.run.smithi180.stderr:pool 'default.rgw.buckets.data' created 2021-09-15T22:08:52.579 DEBUG:teuthology.orchestra.run.smithi180:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c1 2021-09-15T22:08:53.578 INFO:teuthology.orchestra.run.smithi180.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-09-15T22:08:53.593 DEBUG:teuthology.orchestra.run.smithi180:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c1 2021-09-15T22:08:54.583 INFO:teuthology.orchestra.run.smithi180.stderr:pool 'default.rgw.buckets.index' created 2021-09-15T22:08:54.592 DEBUG:teuthology.orchestra.run.smithi180:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c1 2021-09-15T22:08:55.602 INFO:teuthology.orchestra.run.smithi180.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-09-15T22:08:55.614 DEBUG:tasks.rgw:Obtaining remote for client c2.client.0 2021-09-15T22:08:55.614 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2021-09-15T22:08:56.295 INFO:teuthology.orchestra.run.smithi184.stderr:pool 'default.rgw.buckets.data' created 2021-09-15T22:08:56.309 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2021-09-15T22:08:57.321 INFO:teuthology.orchestra.run.smithi184.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-09-15T22:08:57.340 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2021-09-15T22:08:58.318 INFO:teuthology.orchestra.run.smithi184.stderr:pool 'default.rgw.buckets.index' created 2021-09-15T22:08:58.326 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2021-09-15T22:08:59.327 INFO:teuthology.orchestra.run.smithi184.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-09-15T22:08:59.344 DEBUG:tasks.rgw:Obtaining remote for client c2.client.1 2021-09-15T22:08:59.344 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2021-09-15T22:08:59.575 INFO:teuthology.orchestra.run.smithi184.stderr:pool 'default.rgw.buckets.data' already exists 2021-09-15T22:08:59.584 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2021-09-15T22:09:00.324 INFO:teuthology.orchestra.run.smithi184.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-09-15T22:09:00.334 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2021-09-15T22:09:00.585 INFO:teuthology.orchestra.run.smithi184.stderr:pool 'default.rgw.buckets.index' already exists 2021-09-15T22:09:00.594 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2021-09-15T22:09:01.328 INFO:teuthology.orchestra.run.smithi184.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-09-15T22:09:01.338 DEBUG:tasks.rgw:Pools created 2021-09-15T22:09:01.338 INFO:tasks.rgw:Configuring compression type = random 2021-09-15T22:09:01.339 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'list'] 2021-09-15T22:09:01.339 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'list'] 2021-09-15T22:09:01.340 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user list 2021-09-15T22:09:01.403 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:01.403 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:01.415 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:01.415+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:02.623 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.623+0000 7fd40ded3980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:02.623 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.623+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:02.626 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.623+0000 7fd40ded3980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:02.626 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.623+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:02.627 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.627+0000 7fd40ded3980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:02.627 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.627+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:02.628 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.627+0000 7fd40ded3980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:02.640 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.643+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:02.642 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.643+0000 7fd40ded3980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:02.642 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.643+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:02.643 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.643+0000 7fd40ded3980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:02.643 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.643+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:02.643 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.643+0000 7fd40ded3980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:02.643 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.643+0000 7fd40ded3980 10 cannot find current period zonegroup using local zonegroup 2021-09-15T22:09:02.643 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.643+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:02.644 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.643+0000 7fd40ded3980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:02.644 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.643+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:02.644 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.643+0000 7fd40ded3980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:02.644 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.643+0000 7fd40ded3980 10 Creating default zonegroup 2021-09-15T22:09:02.644 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.643+0000 7fd40ded3980 20 get_system_obj_state: rctx=0x7ffe26245720 obj=:.pools.avail state=0x563f85ad5820 s->prefetch_data=0 2021-09-15T22:09:02.645 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.643+0000 7fd40ded3980 10 couldn't find old data placement pools config, setting up new ones for the zone 2021-09-15T22:09:02.654 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.655+0000 7fd40ded3980 10 WARNING: store->list_zones() returned r=-2 2021-09-15T22:09:02.654 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.655+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:02.655 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.655+0000 7fd40ded3980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:02.660 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.659+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:02.660 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.659+0000 7fd40ded3980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:02.660 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.659+0000 7fd40ded3980 10 could not read realm id: (2) No such file or directory 2021-09-15T22:09:02.660 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.659+0000 7fd40ded3980 10 WARNING: failed to set zone as default, r=-22 2021-09-15T22:09:02.661 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.659+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:02.661 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.659+0000 7fd40ded3980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:02.663 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.663+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:02.664 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.663+0000 7fd40ded3980 20 rados_obj.operate() r=0 bl.length=839 2021-09-15T22:09:02.664 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.663+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:02.665 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.667+0000 7fd40ded3980 20 rados_obj.operate() r=0 bl.length=358 2021-09-15T22:09:02.665 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.667+0000 7fd40ded3980 20 zonegroup default 2021-09-15T22:09:02.665 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.667+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:02.665 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.667+0000 7fd40ded3980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:02.666 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.667+0000 7fd40ded3980 10 Cannot find current period zone using local zone 2021-09-15T22:09:02.666 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.667+0000 7fd40ded3980 10 Using default name default 2021-09-15T22:09:02.666 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.667+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:02.667 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.667+0000 7fd40ded3980 20 rados_obj.operate() r=0 bl.length=46 2021-09-15T22:09:02.667 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.667+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:02.668 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.667+0000 7fd40ded3980 20 rados_obj.operate() r=0 bl.length=839 2021-09-15T22:09:02.668 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.667+0000 7fd40ded3980 20 zone default found 2021-09-15T22:09:02.668 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:02.667+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:04.645 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:04.647+0000 7fd40ded3980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:04.645 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:04.647+0000 7fd40ded3980 20 rados->read ofs=0 len=0 2021-09-15T22:09:04.646 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:04.647+0000 7fd40ded3980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:04.646 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:04.647+0000 7fd40ded3980 20 started sync module instance, tier type = 2021-09-15T22:09:04.646 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:04.647+0000 7fd40ded3980 20 started zone id=43d83643-4220-4bd0-b2f1-aaea290bbdff (name=default) with tier type = 2021-09-15T22:09:06.680 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:06.679+0000 7fd40ded3980 20 add_watcher() i=0 2021-09-15T22:09:06.680 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:06.679+0000 7fd40ded3980 20 add_watcher() i=1 2021-09-15T22:09:06.680 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:06.679+0000 7fd40ded3980 20 add_watcher() i=2 2021-09-15T22:09:06.681 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:06.679+0000 7fd40ded3980 20 add_watcher() i=3 2021-09-15T22:09:06.681 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:06.679+0000 7fd40ded3980 20 add_watcher() i=4 2021-09-15T22:09:06.681 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:06.679+0000 7fd40ded3980 20 add_watcher() i=5 2021-09-15T22:09:06.681 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:06.679+0000 7fd40ded3980 20 add_watcher() i=6 2021-09-15T22:09:06.682 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:06.683+0000 7fd40ded3980 20 add_watcher() i=7 2021-09-15T22:09:06.683 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:06.683+0000 7fd40ded3980 2 all 8 watchers are set, enabling cache 2021-09-15T22:09:06.683 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:06.683+0000 7fd40ded3980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-09-15T22:09:06.683 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:06.683+0000 7fd40ded3980 20 check_secure_mon_conn(): mode 1 is insecure 2021-09-15T22:09:06.683 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:06.683+0000 7fd3dcfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-09-15T22:09:10.681 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.683+0000 7fd40ded3980 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2021-09-15T22:09:10.761 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.763+0000 7fd34affd700 20 reqs_thread_entry: start 2021-09-15T22:09:10.761 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.763+0000 7fd348ff9700 20 reqs_thread_entry: start 2021-09-15T22:09:10.761 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.763+0000 7fd40ded3980 20 init_complete bucket index max shards: 11 2021-09-15T22:09:10.762 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.763+0000 7fd336ffd700 20 reqs_thread_entry: start 2021-09-15T22:09:10.786 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.787+0000 7fd3dcfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-09-15T22:09:10.788 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.791+0000 7fd40ded3980 20 remove_watcher() i=0 2021-09-15T22:09:10.789 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.791+0000 7fd40ded3980 2 removed watcher, disabling cache 2021-09-15T22:09:10.791 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.791+0000 7fd40ded3980 20 remove_watcher() i=1 2021-09-15T22:09:10.793 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.795+0000 7fd40ded3980 20 remove_watcher() i=2 2021-09-15T22:09:10.796 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.795+0000 7fd40ded3980 20 remove_watcher() i=3 2021-09-15T22:09:10.798 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.799+0000 7fd40ded3980 20 remove_watcher() i=4 2021-09-15T22:09:10.801 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.803+0000 7fd40ded3980 20 remove_watcher() i=5 2021-09-15T22:09:10.803 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.803+0000 7fd40ded3980 20 remove_watcher() i=6 2021-09-15T22:09:10.805 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.807+0000 7fd40ded3980 20 remove_watcher() i=7 2021-09-15T22:09:10.813 INFO:teuthology.orchestra.run.smithi180.stdout:[] 2021-09-15T22:09:10.814 DEBUG:tasks.util.rgw: json result: [] 2021-09-15T22:09:10.814 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-09-15T22:09:10.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-09-15T22:09:10.815 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-09-15T22:09:10.852 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:10.853 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:10.864 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.867+0000 7fa44c744980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-09-15T22:09:10.864 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.867+0000 7fa44c744980 20 check_secure_mon_conn(): mode 1 is insecure 2021-09-15T22:09:10.871 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.871+0000 7fa392ffd700 20 reqs_thread_entry: start 2021-09-15T22:09:10.872 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.871+0000 7fa44c744980 20 rados->read ofs=0 len=0 2021-09-15T22:09:10.873 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.875+0000 7fa44c744980 20 rados_obj.operate() r=0 bl.length=46 2021-09-15T22:09:10.873 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.875+0000 7fa44c744980 20 rados->read ofs=0 len=0 2021-09-15T22:09:10.874 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.875+0000 7fa44c744980 20 rados_obj.operate() r=0 bl.length=839 2021-09-15T22:09:10.874 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.875+0000 7fa44c744980 20 rados->read ofs=0 len=0 2021-09-15T22:09:10.875 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.875+0000 7fa44c744980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:10.875 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.875+0000 7fa44c744980 20 rados->read ofs=0 len=0 2021-09-15T22:09:10.876 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.875+0000 7fa44c744980 20 rados_obj.operate() r=0 bl.length=46 2021-09-15T22:09:10.876 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.875+0000 7fa44c744980 20 rados->read ofs=0 len=0 2021-09-15T22:09:10.876 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:10.875+0000 7fa44c744980 20 rados_obj.operate() r=0 bl.length=358 2021-09-15T22:09:10.885 INFO:teuthology.orchestra.run.smithi180.stdout:{"id":"43d83643-4220-4bd0-b2f1-aaea290bbdff","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-09-15T22:09:10.885 DEBUG:tasks.util.rgw: json result: {'id': '43d83643-4220-4bd0-b2f1-aaea290bbdff', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': ''} 2021-09-15T22:09:10.886 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['user', 'list'] 2021-09-15T22:09:10.886 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'user', 'list'] 2021-09-15T22:09:10.886 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 user list 2021-09-15T22:09:10.936 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:10.937 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:10.949 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:10.946+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:12.374 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.370+0000 7fc7f4daa980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:12.374 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.370+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:12.380 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.378+0000 7fc7f4daa980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:12.381 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.378+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:12.381 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.378+0000 7fc7f4daa980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:12.382 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.378+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:12.382 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.378+0000 7fc7f4daa980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:12.397 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.394+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:12.398 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.394+0000 7fc7f4daa980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:12.399 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.394+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:12.399 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.394+0000 7fc7f4daa980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:12.399 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.394+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:12.399 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.394+0000 7fc7f4daa980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:12.400 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.394+0000 7fc7f4daa980 10 cannot find current period zonegroup using local zonegroup 2021-09-15T22:09:12.400 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.394+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:12.400 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.398+0000 7fc7f4daa980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:12.400 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.398+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:12.400 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.398+0000 7fc7f4daa980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:12.401 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.398+0000 7fc7f4daa980 10 Creating default zonegroup 2021-09-15T22:09:12.401 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.398+0000 7fc7f4daa980 20 get_system_obj_state: rctx=0x7fff44074a20 obj=:.pools.avail state=0x55b01167f820 s->prefetch_data=0 2021-09-15T22:09:12.401 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.398+0000 7fc7f4daa980 10 couldn't find old data placement pools config, setting up new ones for the zone 2021-09-15T22:09:12.410 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.410+0000 7fc7f4daa980 10 WARNING: store->list_zones() returned r=-2 2021-09-15T22:09:12.411 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.410+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:12.411 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.410+0000 7fc7f4daa980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:12.415 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.414+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:12.416 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.414+0000 7fc7f4daa980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:12.417 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.414+0000 7fc7f4daa980 10 could not read realm id: (2) No such file or directory 2021-09-15T22:09:12.417 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.414+0000 7fc7f4daa980 10 WARNING: failed to set zone as default, r=-22 2021-09-15T22:09:12.417 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.414+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:12.417 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.414+0000 7fc7f4daa980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:12.421 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.418+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:12.422 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.422+0000 7fc7f4daa980 20 rados_obj.operate() r=0 bl.length=839 2021-09-15T22:09:12.422 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.422+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:12.424 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.422+0000 7fc7f4daa980 20 rados_obj.operate() r=0 bl.length=358 2021-09-15T22:09:12.424 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.422+0000 7fc7f4daa980 20 zonegroup default 2021-09-15T22:09:12.424 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.422+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:12.424 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.422+0000 7fc7f4daa980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:12.425 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.422+0000 7fc7f4daa980 10 Cannot find current period zone using local zone 2021-09-15T22:09:12.425 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.422+0000 7fc7f4daa980 10 Using default name default 2021-09-15T22:09:12.425 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.422+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:12.426 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.422+0000 7fc7f4daa980 20 rados_obj.operate() r=0 bl.length=46 2021-09-15T22:09:12.426 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.422+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:12.427 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.422+0000 7fc7f4daa980 20 rados_obj.operate() r=0 bl.length=839 2021-09-15T22:09:12.427 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.422+0000 7fc7f4daa980 20 zone default found 2021-09-15T22:09:12.427 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:12.422+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:14.381 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:14.378+0000 7fc7f4daa980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:14.381 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:14.378+0000 7fc7f4daa980 20 rados->read ofs=0 len=0 2021-09-15T22:09:14.386 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:14.386+0000 7fc7f4daa980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:14.386 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:14.386+0000 7fc7f4daa980 20 started sync module instance, tier type = 2021-09-15T22:09:14.387 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:14.386+0000 7fc7f4daa980 20 started zone id=3974cce6-cc37-40b1-ab05-cb0617ee014b (name=default) with tier type = 2021-09-15T22:09:16.444 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:16.442+0000 7fc7f4daa980 20 add_watcher() i=0 2021-09-15T22:09:16.444 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:16.442+0000 7fc7f4daa980 20 add_watcher() i=1 2021-09-15T22:09:16.444 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:16.442+0000 7fc7f4daa980 20 add_watcher() i=2 2021-09-15T22:09:16.444 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:16.442+0000 7fc7f4daa980 20 add_watcher() i=3 2021-09-15T22:09:16.445 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:16.442+0000 7fc7f4daa980 20 add_watcher() i=4 2021-09-15T22:09:16.445 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:16.442+0000 7fc7f4daa980 20 add_watcher() i=5 2021-09-15T22:09:16.445 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:16.442+0000 7fc7f4daa980 20 add_watcher() i=6 2021-09-15T22:09:16.446 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:16.442+0000 7fc7f4daa980 20 add_watcher() i=7 2021-09-15T22:09:16.446 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:16.442+0000 7fc7f4daa980 2 all 8 watchers are set, enabling cache 2021-09-15T22:09:16.447 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:16.442+0000 7fc7f4daa980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-09-15T22:09:16.447 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:16.442+0000 7fc7f4daa980 20 check_secure_mon_conn(): mode 1 is insecure 2021-09-15T22:09:16.447 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:16.442+0000 7fc7c3fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-09-15T22:09:20.418 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.414+0000 7fc7f4daa980 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2021-09-15T22:09:20.514 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.514+0000 7fc7327fc700 20 reqs_thread_entry: start 2021-09-15T22:09:20.515 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.514+0000 7fc71ffff700 20 reqs_thread_entry: start 2021-09-15T22:09:20.515 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.514+0000 7fc7f4daa980 20 init_complete bucket index max shards: 11 2021-09-15T22:09:20.515 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.514+0000 7fc71e7fc700 20 reqs_thread_entry: start 2021-09-15T22:09:20.537 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.534+0000 7fc7c3fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-09-15T22:09:20.540 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.538+0000 7fc7f4daa980 20 remove_watcher() i=0 2021-09-15T22:09:20.540 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.538+0000 7fc7f4daa980 2 removed watcher, disabling cache 2021-09-15T22:09:20.542 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.542+0000 7fc7f4daa980 20 remove_watcher() i=1 2021-09-15T22:09:20.545 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.542+0000 7fc7f4daa980 20 remove_watcher() i=2 2021-09-15T22:09:20.547 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.546+0000 7fc7f4daa980 20 remove_watcher() i=3 2021-09-15T22:09:20.550 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.550+0000 7fc7f4daa980 20 remove_watcher() i=4 2021-09-15T22:09:20.552 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.550+0000 7fc7f4daa980 20 remove_watcher() i=5 2021-09-15T22:09:20.554 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.554+0000 7fc7f4daa980 20 remove_watcher() i=6 2021-09-15T22:09:20.556 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.554+0000 7fc7f4daa980 20 remove_watcher() i=7 2021-09-15T22:09:20.564 INFO:teuthology.orchestra.run.smithi184.stdout:[] 2021-09-15T22:09:20.565 DEBUG:tasks.util.rgw: json result: [] 2021-09-15T22:09:20.565 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-09-15T22:09:20.566 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-09-15T22:09:20.566 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-09-15T22:09:20.604 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:20.604 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:20.618 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.618+0000 7fecf4c83980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-09-15T22:09:20.618 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.618+0000 7fecf4c83980 20 check_secure_mon_conn(): mode 1 is insecure 2021-09-15T22:09:20.627 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.626+0000 7fec3b7fe700 20 reqs_thread_entry: start 2021-09-15T22:09:20.627 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.626+0000 7fecf4c83980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.628 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.626+0000 7fecf4c83980 20 rados_obj.operate() r=0 bl.length=46 2021-09-15T22:09:20.629 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.626+0000 7fecf4c83980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.630 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.626+0000 7fecf4c83980 20 rados_obj.operate() r=0 bl.length=839 2021-09-15T22:09:20.630 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.626+0000 7fecf4c83980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.630 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.630+0000 7fecf4c83980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:20.631 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.630+0000 7fecf4c83980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.631 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.630+0000 7fecf4c83980 20 rados_obj.operate() r=0 bl.length=46 2021-09-15T22:09:20.632 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.630+0000 7fecf4c83980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.632 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.630+0000 7fecf4c83980 20 rados_obj.operate() r=0 bl.length=358 2021-09-15T22:09:20.642 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"3974cce6-cc37-40b1-ab05-cb0617ee014b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-09-15T22:09:20.642 DEBUG:tasks.util.rgw: json result: {'id': '3974cce6-cc37-40b1-ab05-cb0617ee014b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': ''} 2021-09-15T22:09:20.643 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['user', 'list'] 2021-09-15T22:09:20.643 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'user', 'list'] 2021-09-15T22:09:20.643 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 user list 2021-09-15T22:09:20.675 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:20.676 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:20.688 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.686+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.690 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.690+0000 7f5fddff4980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:20.691 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.690+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.691 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.690+0000 7f5fddff4980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:20.692 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.690+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.692 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.690+0000 7f5fddff4980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:20.692 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.690+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.693 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.690+0000 7f5fddff4980 20 rados_obj.operate() r=0 bl.length=46 2021-09-15T22:09:20.711 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.710+0000 7f5fddff4980 20 RGWRados::pool_iterate: got zonegroup_info.c75ddfbe-490d-4d2e-97f6-3f8e019f95d1 2021-09-15T22:09:20.712 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.710+0000 7f5fddff4980 20 RGWRados::pool_iterate: got zone_info.3974cce6-cc37-40b1-ab05-cb0617ee014b 2021-09-15T22:09:20.712 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.710+0000 7f5fddff4980 20 RGWRados::pool_iterate: got zone_names.default 2021-09-15T22:09:20.712 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.710+0000 7f5fddff4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2021-09-15T22:09:20.712 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.710+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.713 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.710+0000 7f5fddff4980 20 rados_obj.operate() r=0 bl.length=46 2021-09-15T22:09:20.714 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.710+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.714 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.710+0000 7f5fddff4980 20 rados_obj.operate() r=0 bl.length=855 2021-09-15T22:09:20.714 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.710+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.714 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.710+0000 7f5fddff4980 20 rados_obj.operate() r=0 bl.length=46 2021-09-15T22:09:20.715 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.710+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.716 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.714+0000 7f5fddff4980 20 rados_obj.operate() r=0 bl.length=358 2021-09-15T22:09:20.716 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.714+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.716 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.714+0000 7f5fddff4980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:20.716 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.714+0000 7f5fddff4980 10 cannot find current period zonegroup using local zonegroup 2021-09-15T22:09:20.716 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.714+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.717 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.714+0000 7f5fddff4980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:20.717 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.714+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.718 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.714+0000 7f5fddff4980 20 rados_obj.operate() r=0 bl.length=46 2021-09-15T22:09:20.718 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.714+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.719 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.714+0000 7f5fddff4980 20 rados_obj.operate() r=0 bl.length=358 2021-09-15T22:09:20.719 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.714+0000 7f5fddff4980 20 zonegroup default 2021-09-15T22:09:20.719 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.714+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.719 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.714+0000 7f5fddff4980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:20.720 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.714+0000 7f5fddff4980 10 Cannot find current period zone using local zone 2021-09-15T22:09:20.720 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.714+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.720 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.714+0000 7f5fddff4980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:20.720 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.714+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.721 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.718+0000 7f5fddff4980 20 rados_obj.operate() r=0 bl.length=46 2021-09-15T22:09:20.721 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.718+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.722 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.718+0000 7f5fddff4980 20 rados_obj.operate() r=0 bl.length=855 2021-09-15T22:09:20.722 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.718+0000 7f5fddff4980 20 zone default found 2021-09-15T22:09:20.722 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.718+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.722 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.718+0000 7f5fddff4980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:20.723 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.718+0000 7f5fddff4980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.723 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.718+0000 7f5fddff4980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:20.723 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.718+0000 7f5fddff4980 20 started sync module instance, tier type = 2021-09-15T22:09:20.723 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.718+0000 7f5fddff4980 20 started zone id=3974cce6-cc37-40b1-ab05-cb0617ee014b (name=default) with tier type = 2021-09-15T22:09:20.737 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.734+0000 7f5fddff4980 20 add_watcher() i=0 2021-09-15T22:09:20.738 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.734+0000 7f5fddff4980 20 add_watcher() i=1 2021-09-15T22:09:20.738 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.734+0000 7f5fddff4980 20 add_watcher() i=2 2021-09-15T22:09:20.738 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.734+0000 7f5fddff4980 20 add_watcher() i=3 2021-09-15T22:09:20.738 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.734+0000 7f5fddff4980 20 add_watcher() i=4 2021-09-15T22:09:20.739 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.734+0000 7f5fddff4980 20 add_watcher() i=5 2021-09-15T22:09:20.739 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.734+0000 7f5fddff4980 20 add_watcher() i=6 2021-09-15T22:09:20.740 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.738+0000 7f5fddff4980 20 add_watcher() i=7 2021-09-15T22:09:20.740 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.738+0000 7f5fddff4980 2 all 8 watchers are set, enabling cache 2021-09-15T22:09:20.740 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.738+0000 7f5fddff4980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-09-15T22:09:20.740 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.738+0000 7f5fddff4980 20 check_secure_mon_conn(): mode 1 is insecure 2021-09-15T22:09:20.741 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.738+0000 7f5facfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-09-15T22:09:20.811 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.809+0000 7f5f1effd700 20 reqs_thread_entry: start 2021-09-15T22:09:20.812 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.809+0000 7f5fddff4980 20 init_complete bucket index max shards: 11 2021-09-15T22:09:20.812 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.809+0000 7f5f12ffd700 20 reqs_thread_entry: start 2021-09-15T22:09:20.812 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.809+0000 7f5f1cff9700 20 reqs_thread_entry: start 2021-09-15T22:09:20.834 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.833+0000 7f5facfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-09-15T22:09:20.837 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.833+0000 7f5fddff4980 20 remove_watcher() i=0 2021-09-15T22:09:20.837 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.833+0000 7f5fddff4980 2 removed watcher, disabling cache 2021-09-15T22:09:20.839 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.837+0000 7f5fddff4980 20 remove_watcher() i=1 2021-09-15T22:09:20.842 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.837+0000 7f5fddff4980 20 remove_watcher() i=2 2021-09-15T22:09:20.844 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.841+0000 7f5fddff4980 20 remove_watcher() i=3 2021-09-15T22:09:20.847 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.845+0000 7f5fddff4980 20 remove_watcher() i=4 2021-09-15T22:09:20.849 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.845+0000 7f5fddff4980 20 remove_watcher() i=5 2021-09-15T22:09:20.851 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.849+0000 7f5fddff4980 20 remove_watcher() i=6 2021-09-15T22:09:20.853 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.849+0000 7f5fddff4980 20 remove_watcher() i=7 2021-09-15T22:09:20.862 INFO:teuthology.orchestra.run.smithi184.stdout:[] 2021-09-15T22:09:20.862 DEBUG:tasks.util.rgw: json result: [] 2021-09-15T22:09:20.863 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-09-15T22:09:20.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-09-15T22:09:20.863 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-09-15T22:09:20.944 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:20.944 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:20.956 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.953+0000 7fc7e638c980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-09-15T22:09:20.956 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.953+0000 7fc7e638c980 20 check_secure_mon_conn(): mode 1 is insecure 2021-09-15T22:09:20.963 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.961+0000 7fc7e638c980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.963 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.961+0000 7fc727fff700 20 reqs_thread_entry: start 2021-09-15T22:09:20.965 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.961+0000 7fc7e638c980 20 rados_obj.operate() r=0 bl.length=46 2021-09-15T22:09:20.965 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.961+0000 7fc7e638c980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.966 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.961+0000 7fc7e638c980 20 rados_obj.operate() r=0 bl.length=855 2021-09-15T22:09:20.966 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.961+0000 7fc7e638c980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.967 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.965+0000 7fc7e638c980 20 rados_obj.operate() r=-2 bl.length=0 2021-09-15T22:09:20.967 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.965+0000 7fc7e638c980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.968 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.965+0000 7fc7e638c980 20 rados_obj.operate() r=0 bl.length=46 2021-09-15T22:09:20.968 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.965+0000 7fc7e638c980 20 rados->read ofs=0 len=0 2021-09-15T22:09:20.968 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:20.965+0000 7fc7e638c980 20 rados_obj.operate() r=0 bl.length=358 2021-09-15T22:09:20.977 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"3974cce6-cc37-40b1-ab05-cb0617ee014b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-09-15T22:09:20.978 DEBUG:tasks.util.rgw: json result: {'id': '3974cce6-cc37-40b1-ab05-cb0617ee014b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': ''} 2021-09-15T22:09:20.978 INFO:tasks.rgw:Starting rgw... 2021-09-15T22:09:20.979 INFO:tasks.rgw:rgw c1.client.0 config is {'port': 8000} 2021-09-15T22:09:20.979 INFO:tasks.rgw:Using beast as radosgw frontend 2021-09-15T22:09:20.979 INFO:tasks.rgw.c1.client.0:Restarting daemon 2021-09-15T22:09:20.980 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2021-09-15T22:09:20.983 INFO:tasks.rgw.c1.client.0:Started 2021-09-15T22:09:20.983 INFO:tasks.rgw:rgw c2.client.0 config is {'port': 8000} 2021-09-15T22:09:20.983 INFO:tasks.rgw:Using beast as radosgw frontend 2021-09-15T22:09:20.984 INFO:tasks.rgw.c2.client.0:Restarting daemon 2021-09-15T22:09:20.984 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2021-09-15T22:09:20.986 INFO:tasks.rgw.c2.client.0:Started 2021-09-15T22:09:20.987 INFO:tasks.rgw:rgw c2.client.1 config is {'port': 8001} 2021-09-15T22:09:20.987 INFO:tasks.rgw:Using beast as radosgw frontend 2021-09-15T22:09:20.987 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-09-15T22:09:20.988 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-09-15T22:09:20.990 INFO:tasks.rgw.c2.client.1:Started 2021-09-15T22:09:20.990 INFO:tasks.rgw:Polling c1.client.0 until it starts accepting connections on http://smithi180.front.sepia.ceph.com:8000/ 2021-09-15T22:09:20.991 DEBUG:teuthology.orchestra.run.smithi180:> curl http://smithi180.front.sepia.ceph.com:8000/ 2021-09-15T22:09:21.021 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-09-15T22:09:21.022 INFO:teuthology.orchestra.run.smithi180.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-09-15T22:09:21.022 INFO:teuthology.orchestra.run.smithi180.stderr: Dload Upload Total Spent Left Speed 2021-09-15T22:09:21.022 INFO:teuthology.orchestra.run.smithi180.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-09-15T22:09:21.023 INFO:teuthology.orchestra.run.smithi180.stderr:curl: (7) Failed to connect to smithi180.front.sepia.ceph.com port 8000: Connection refused 2021-09-15T22:09:22.024 DEBUG:teuthology.orchestra.run.smithi180:> curl http://smithi180.front.sepia.ceph.com:8000/ 2021-09-15T22:09:22.042 INFO:teuthology.orchestra.run.smithi180.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-09-15T22:09:22.042 INFO:teuthology.orchestra.run.smithi180.stderr: Dload Upload Total Spent Left Speed 2021-09-15T22:09:22.044 INFO:teuthology.orchestra.run.smithi180.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2021-09-15T22:09:22.045 INFO:teuthology.orchestra.run.smithi180.stdout:anonymous 2021-09-15T22:09:22.046 INFO:tasks.rgw:Polling c2.client.0 until it starts accepting connections on http://smithi184.front.sepia.ceph.com:8000/ 2021-09-15T22:09:22.046 DEBUG:teuthology.orchestra.run.smithi184:> curl http://smithi184.front.sepia.ceph.com:8000/ 2021-09-15T22:09:22.076 INFO:teuthology.orchestra.run.smithi184.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-09-15T22:09:22.076 INFO:teuthology.orchestra.run.smithi184.stderr: Dload Upload Total Spent Left Speed 2021-09-15T22:09:22.080 INFO:teuthology.orchestra.run.smithi184.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2021-09-15T22:09:22.080 INFO:teuthology.orchestra.run.smithi184.stdout:anonymous 2021-09-15T22:09:22.081 INFO:tasks.rgw:Polling c2.client.1 until it starts accepting connections on http://smithi184.front.sepia.ceph.com:8001/ 2021-09-15T22:09:22.082 DEBUG:teuthology.orchestra.run.smithi184:> curl http://smithi184.front.sepia.ceph.com:8001/ 2021-09-15T22:09:22.140 INFO:teuthology.orchestra.run.smithi184.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-09-15T22:09:22.140 INFO:teuthology.orchestra.run.smithi184.stderr: Dload Upload Total Spent Left Speed 2021-09-15T22:09:22.142 INFO:teuthology.orchestra.run.smithi184.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 104k 0 --:--:-- --:--:-- --:--:-- 208k 2021-09-15T22:09:22.143 INFO:teuthology.orchestra.run.smithi184.stdout:anonymous 2021-09-15T22:09:22.143 INFO:teuthology.run_tasks:Running task rgw-multisite... 2021-09-15T22:09:22.298 INFO:tasks.rgw_multisite:creating realm.. 2021-09-15T22:09:22.299 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:22.300 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:22.300 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 realm create --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:09:22.338 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:22.338 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:22.382 INFO:teuthology.orchestra.run.smithi180.stdout:{"id":"7b8f35c2-e353-409a-bb72-b775418364c6","name":"test-realm","current_period":"fe37017c-2b04-4a42-ad5d-81817a1bd0d6","epoch":1} 2021-09-15T22:09:22.382 INFO:tasks.rgw_multisite:creating master zonegroup.. 2021-09-15T22:09:22.383 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:22.383 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:22.384 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup set --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:09:22.418 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:22.418 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:22.440 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:09:22.442+0000 7fd1b99f2980 -1 old format 2021-09-15T22:09:22.455 INFO:teuthology.orchestra.run.smithi180.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[],"default_placement":"","realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","sync_policy":{"groups":[]}} 2021-09-15T22:09:22.455 INFO:tasks.rgw_multisite:creating master zone.. 2021-09-15T22:09:22.456 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', '05C2LIV22Q1515AF', '--secret', 'bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk', '--endpoints', 'http://smithi180.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:22.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', '05C2LIV22Q1515AF', '--secret', 'bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk', '--endpoints', 'http://smithi180.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:22.456 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --master --access-key 05C2LIV22Q1515AF --secret bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk --endpoints http://smithi180.front.sepia.ceph.com:8000 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:09:22.499 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:22.500 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:22.564 INFO:teuthology.orchestra.run.smithi180.stdout:{"id":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"05C2LIV22Q1515AF","secret_key":"bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6"} 2021-09-15T22:09:22.564 DEBUG:teuthology.orchestra.run.smithi180:> sudo ceph osd pool create test-zone1.rgw.buckets.data 64 64 --cluster c1 2021-09-15T22:09:23.440 INFO:teuthology.orchestra.run.smithi180.stderr:pool 'test-zone1.rgw.buckets.data' created 2021-09-15T22:09:23.453 DEBUG:teuthology.orchestra.run.smithi180:> sudo ceph osd pool application enable test-zone1.rgw.buckets.data rgw --cluster c1 2021-09-15T22:09:24.455 INFO:teuthology.orchestra.run.smithi180.stderr:enabled application 'rgw' on pool 'test-zone1.rgw.buckets.data' 2021-09-15T22:09:24.478 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:24.479 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:24.479 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:09:24.513 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:24.514 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:24.542 INFO:teuthology.orchestra.run.smithi180.stdout:{"id":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"05C2LIV22Q1515AF","secret_key":"bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-09-15T22:09:24.543 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:24.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:24.544 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:09:24.619 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:24.619 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:32.670 INFO:teuthology.orchestra.run.smithi180.stdout:{"id":"af209127-5081-4e40-be50-bf8d6eadaece","epoch":1,"predecessor_uuid":"fe37017c-2b04-4a42-ad5d-81817a1bd0d6","sync_status":[],"period_map":{"id":"af209127-5081-4e40-be50-bf8d6eadaece","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","zones":[{"id":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","name":"test-zone1","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"false","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","val":3863291254}]},"master_zonegroup":"test-zonegroup","master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","realm_name":"test-realm","realm_epoch":2} 2021-09-15T22:09:32.671 DEBUG:tasks.rgw.c1.client.0:waiting for process to exit 2021-09-15T22:09:32.672 INFO:teuthology.orchestra.run:waiting for 300 2021-09-15T22:09:32.673 INFO:tasks.rgw.c1.client.0.smithi180.stdout:2021-09-15T22:09:32.683+0000 7f5b177fe700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground (PID: 13421) UID: 0 2021-09-15T22:09:32.673 INFO:tasks.rgw.c1.client.0.smithi180.stdout:2021-09-15T22:09:32.683+0000 7f5b1ffb4980 -1 shutting down 2021-09-15T22:09:36.281 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 is failed for ~0s 2021-09-15T22:09:38.773 INFO:tasks.rgw.c1.client.0:Stopped 2021-09-15T22:09:38.774 INFO:tasks.rgw.c1.client.0:Restarting daemon 2021-09-15T22:09:38.774 DEBUG:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2021-09-15T22:09:38.777 INFO:tasks.rgw.c1.client.0:Started 2021-09-15T22:09:38.778 DEBUG:teuthology.orchestra.run.smithi180:> curl http://smithi180.front.sepia.ceph.com:8000 2021-09-15T22:09:38.796 INFO:teuthology.orchestra.run.smithi180.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-09-15T22:09:38.797 INFO:teuthology.orchestra.run.smithi180.stderr: Dload Upload Total Spent Left Speed 2021-09-15T22:09:38.797 INFO:teuthology.orchestra.run.smithi180.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-09-15T22:09:38.798 INFO:teuthology.orchestra.run.smithi180.stderr:curl: (7) Failed to connect to smithi180.front.sepia.ceph.com port 8000: Connection refused 2021-09-15T22:09:38.799 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-09-15T22:09:39.801 DEBUG:teuthology.orchestra.run.smithi180:> curl http://smithi180.front.sepia.ceph.com:8000 2021-09-15T22:09:39.818 INFO:teuthology.orchestra.run.smithi180.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-09-15T22:09:39.819 INFO:teuthology.orchestra.run.smithi180.stderr: Dload Upload Total Spent Left Speed 2021-09-15T22:09:39.842 INFO:teuthology.orchestra.run.smithi180.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 9304 0 --:--:-- --:--:-- --:--:-- 9304 2021-09-15T22:09:39.843 INFO:teuthology.orchestra.run.smithi180.stdout:anonymous 2021-09-15T22:09:39.844 INFO:tasks.rgw_multisite:creating admin user.. 2021-09-15T22:09:39.844 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', '05C2LIV22Q1515AF', '--secret', 'bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:39.845 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', '05C2LIV22Q1515AF', '--secret', 'bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:39.845 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid realm-admin --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Realm Admin' --system --access-key 05C2LIV22Q1515AF --secret bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:09:39.891 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:39.891 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:40.040 INFO:teuthology.orchestra.run.smithi180.stdout:{"user_id":"realm-admin","display_name":"Realm Admin","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"realm-admin","access_key":"05C2LIV22Q1515AF","secret_key":"bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","system":"true","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2021-09-15T22:09:40.065 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2021-09-15T22:09:40.066 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi180.front.sepia.ceph.com:8000', '--access-key', '05C2LIV22Q1515AF', '--secret', 'bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:40.066 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi180.front.sepia.ceph.com:8000', '--access-key', '05C2LIV22Q1515AF', '--secret', 'bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:40.067 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://smithi180.front.sepia.ceph.com:8000 --access-key 05C2LIV22Q1515AF --secret bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:09:40.109 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:40.109 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:40.188 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"7b8f35c2-e353-409a-bb72-b775418364c6","name":"test-realm","current_period":"af209127-5081-4e40-be50-bf8d6eadaece","epoch":2} 2021-09-15T22:09:40.189 INFO:tasks.rgw_multisite:creating zone.. 2021-09-15T22:09:40.189 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', '05C2LIV22Q1515AF', '--secret', 'bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk', '--endpoints', 'http://smithi184.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:40.189 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', '05C2LIV22Q1515AF', '--secret', 'bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk', '--endpoints', 'http://smithi184.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:40.190 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --access-key 05C2LIV22Q1515AF --secret bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk --endpoints http://smithi184.front.sepia.ceph.com:8000 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:09:40.230 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:40.230 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:40.282 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:40.276+0000 7f5d5fe85980 0 failed reading obj info from .rgw.root:zone_info.4de7baf2-0fdf-417b-9ffb-8497dcfb5977: (2) No such file or directory 2021-09-15T22:09:40.282 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:40.276+0000 7f5d5fe85980 0 WARNING: could not read zone params for zone id=4de7baf2-0fdf-417b-9ffb-8497dcfb5977 name=test-zone1 2021-09-15T22:09:40.295 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"05C2LIV22Q1515AF","secret_key":"bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6"} 2021-09-15T22:09:40.296 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph osd pool create test-zone2.rgw.buckets.data 64 64 --cluster c2 2021-09-15T22:09:41.493 INFO:teuthology.orchestra.run.smithi184.stderr:pool 'test-zone2.rgw.buckets.data' created 2021-09-15T22:09:41.511 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph osd pool application enable test-zone2.rgw.buckets.data rgw --cluster c2 2021-09-15T22:09:41.887 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 has been restored 2021-09-15T22:09:42.515 INFO:teuthology.orchestra.run.smithi184.stderr:enabled application 'rgw' on pool 'test-zone2.rgw.buckets.data' 2021-09-15T22:09:42.526 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:42.526 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:42.527 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:09:42.561 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:42.561 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:42.589 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"05C2LIV22Q1515AF","secret_key":"bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-09-15T22:09:42.590 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:42.590 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:42.591 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:09:42.673 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:42.674 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:50.673 INFO:teuthology.orchestra.run.smithi184.stderr:Sending period to new master zone 4de7baf2-0fdf-417b-9ffb-8497dcfb5977 2021-09-15T22:09:50.756 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"af209127-5081-4e40-be50-bf8d6eadaece","epoch":2,"predecessor_uuid":"fe37017c-2b04-4a42-ad5d-81817a1bd0d6","sync_status":[],"period_map":{"id":"af209127-5081-4e40-be50-bf8d6eadaece","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","zones":[{"id":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","name":"test-zone1","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","endpoints":["http://smithi184.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","val":3863291254},{"key":"4f4b61b1-d30a-4c5f-906c-596bca64c691","val":24034659}]},"master_zonegroup":"test-zonegroup","master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","realm_name":"test-realm","realm_epoch":2} 2021-09-15T22:09:50.757 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2021-09-15T22:09:50.758 INFO:teuthology.orchestra.run:waiting for 300 2021-09-15T22:09:50.758 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:09:50.752+0000 7f13dffff700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground (PID: 14054) UID: 0 2021-09-15T22:09:50.759 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:09:50.752+0000 7f13f07c9980 -1 shutting down 2021-09-15T22:09:55.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2021-09-15T22:09:56.859 INFO:tasks.rgw.c2.client.0:Stopped 2021-09-15T22:09:56.860 INFO:tasks.rgw.c2.client.0:Restarting daemon 2021-09-15T22:09:56.861 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2021-09-15T22:09:56.864 INFO:tasks.rgw.c2.client.0:Started 2021-09-15T22:09:56.864 DEBUG:teuthology.orchestra.run.smithi184:> curl http://smithi184.front.sepia.ceph.com:8000 2021-09-15T22:09:56.882 INFO:teuthology.orchestra.run.smithi184.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-09-15T22:09:56.882 INFO:teuthology.orchestra.run.smithi184.stderr: Dload Upload Total Spent Left Speed 2021-09-15T22:09:56.883 INFO:teuthology.orchestra.run.smithi184.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-09-15T22:09:56.883 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-09-15T22:09:56.884 INFO:teuthology.orchestra.run.smithi184.stderr:curl: (7) Failed to connect to smithi184.front.sepia.ceph.com port 8000: Connection refused 2021-09-15T22:09:57.886 DEBUG:teuthology.orchestra.run.smithi184:> curl http://smithi184.front.sepia.ceph.com:8000 2021-09-15T22:09:57.905 INFO:teuthology.orchestra.run.smithi184.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-09-15T22:09:57.905 INFO:teuthology.orchestra.run.smithi184.stderr: Dload Upload Total Spent Left Speed 2021-09-15T22:09:57.906 INFO:teuthology.orchestra.run.smithi184.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2021-09-15T22:09:57.908 INFO:teuthology.orchestra.run.smithi184.stdout:anonymous 2021-09-15T22:09:57.908 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2021-09-15T22:09:57.908 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi180.front.sepia.ceph.com:8000', '--access-key', '05C2LIV22Q1515AF', '--secret', 'bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk', '--url', 'http://smithi180.front.sepia.ceph.com:8000', '--access-key', '05C2LIV22Q1515AF', '--secret', 'bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:57.909 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi180.front.sepia.ceph.com:8000', '--access-key', '05C2LIV22Q1515AF', '--secret', 'bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk', '--url', 'http://smithi180.front.sepia.ceph.com:8000', '--access-key', '05C2LIV22Q1515AF', '--secret', 'bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:57.909 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://smithi180.front.sepia.ceph.com:8000 --access-key 05C2LIV22Q1515AF --secret bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk --url http://smithi180.front.sepia.ceph.com:8000 --access-key 05C2LIV22Q1515AF --secret bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:09:57.951 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:57.952 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:57.994 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:09:57.988+0000 7fd873606700 -1 rgw realm watcher: RGWRealmWatcher::handle_error oid=realms.7b8f35c2-e353-409a-bb72-b775418364c6.control err=-107 2021-09-15T22:09:58.016 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"7b8f35c2-e353-409a-bb72-b775418364c6","name":"test-realm","current_period":"af209127-5081-4e40-be50-bf8d6eadaece","epoch":2} 2021-09-15T22:09:58.017 INFO:tasks.rgw_multisite:creating zone.. 2021-09-15T22:09:58.017 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', '05C2LIV22Q1515AF', '--secret', 'bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk', '--endpoints', 'http://smithi184.front.sepia.ceph.com:8001', '--tier-type', 'pubsub', '--sync-from-all=0', '--sync-from', 'test-zone1', '--tier-config', 'start_with_full_sync=false,event_retention_days=7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:58.018 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', '05C2LIV22Q1515AF', '--secret', 'bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk', '--endpoints', 'http://smithi184.front.sepia.ceph.com:8001', '--tier-type', 'pubsub', '--sync-from-all=0', '--sync-from', 'test-zone1', '--tier-config', 'start_with_full_sync=false,event_retention_days=7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:09:58.019 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key 05C2LIV22Q1515AF --secret bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk --endpoints http://smithi184.front.sepia.ceph.com:8001 --tier-type pubsub --sync-from-all=0 --sync-from test-zone1 --tier-config start_with_full_sync=false,event_retention_days=7 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:09:58.069 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:09:58.070 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:09:58.125 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:58.120+0000 7f8a53054980 0 failed reading obj info from .rgw.root:zone_info.4de7baf2-0fdf-417b-9ffb-8497dcfb5977: (2) No such file or directory 2021-09-15T22:09:58.125 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:09:58.120+0000 7f8a53054980 0 WARNING: could not read zone params for zone id=4de7baf2-0fdf-417b-9ffb-8497dcfb5977 name=test-zone1 2021-09-15T22:09:58.137 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","name":"test-zone3","domain_root":"test-zone3.rgw.meta:root","control_pool":"test-zone3.rgw.control","gc_pool":"test-zone3.rgw.log:gc","lc_pool":"test-zone3.rgw.log:lc","log_pool":"test-zone3.rgw.log","intent_log_pool":"test-zone3.rgw.log:intent","usage_log_pool":"test-zone3.rgw.log:usage","roles_pool":"test-zone3.rgw.meta:roles","reshard_pool":"test-zone3.rgw.log:reshard","user_keys_pool":"test-zone3.rgw.meta:users.keys","user_email_pool":"test-zone3.rgw.meta:users.email","user_swift_pool":"test-zone3.rgw.meta:users.swift","user_uid_pool":"test-zone3.rgw.meta:users.uid","otp_pool":"test-zone3.rgw.otp","system_key":{"access_key":"05C2LIV22Q1515AF","secret_key":"bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone3.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone3.rgw.buckets.data"}},"data_extra_pool":"test-zone3.rgw.buckets.non-ec","index_type":0}}],"tier_config":{"event_retention_days":7,"start_with_full_sync":false},"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6"} 2021-09-15T22:09:58.137 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph osd pool create test-zone3.rgw.buckets.data 64 64 --cluster c2 2021-09-15T22:09:59.328 INFO:teuthology.orchestra.run.smithi184.stderr:pool 'test-zone3.rgw.buckets.data' created 2021-09-15T22:09:59.343 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph osd pool application enable test-zone3.rgw.buckets.data rgw --cluster c2 2021-09-15T22:10:00.358 INFO:teuthology.orchestra.run.smithi184.stderr:enabled application 'rgw' on pool 'test-zone3.rgw.buckets.data' 2021-09-15T22:10:00.377 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:10:00.378 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:10:00.378 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:10:00.412 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:10:00.413 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:10:00.442 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","name":"test-zone3","domain_root":"test-zone3.rgw.meta:root","control_pool":"test-zone3.rgw.control","gc_pool":"test-zone3.rgw.log:gc","lc_pool":"test-zone3.rgw.log:lc","log_pool":"test-zone3.rgw.log","intent_log_pool":"test-zone3.rgw.log:intent","usage_log_pool":"test-zone3.rgw.log:usage","roles_pool":"test-zone3.rgw.meta:roles","reshard_pool":"test-zone3.rgw.log:reshard","user_keys_pool":"test-zone3.rgw.meta:users.keys","user_email_pool":"test-zone3.rgw.meta:users.email","user_swift_pool":"test-zone3.rgw.meta:users.swift","user_uid_pool":"test-zone3.rgw.meta:users.uid","otp_pool":"test-zone3.rgw.otp","system_key":{"access_key":"05C2LIV22Q1515AF","secret_key":"bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone3.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone3.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone3.rgw.buckets.non-ec","index_type":0}}],"tier_config":{"event_retention_days":7,"start_with_full_sync":false},"realm_id":""} 2021-09-15T22:10:00.442 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:10:00.443 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:10:00.443 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:10:00.479 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:10:00.479 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:10:01.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2021-09-15T22:10:08.522 INFO:teuthology.orchestra.run.smithi184.stderr:Sending period to new master zone 4de7baf2-0fdf-417b-9ffb-8497dcfb5977 2021-09-15T22:10:08.605 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"af209127-5081-4e40-be50-bf8d6eadaece","epoch":3,"predecessor_uuid":"fe37017c-2b04-4a42-ad5d-81817a1bd0d6","sync_status":[],"period_map":{"id":"af209127-5081-4e40-be50-bf8d6eadaece","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","zones":[{"id":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","name":"test-zone1","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","endpoints":["http://smithi184.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","name":"test-zone3","endpoints":["http://smithi184.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","val":3863291254},{"key":"4f4b61b1-d30a-4c5f-906c-596bca64c691","val":24034659},{"key":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","val":3190180025}]},"master_zonegroup":"test-zonegroup","master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","realm_name":"test-realm","realm_epoch":2} 2021-09-15T22:10:08.606 DEBUG:tasks.rgw.c2.client.1:waiting for process to exit 2021-09-15T22:10:08.607 INFO:teuthology.orchestra.run:waiting for 300 2021-09-15T22:10:08.647 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:10:08.644+0000 7f9461ad1700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground (PID: 14057) UID: 0 2021-09-15T22:10:08.648 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:10:08.644+0000 7f9465eab980 -1 shutting down 2021-09-15T22:10:12.849 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 is failed for ~0s 2021-09-15T22:10:14.709 INFO:tasks.rgw.c2.client.1:Stopped 2021-09-15T22:10:14.709 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-09-15T22:10:14.710 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-09-15T22:10:14.713 INFO:tasks.rgw.c2.client.1:Started 2021-09-15T22:10:14.713 DEBUG:teuthology.orchestra.run.smithi184:> curl http://smithi184.front.sepia.ceph.com:8001 2021-09-15T22:10:14.730 INFO:teuthology.orchestra.run.smithi184.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-09-15T22:10:14.731 INFO:teuthology.orchestra.run.smithi184.stderr: Dload Upload Total Spent Left Speed 2021-09-15T22:10:14.731 INFO:teuthology.orchestra.run.smithi184.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-09-15T22:10:14.732 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-09-15T22:10:14.732 INFO:teuthology.orchestra.run.smithi184.stderr:curl: (7) Failed to connect to smithi184.front.sepia.ceph.com port 8001: Connection refused 2021-09-15T22:10:15.734 DEBUG:teuthology.orchestra.run.smithi184:> curl http://smithi184.front.sepia.ceph.com:8001 2021-09-15T22:10:15.752 INFO:teuthology.orchestra.run.smithi184.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-09-15T22:10:15.753 INFO:teuthology.orchestra.run.smithi184.stderr: Dload Upload Total Spent Left Speed 2021-09-15T22:10:15.754 INFO:teuthology.orchestra.run.smithi184.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 134 100 134 0 0 130k 0 --:--:-- --:--:-- --:--:-- 130k 2021-09-15T22:10:15.755 INFO:teuthology.orchestra.run.smithi184.stdout:{"Code":"MethodNotAllowed","RequestId":"tx000000000000000000001-0061426f47-10e5-test-zone3","HostId":"10e5-test-zone3-test-zonegroup"} 2021-09-15T22:10:15.755 INFO:tasks.rgw_multisite:rgw multisite configuration completed 2021-09-15T22:10:15.755 INFO:teuthology.run_tasks:Running task rgw-multisite-tests... 2021-09-15T22:10:15.770 INFO:tasks.rgw_multisite_tests:cloning suite branch octopus from https://github.com/ceph/ceph.git... 2021-09-15T22:10:15.771 DEBUG:teuthology.repo_utils:Setting repo remote to https://github.com/ceph/ceph.git 2021-09-15T22:10:15.778 INFO:teuthology.repo_utils:Fetching octopus from origin 2021-09-15T22:10:16.944 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/github.com_ceph_ceph_octopus to origin/octopus 2021-09-15T22:10:17.043 INFO:tasks.rgw_multisite_tests:importing tests from /home/teuthworker/src/github.com_ceph_ceph_octopus/src/test/rgw/rgw_multi 2021-09-15T22:10:17.066 INFO:tasks.rgw_multisite_tests:creating test user.. 2021-09-15T22:10:17.066 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:10:17.067 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:10:17.068 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid rgw-multisite-test-user --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Multisite Test User' --gen-access-key --gen-secret --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:10:17.111 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:10:17.111 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:10:17.272 INFO:teuthology.orchestra.run.smithi180.stdout:{"user_id":"rgw-multisite-test-user","display_name":"Multisite Test User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"rgw-multisite-test-user","access_key":"RJYNA81H0YC6K74IW78Y","secret_key":"CdY5WVEE569LZ50MmnrglWbHpppnI1XCPGk0gKAd"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2021-09-15T22:10:17.296 INFO:rgw_multi.tests:meta checkpoint 2021-09-15T22:10:17.298 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:17.298 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:17.299 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:10:17.337 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:10:17.337 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:10:17.479 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:10:17.507 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:10:17.508 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:10:17.508 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:17.509 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:17.509 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:10:17.550 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:10:17.551 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:10:17.741 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:10:17.742 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:10:18.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 has been restored 2021-09-15T22:10:22.744 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:22.745 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:22.745 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:10:22.787 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:10:22.787 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:10:22.985 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:10:22.985 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:10:27.987 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:27.988 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:27.988 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:10:28.026 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:10:28.027 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:10:28.224 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:10:28.225 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:10:33.226 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:33.227 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:33.228 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:10:33.267 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:10:33.267 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:10:33.471 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:10:33.471 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:10:38.473 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:38.474 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:38.474 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:10:38.513 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:10:38.513 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:10:38.687 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:10:38.688 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:10:43.688 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:43.689 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:43.690 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:10:43.731 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:10:43.732 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:10:43.926 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:10:43.927 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:10:48.928 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:48.929 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:48.929 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:10:48.970 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:10:48.970 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:10:49.152 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:10:49.153 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:10:54.154 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:54.154 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:54.155 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:10:54.194 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:10:54.195 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:10:54.381 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:10:54.382 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:10:59.383 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:59.384 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:10:59.385 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:10:59.424 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:10:59.523 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:10:59.622 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:10:59.623 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:11:04.623 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:04.624 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:04.625 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:11:04.665 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:11:04.665 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:11:04.853 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:11:04.854 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:11:09.855 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:09.856 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:09.857 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:11:09.902 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:11:09.903 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:11:10.092 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:11:10.092 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:11:15.094 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:15.094 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:15.095 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:11:15.132 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:11:15.133 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:11:15.340 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:11:15.340 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:11:20.341 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:20.342 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:20.343 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:11:20.386 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:11:20.386 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:11:20.567 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:11:20.568 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:11:25.569 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:25.570 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:25.570 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:11:25.609 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:11:25.610 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:11:25.796 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:11:25.797 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:11:30.798 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:30.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:30.799 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:11:30.839 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:11:30.839 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:11:31.031 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:11:31.031 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:11:36.033 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:36.034 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:36.034 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:11:36.075 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:11:36.075 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:11:36.265 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:11:36.265 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:11:41.267 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:41.267 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:41.268 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:11:41.306 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:11:41.306 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:11:41.507 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:11:41.508 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:11:46.509 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:46.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:46.511 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:11:46.552 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:11:46.552 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:11:46.758 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:11:46.759 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:11:51.760 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:51.761 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:51.761 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:11:51.800 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:11:51.801 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:11:52.006 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:11:52.007 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:11:57.008 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:57.009 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:11:57.010 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:11:57.053 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:11:57.054 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:11:57.234 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:11:57.235 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:12:02.237 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:02.238 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:02.241 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:02.281 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:02.281 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:02.465 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:02.466 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:12:07.470 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:07.471 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:07.471 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:07.511 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:07.511 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:07.700 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:07.701 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1631743817.278003_20.1 target= 2021-09-15T22:12:12.702 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:12.703 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:12.704 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:12.744 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:12.744 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:12.948 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:12.949 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:12:12.949 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:12:12.950 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:12.950 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:12.951 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:12.989 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:12.989 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:13.198 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:13.198 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:12:13.199 INFO:rgw_multi.tests:meta checkpoint 2021-09-15T22:12:13.199 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:13.200 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:13.200 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:13.239 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:13.239 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:13.386 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:12:13.415 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:12:13.415 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:12:13.416 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:13.416 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:13.416 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:13.455 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:13.456 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:13.642 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:13.643 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:12:13.644 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:12:13.644 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:13.644 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:13.645 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:13.723 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:13.723 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:13.918 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:13.919 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:12:13.919 INFO:tasks.rgw_multisite_tests:running rgw multisite tests on '/home/teuthworker/src/github.com_ceph_ceph_octopus/src/test/rgw/rgw_multi' with args=['tests.py', 'tests_ps.py'] 2021-09-15T22:12:13.996 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-1 2021-09-15T22:12:17.657 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-2 2021-09-15T22:12:21.492 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:21.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:21.493 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:21.540 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:21.542 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:21.679 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:12:21.707 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631743937.695821_64.1","last_update":"2021-09-15T22:12:17.695821Z"}] 2021-09-15T22:12:21.707 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:12:21.708 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:21.708 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:21.709 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:21.751 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:21.752 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:21.950 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743937.695821_64.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:17.695821Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:21.950 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:12:21.951 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:12:21.952 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:21.952 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:21.953 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:22.035 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:22.036 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:22.226 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743937.695821_64.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:17.695821Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:22.227 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:12:22.248 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_create ... ok 2021-09-15T22:12:22.249 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-3 2021-09-15T22:12:22.274 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-4 2021-09-15T22:12:22.317 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:22.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:22.318 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:22.358 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:22.359 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:22.499 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:12:22.527 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631743942.312355_74.1","last_update":"2021-09-15T22:12:22.312355Z"}] 2021-09-15T22:12:22.528 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:12:22.528 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:22.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:22.529 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:22.564 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:22.564 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:22.760 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743942.312355_74.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:22.312355Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:22.760 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:12:22.761 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:12:22.761 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:22.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:22.762 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:22.800 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:22.800 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:22.981 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743942.312355_74.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:22.312355Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:22.981 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:12:23.176 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:23.177 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:23.178 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:23.216 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:23.216 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:23.366 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:12:23.395 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631743943.146773_94.1","last_update":"2021-09-15T22:12:23.146773Z"}] 2021-09-15T22:12:23.396 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:12:23.397 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:23.397 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:23.398 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:23.436 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:23.437 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:23.623 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743943.146773_94.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:23.146773Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:23.623 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:12:23.624 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:12:23.624 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:23.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:23.625 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:23.665 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:23.666 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:23.851 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743943.146773_94.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:23.146773Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:23.852 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:12:23.871 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_recreate ... ok 2021-09-15T22:12:23.872 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-5 2021-09-15T22:12:23.901 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-6 2021-09-15T22:12:23.943 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:23.944 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:23.945 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:23.985 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:23.985 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:24.130 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:12:24.159 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631743943.939854_105.1","last_update":"2021-09-15T22:12:23.939854Z"}] 2021-09-15T22:12:24.160 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:12:24.160 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:24.161 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:24.161 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:24.201 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:24.201 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:24.387 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743943.939854_105.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:23.939854Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:24.388 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:12:24.388 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:12:24.389 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:24.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:24.390 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:24.426 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:24.427 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:24.610 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743943.939854_105.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:23.939854Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:24.611 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:12:24.726 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:24.727 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:24.728 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:24.767 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:24.767 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:24.915 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:12:24.944 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631743944.716073_110.1","last_update":"2021-09-15T22:12:24.716073Z"}] 2021-09-15T22:12:24.945 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:12:24.946 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:24.946 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:24.947 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:24.987 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:24.987 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:25.175 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743944.716073_110.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:24.716073Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:25.176 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:12:25.176 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:12:25.177 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:25.177 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:25.178 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:25.254 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:25.254 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:25.428 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743944.716073_110.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:24.716073Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:25.429 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:12:25.436 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_remove ... ok 2021-09-15T22:12:25.436 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-7 2021-09-15T22:12:25.462 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-8 2021-09-15T22:12:25.656 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:12:25.652+0000 7fda6affd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:12:25.656 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:12:25.652+0000 7fda6bfff700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:12:25.657 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:12:25.656+0000 7fda6b7fe700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:12:25.657 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:12:25.656+0000 7f57d47e8700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:12:25.658 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:12:25.656+0000 7f57d9ff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:12:25.658 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:12:25.656+0000 7f57daff5700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:12:25.659 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:12:25.656+0000 7f57deffd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:12:25.659 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:12:25.656+0000 7f57deffd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:12:25.659 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:12:25.656+0000 7f57dd7fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:12:25.662 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:12:25.660+0000 7fda62ffd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:12:25.663 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:12:25.660+0000 7fda62ffd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:12:25.663 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:12:25.660+0000 7fda62ffd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:12:25.891 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:25.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:25.892 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:25.930 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:25.930 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:26.061 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:12:26.084 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631743945.498539_119.1","last_update":"2021-09-15T22:12:25.498539Z"}] 2021-09-15T22:12:26.085 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:12:26.086 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:26.087 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:26.088 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:26.123 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:26.123 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:26.310 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743945.498539_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:25.498539Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:26.312 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:12:26.312 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:12:26.313 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:26.314 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:26.314 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:26.352 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:26.352 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:26.526 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743945.498539_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:25.498539Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:26.526 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:12:26.527 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-7', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:26.527 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-7', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:26.528 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-7 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:26.566 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:26.567 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:26.730 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.6.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.7.5"},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.9.5"},{"key":8,"val":"00000000001.10.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:26.731 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-7 2021-09-15T22:12:26.732 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:26.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:26.733 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-7 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:26.775 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:26.776 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:26.988 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.6.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"_myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.7.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"&","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.9.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":":","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.10.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:26.989 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-7 2021-09-15T22:12:26.990 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-7 zones={test-zone2, test-zone1} 2021-09-15T22:12:26.998 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:12:27.048 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-09-15T22:12:27.049 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-09-15T22:12:27.050 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-09-15T22:12:27.050 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-09-15T22:12:27.051 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:12:27.057 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-09-15T22:12:27.057 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-09-15T22:12:27.058 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-09-15T22:12:27.059 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-09-15T22:12:27.113 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-09-15T22:12:27.171 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-09-15T22:12:27.283 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-09-15T22:12:27.389 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-09-15T22:12:27.448 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-09-15T22:12:27.556 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-09-15T22:12:27.665 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-09-15T22:12:27.725 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-09-15T22:12:27.835 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-09-15T22:12:27.945 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-09-15T22:12:28.004 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-09-15T22:12:28.121 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-09-15T22:12:28.225 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-7 zones={test-zone2, test-zone1} 2021-09-15T22:12:28.226 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-7', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:28.226 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-7', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:28.227 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-7 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:28.264 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:28.265 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:28.440 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.6.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.7.5"},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.9.5"},{"key":8,"val":"00000000001.10.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:28.440 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-7 2021-09-15T22:12:28.441 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:28.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:28.442 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-7 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:28.484 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:28.485 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:28.691 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.6.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.7.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.9.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.10.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:28.691 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-7 2021-09-15T22:12:28.692 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-8', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:28.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-8', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:28.693 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-8 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:28.732 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:28.733 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:28.922 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.10.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.14.5"},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.9.5"},{"key":8,"val":"00000000001.4.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:28.923 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-8 2021-09-15T22:12:28.923 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-8', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:28.924 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-8', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:28.924 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-8 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:28.969 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:28.970 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:29.166 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.10.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"_myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.14.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"&","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.9.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":":","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.4.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:29.167 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-8 2021-09-15T22:12:29.167 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-8 zones={test-zone1, test-zone2} 2021-09-15T22:12:29.176 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:12:29.227 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-09-15T22:12:29.228 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-09-15T22:12:29.228 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-09-15T22:12:29.229 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-09-15T22:12:29.229 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:12:29.236 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-09-15T22:12:29.236 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-09-15T22:12:29.237 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-09-15T22:12:29.237 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-09-15T22:12:29.297 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-09-15T22:12:29.355 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-09-15T22:12:29.463 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-09-15T22:12:29.572 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-09-15T22:12:29.627 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-09-15T22:12:29.782 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-09-15T22:12:29.885 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-09-15T22:12:29.943 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-09-15T22:12:30.060 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-09-15T22:12:30.171 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-09-15T22:12:30.231 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-09-15T22:12:30.344 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-09-15T22:12:30.447 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-8 zones={test-zone1, test-zone2} 2021-09-15T22:12:30.448 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_sync ... ok 2021-09-15T22:12:30.449 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-9 2021-09-15T22:12:30.475 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-10 2021-09-15T22:12:30.621 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:30.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:30.622 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:30.655 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:12:30.652+0000 7fda777fe700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:12:30.656 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:12:30.652+0000 7f57dd7fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:12:30.656 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:30.657 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:30.657 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:12:30.656+0000 7fda5d7f2700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:12:30.658 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:12:30.656+0000 7f57e6ffd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:12:30.785 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:12:30.815 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631743950.513399_98.1","last_update":"2021-09-15T22:12:30.513399Z"},{"marker":"1_1631743950.486515_127.1","last_update":"2021-09-15T22:12:30.486515Z"}] 2021-09-15T22:12:30.815 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:12:30.816 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:30.816 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:30.817 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:30.860 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:30.861 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:31.045 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743950.513399_98.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.513399Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:31.045 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:12:31.046 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:12:31.046 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:31.047 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:31.047 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:31.085 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:31.085 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:31.272 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743950.513399_98.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.513399Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:31.272 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:12:31.273 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:31.273 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:31.274 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-9 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:31.316 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:31.316 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:31.499 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.9.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:31.500 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-9 2021-09-15T22:12:31.500 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:31.501 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:31.501 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-9 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:31.544 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:31.544 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:31.746 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.9.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:31.747 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-9 2021-09-15T22:12:31.747 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-9 zones={test-zone2, test-zone1} 2021-09-15T22:12:31.757 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:12:31.807 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-09-15T22:12:31.808 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:12:31.815 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-09-15T22:12:31.868 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-09-15T22:12:31.929 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-09-15T22:12:32.037 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-09-15T22:12:32.145 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-9 zones={test-zone2, test-zone1} 2021-09-15T22:12:32.146 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:32.146 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:32.147 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-9 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:32.184 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:32.184 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:32.364 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.9.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:32.364 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-9 2021-09-15T22:12:32.365 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:32.365 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:32.366 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-9 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:32.408 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:32.408 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:32.611 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.9.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:32.612 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-9 2021-09-15T22:12:32.612 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:32.613 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:32.613 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-10 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:32.653 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:32.653 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:32.858 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.12.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:32.859 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-10 2021-09-15T22:12:32.859 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:32.860 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:32.861 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-10 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:32.905 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:32.906 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:33.104 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.12.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:33.105 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-10 2021-09-15T22:12:33.106 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-10 zones={test-zone1, test-zone2} 2021-09-15T22:12:33.114 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:12:33.159 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-09-15T22:12:33.160 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:12:33.166 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-09-15T22:12:33.220 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-09-15T22:12:33.278 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-09-15T22:12:33.389 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-09-15T22:12:33.493 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-10 zones={test-zone1, test-zone2} 2021-09-15T22:12:33.510 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:33.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:33.511 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-9 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:33.553 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:33.554 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:33.723 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.11.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:33.724 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-9 2021-09-15T22:12:33.724 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:33.725 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:33.726 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-9 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:33.768 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:33.768 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:33.982 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.11.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:33.982 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-9 2021-09-15T22:12:33.983 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-9 zones={test-zone2, test-zone1} 2021-09-15T22:12:33.994 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:12:34.043 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:12:34.103 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-9 zones={test-zone2, test-zone1} 2021-09-15T22:12:34.104 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:34.105 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:34.105 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-9 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:34.145 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:34.145 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:34.319 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.11.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:34.320 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-9 2021-09-15T22:12:34.320 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:34.321 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:34.321 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-9 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:34.367 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:34.367 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:34.568 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.11.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:34.568 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-9 2021-09-15T22:12:34.582 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:34.582 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:34.583 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-10 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:34.652 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:34.652 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:34.848 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.18.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:34.849 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-10 2021-09-15T22:12:34.849 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:34.851 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:34.851 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-10 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:34.895 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:34.896 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:35.088 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.18.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:35.089 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-10 2021-09-15T22:12:35.089 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-10 zones={test-zone1, test-zone2} 2021-09-15T22:12:35.098 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:12:35.143 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:12:35.204 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-10 zones={test-zone1, test-zone2} 2021-09-15T22:12:35.205 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_delete ... ok 2021-09-15T22:12:35.206 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-11 2021-09-15T22:12:35.231 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-12 2021-09-15T22:12:35.307 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:35.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:35.309 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:35.348 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:35.348 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:35.495 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:12:35.525 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631743955.315255_131.1","last_update":"2021-09-15T22:12:35.315255Z"},{"marker":"1_1631743950.486515_127.1","last_update":"2021-09-15T22:12:30.486515Z"}] 2021-09-15T22:12:35.526 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:12:35.526 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:35.527 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:35.528 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:35.560 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:35.561 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:35.764 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743955.315255_131.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:35.315255Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:35.764 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:12:35.765 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:12:35.765 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:35.766 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:35.766 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:35.804 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:35.804 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:36.006 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743955.315255_131.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:35.315255Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:36.009 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:12:36.059 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:36.060 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:36.063 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:36.104 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:36.104 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:36.280 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.8.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:36.280 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-11 2021-09-15T22:12:36.282 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:36.283 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:36.284 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:36.325 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:36.326 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:36.512 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"ZHovBeUctiji7j8UQC-EFaugFJwXW01","ns":""},"count":1},"inc_marker":{"position":"00000000003.10.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:36.513 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-11 2021-09-15T22:12:36.513 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:36.514 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:36.515 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:36.554 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:36.554 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:36.725 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.10.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:36.725 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-11 2021-09-15T22:12:36.726 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:36.726 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:36.727 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:36.771 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:36.771 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:36.985 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.10.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:36.985 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-11 2021-09-15T22:12:37.039 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:37.040 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:37.040 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:37.289 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.30.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:37.290 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-12 2021-09-15T22:12:37.291 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:37.291 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:37.292 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:37.338 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:37.339 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:37.521 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"s.blweT7iL54nphRF-ewzKK0X-Ys.2y","ns":""},"count":1},"inc_marker":{"position":"00000000003.32.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:37.522 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-12 2021-09-15T22:12:38.271 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:38.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:38.273 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:38.315 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:38.315 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:38.483 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000010.30.5"},{"key":2,"val":""},{"key":3,"val":"00000000006.16.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.10.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:38.484 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-11 2021-09-15T22:12:38.484 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:38.485 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:38.485 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:38.531 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:38.531 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:38.724 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"pLH5190TnlsoIxQOQXxhf4kdelTbA8d","ns":""},"count":1},"inc_marker":{"position":"00000000010.30.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"JJ8ENi1hvVK2bhWklLYzqYaU95WAju2","ns":""},"count":1},"inc_marker":{"position":"00000000006.16.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"ZHovBeUctiji7j8UQC-EFaugFJwXW01","ns":""},"count":1},"inc_marker":{"position":"00000000003.10.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:38.725 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-11 2021-09-15T22:12:38.726 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:38.727 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:38.728 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:38.771 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:38.772 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:38.945 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000010.30.5"},{"key":2,"val":""},{"key":3,"val":"00000000006.16.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.10.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:38.946 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-11 2021-09-15T22:12:38.946 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:38.947 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:38.948 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:38.991 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:38.991 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:39.200 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.30.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.16.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.10.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:39.201 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-11 2021-09-15T22:12:39.202 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:39.202 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:39.203 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:39.281 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:39.282 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:39.474 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000005.34.5"},{"key":2,"val":""},{"key":3,"val":"00000000010.24.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.14.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:39.475 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-11 2021-09-15T22:12:39.476 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:39.477 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:39.477 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:39.520 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:39.521 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:39.694 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"nLYLn0XV3n0zUGYpLCyzLu9dBH9Dk.g","ns":""},"count":1},"inc_marker":{"position":"00000000005.34.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"JJ8ENi1hvVK2bhWklLYzqYaU95WAju2","ns":""},"count":1},"inc_marker":{"position":"00000000010.24.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"ZHovBeUctiji7j8UQC-EFaugFJwXW01","ns":""},"count":1},"inc_marker":{"position":"00000000002.14.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:39.695 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-11 2021-09-15T22:12:39.695 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-11 zones={test-zone2, test-zone1} 2021-09-15T22:12:39.705 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:12:39.711 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-09-15T22:12:39.712 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-09-15T22:12:39.712 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-09-15T22:12:39.713 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:12:39.718 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-09-15T22:12:39.719 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-09-15T22:12:39.719 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-09-15T22:12:39.730 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:39.741 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:39.808 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:39.864 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-09-15T22:12:39.920 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-09-15T22:12:40.036 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-09-15T22:12:40.141 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-09-15T22:12:40.196 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-09-15T22:12:40.311 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-09-15T22:12:40.414 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-11 zones={test-zone2, test-zone1} 2021-09-15T22:12:40.415 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:40.415 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:40.416 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:40.454 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:40.455 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:40.635 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000010.25.5"},{"key":2,"val":""},{"key":3,"val":"00000000002.30.10"},{"key":4,"val":""},{"key":5,"val":"00000000002.14.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:40.635 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-12 2021-09-15T22:12:40.636 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:40.637 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:40.638 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:40.682 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:40.683 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:40.887 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"qhHiiB12Qlo4Gs6RJJF1sxDFu6Lvw6F","ns":""},"count":1},"inc_marker":{"position":"00000000010.25.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"PmnzdTFtJG7ZIK8JRXdT3gATLN1MEHK","ns":""},"count":1},"inc_marker":{"position":"00000000002.30.10"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"s.blweT7iL54nphRF-ewzKK0X-Ys.2y","ns":""},"count":1},"inc_marker":{"position":"00000000002.14.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:40.888 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-12 2021-09-15T22:12:40.888 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:40.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:40.890 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:40.931 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:40.932 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:41.112 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000010.25.5"},{"key":2,"val":""},{"key":3,"val":"00000000002.30.10"},{"key":4,"val":""},{"key":5,"val":"00000000002.14.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:41.112 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-12 2021-09-15T22:12:41.113 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:41.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:41.114 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:41.156 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:41.156 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:41.363 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.25.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.10"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.14.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:41.364 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-12 2021-09-15T22:12:41.364 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:41.365 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:41.365 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:41.447 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:41.448 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:41.652 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.22.10"},{"key":2,"val":""},{"key":3,"val":"00000000010.42.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.32.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:41.653 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-12 2021-09-15T22:12:41.653 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:41.654 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:41.654 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:41.698 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:41.699 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:41.897 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"qhHiiB12Qlo4Gs6RJJF1sxDFu6Lvw6F","ns":""},"count":1},"inc_marker":{"position":"00000000002.22.10"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"kreisVjgeQ5xFzek6LB6IyYVqInOzFV","ns":""},"count":1},"inc_marker":{"position":"00000000010.42.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"s.blweT7iL54nphRF-ewzKK0X-Ys.2y","ns":""},"count":1},"inc_marker":{"position":"00000000003.32.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:41.897 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-12 2021-09-15T22:12:41.898 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-12 zones={test-zone2, test-zone1} 2021-09-15T22:12:41.907 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:12:41.912 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-09-15T22:12:41.913 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-09-15T22:12:41.913 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-09-15T22:12:41.914 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:12:41.919 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-09-15T22:12:41.920 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-09-15T22:12:41.920 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-09-15T22:12:41.973 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:41.984 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:42.047 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:42.109 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-09-15T22:12:42.167 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-09-15T22:12:42.288 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-09-15T22:12:42.392 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-09-15T22:12:42.448 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-09-15T22:12:42.562 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-09-15T22:12:42.663 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-12 zones={test-zone2, test-zone1} 2021-09-15T22:12:42.931 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:42.932 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:42.933 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:42.975 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:42.975 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:43.141 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000011.34.5"},{"key":2,"val":""},{"key":3,"val":"00000000007.19.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.10.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:43.141 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-11 2021-09-15T22:12:43.142 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:43.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:43.143 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:43.187 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:43.187 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:43.391 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"pLH5190TnlsoIxQOQXxhf4kdelTbA8d","ns":""},"count":1},"inc_marker":{"position":"00000000011.34.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"JJ8ENi1hvVK2bhWklLYzqYaU95WAju2","ns":""},"count":1},"inc_marker":{"position":"00000000007.19.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"ZHovBeUctiji7j8UQC-EFaugFJwXW01","ns":""},"count":1},"inc_marker":{"position":"00000000003.10.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:43.392 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-11 2021-09-15T22:12:43.392 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:43.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:43.394 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:43.435 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:43.435 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:43.617 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000011.34.5"},{"key":2,"val":""},{"key":3,"val":"00000000007.19.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.10.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:43.617 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-11 2021-09-15T22:12:43.618 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:43.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:43.619 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:43.663 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:43.663 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:43.858 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000011.34.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000007.19.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.10.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:43.859 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-11 2021-09-15T22:12:43.860 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:43.861 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:43.862 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:43.940 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:43.940 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:44.132 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000006.37.5"},{"key":2,"val":""},{"key":3,"val":"00000000011.27.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.14.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:44.132 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-11 2021-09-15T22:12:44.133 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:44.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:44.134 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:44.178 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:44.178 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:44.377 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"nLYLn0XV3n0zUGYpLCyzLu9dBH9Dk.g","ns":""},"count":1},"inc_marker":{"position":"00000000006.37.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"JJ8ENi1hvVK2bhWklLYzqYaU95WAju2","ns":""},"count":1},"inc_marker":{"position":"00000000011.27.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"ZHovBeUctiji7j8UQC-EFaugFJwXW01","ns":""},"count":1},"inc_marker":{"position":"00000000002.14.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:44.378 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-11 2021-09-15T22:12:44.378 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-11 zones={test-zone2, test-zone1} 2021-09-15T22:12:44.387 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:12:44.393 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-09-15T22:12:44.393 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-09-15T22:12:44.394 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-09-15T22:12:44.395 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:12:44.400 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-09-15T22:12:44.401 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-09-15T22:12:44.401 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-09-15T22:12:44.411 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:44.424 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:44.490 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:44.548 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-09-15T22:12:44.608 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-09-15T22:12:44.723 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-09-15T22:12:44.826 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-09-15T22:12:44.880 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-09-15T22:12:44.996 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-09-15T22:12:45.101 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-11 zones={test-zone2, test-zone1} 2021-09-15T22:12:45.102 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:45.103 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:45.104 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:45.144 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:45.144 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:45.330 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000011.33.5"},{"key":2,"val":""},{"key":3,"val":"00000000003.35.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.14.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:45.330 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-12 2021-09-15T22:12:45.331 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:45.332 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:45.332 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:45.376 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:45.376 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:45.560 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"qhHiiB12Qlo4Gs6RJJF1sxDFu6Lvw6F","ns":""},"count":1},"inc_marker":{"position":"00000000011.33.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"PmnzdTFtJG7ZIK8JRXdT3gATLN1MEHK","ns":""},"count":1},"inc_marker":{"position":"00000000003.35.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"s.blweT7iL54nphRF-ewzKK0X-Ys.2y","ns":""},"count":1},"inc_marker":{"position":"00000000002.14.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:45.561 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-12 2021-09-15T22:12:45.561 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:45.562 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:45.562 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:45.604 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:45.605 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:45.774 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000011.33.5"},{"key":2,"val":""},{"key":3,"val":"00000000003.35.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.14.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:45.774 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-12 2021-09-15T22:12:45.775 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:45.775 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:45.776 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:45.819 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:45.820 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:46.000 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000011.33.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.35.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.14.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:46.001 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-12 2021-09-15T22:12:46.001 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:46.002 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:46.002 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:46.085 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:46.086 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:46.262 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000003.46.5"},{"key":2,"val":""},{"key":3,"val":"00000000011.48.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.32.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:46.262 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-12 2021-09-15T22:12:46.263 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:46.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:46.264 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:46.308 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:46.309 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:46.502 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"qhHiiB12Qlo4Gs6RJJF1sxDFu6Lvw6F","ns":""},"count":1},"inc_marker":{"position":"00000000003.46.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"kreisVjgeQ5xFzek6LB6IyYVqInOzFV","ns":""},"count":1},"inc_marker":{"position":"00000000011.48.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"s.blweT7iL54nphRF-ewzKK0X-Ys.2y","ns":""},"count":1},"inc_marker":{"position":"00000000003.32.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:46.502 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-12 2021-09-15T22:12:46.503 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-12 zones={test-zone2, test-zone1} 2021-09-15T22:12:46.511 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:12:46.517 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-09-15T22:12:46.518 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-09-15T22:12:46.518 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-09-15T22:12:46.519 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:12:46.568 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-09-15T22:12:46.568 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-09-15T22:12:46.569 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-09-15T22:12:46.623 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:46.633 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:46.700 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:46.756 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-09-15T22:12:46.812 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-09-15T22:12:46.926 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-09-15T22:12:47.029 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-09-15T22:12:47.088 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-09-15T22:12:47.209 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-09-15T22:12:47.317 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-12 zones={test-zone2, test-zone1} 2021-09-15T22:12:47.318 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_versioned_object_incremental_sync ... ok 2021-09-15T22:12:47.352 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:47.353 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:47.353 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:47.388 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:47.389 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:47.537 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:12:47.565 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631743967.365759_185.1","last_update":"2021-09-15T22:12:47.365759Z"},{"marker":"1_1631743950.486515_127.1","last_update":"2021-09-15T22:12:30.486515Z"}] 2021-09-15T22:12:47.565 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:12:47.566 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:47.566 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:47.567 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:47.606 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:47.606 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:47.790 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743967.365759_185.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:47.365759Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:47.791 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:12:47.791 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:12:47.792 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:47.792 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:47.793 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:47.830 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:47.831 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:48.002 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743967.365759_185.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:47.365759Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:12:48.003 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:12:48.051 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:48.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:48.052 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:48.093 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:48.094 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:48.261 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.8.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:48.261 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-13 2021-09-15T22:12:48.262 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:48.262 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:48.263 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:48.307 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:48.308 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:48.491 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"phUa77iOKdcuzCKR6OK4-Kabtv67lQF","ns":""},"count":1},"inc_marker":{"position":"00000000002.8.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:48.491 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-13 2021-09-15T22:12:48.492 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:48.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:48.493 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:48.531 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:48.532 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:48.701 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.10.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:48.701 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-13 2021-09-15T22:12:48.702 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:48.702 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:48.703 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:48.746 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:48.747 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:48.932 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.10.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:48.933 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-13 2021-09-15T22:12:48.934 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:48.934 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:48.935 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:49.017 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:49.018 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:49.200 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.13.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:49.201 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-13 2021-09-15T22:12:49.201 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:49.202 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:49.202 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:49.246 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:49.247 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:49.436 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"phUa77iOKdcuzCKR6OK4-Kabtv67lQF","ns":""},"count":1},"inc_marker":{"position":"00000000002.13.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:49.437 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-13 2021-09-15T22:12:49.438 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-13 zones={test-zone2, test-zone1} 2021-09-15T22:12:49.448 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:12:49.495 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-09-15T22:12:49.496 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:12:49.503 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-09-15T22:12:49.557 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:49.568 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:49.636 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:49.698 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-13 zones={test-zone2, test-zone1} 2021-09-15T22:12:50.703 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:50.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:50.705 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:50.747 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:50.747 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:50.922 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.10.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000032.87.8"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:50.923 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-13 2021-09-15T22:12:50.924 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:50.925 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:50.926 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:50.971 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:50.972 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:51.164 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"phUa77iOKdcuzCKR6OK4-Kabtv67lQF","ns":""},"count":1},"inc_marker":{"position":"00000000003.10.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"O.3KRtrPd1EW5SGxVTWlhLRJ3piOBYj","ns":""},"count":1},"inc_marker":{"position":"00000000032.87.8"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:51.165 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-13 2021-09-15T22:12:51.165 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:51.166 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:51.166 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:51.206 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:51.206 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:51.390 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.10.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000032.87.8"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:51.390 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-13 2021-09-15T22:12:51.391 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:51.391 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:51.392 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:51.435 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:51.435 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:51.613 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.10.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000032.87.8"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:51.614 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-13 2021-09-15T22:12:51.614 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:51.615 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:51.616 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:51.697 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:51.697 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:51.871 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.13.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000037.99.11"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:12:51.871 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-13 2021-09-15T22:12:51.872 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:51.872 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:51.873 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:51.918 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:51.918 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:52.111 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"phUa77iOKdcuzCKR6OK4-Kabtv67lQF","ns":""},"count":1},"inc_marker":{"position":"00000000002.13.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"1RxhaMWU3XawM6xddJv0pdd4Xc9a8P0","ns":""},"count":1},"inc_marker":{"position":"00000000037.99.11"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:12:52.112 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-13 2021-09-15T22:12:52.113 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-13 zones={test-zone2, test-zone1} 2021-09-15T22:12:52.123 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:12:52.133 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-09-15T22:12:52.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.137 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.138 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.139 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.139 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.140 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.141 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.142 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.142 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.146 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.147 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.148 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.148 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.149 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.150 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:12:52.160 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-09-15T22:12:52.160 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.161 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.161 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.162 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.162 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.163 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.164 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.164 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.164 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.165 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.166 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.166 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.167 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.167 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.168 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.168 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.169 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.169 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.169 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.170 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:12:52.186 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:52.198 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:52.264 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-09-15T22:12:52.327 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:52.720 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:52.840 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:52.945 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:53.001 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:53.118 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:53.222 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:53.275 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:53.393 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:53.501 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:53.557 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:53.674 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:53.781 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:53.839 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:53.958 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:54.070 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:54.126 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:54.243 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:54.345 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:54.400 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:54.514 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:54.620 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:54.676 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:54.798 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:54.907 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:54.969 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:55.087 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:55.193 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:55.251 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:55.369 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:55.473 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:55.529 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:55.649 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:55.754 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:55.812 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:55.935 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:56.041 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:56.099 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:56.221 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:56.325 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:56.379 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:56.495 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:56.602 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:56.655 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:56.769 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:56.877 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:56.932 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:57.049 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:57.154 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:57.208 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:57.328 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:57.429 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:57.491 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:57.610 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:57.713 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:57.767 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:57.885 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:57.993 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:58.048 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:58.168 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:12:58.273 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-13 zones={test-zone2, test-zone1} 2021-09-15T22:12:58.274 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:58.275 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:58.275 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:58.311 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:58.311 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:58.492 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743962.711074_36.2","last_update":"2021-09-15T22:12:42.711074Z"},{"marker":"1_1631743969.726140_119.1","last_update":"2021-09-15T22:12:49.726140Z"},{"marker":"1_1631743968.035171_55.1","last_update":"2021-09-15T22:12:48.035171Z"},{"marker":"1_1631743946.058984_42.1","last_update":"2021-09-15T22:12:26.058984Z"}] 2021-09-15T22:12:58.492 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-09-15T22:12:58.493 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:58.494 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:58.495 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:58.537 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:58.538 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:58.717 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":2214498870205982451},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743962.711074_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:42.711074Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631743969.726140_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:49.726140Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631743968.035171_55.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:48.035171Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743946.058984_42.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:26.058984Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:12:58.717 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-09-15T22:12:58.718 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:58.718 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:58.719 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:58.760 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:58.760 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:58.943 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743962.711074_36.2","last_update":"2021-09-15T22:12:42.711074Z"},{"marker":"1_1631743969.726140_119.1","last_update":"2021-09-15T22:12:49.726140Z"},{"marker":"1_1631743968.035171_55.1","last_update":"2021-09-15T22:12:48.035171Z"},{"marker":"1_1631743946.058984_42.1","last_update":"2021-09-15T22:12:26.058984Z"}] 2021-09-15T22:12:58.944 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-09-15T22:12:58.944 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:58.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:58.945 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:58.985 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:58.986 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:59.162 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16115054566166127550},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743962.711074_36.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:42.711074Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631743969.726140_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:49.726140Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631743968.035171_55.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:48.035171Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743946.058984_42.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:26.058984Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:12:59.162 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-09-15T22:12:59.163 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:59.163 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:59.164 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:59.242 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:59.243 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:59.410 INFO:teuthology.orchestra.run.smithi184.stdout:[{"marker":"1_1631743962.861016_30.2","last_update":"2021-09-15T22:12:42.861016Z"},{"marker":"1_1631743969.769935_105.1","last_update":"2021-09-15T22:12:49.769935Z"},{"marker":"1_1631743968.098108_76.1","last_update":"2021-09-15T22:12:48.098108Z"},{"marker":"1_1631743945.930099_51.1","last_update":"2021-09-15T22:12:25.930099Z"}] 2021-09-15T22:12:59.411 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-09-15T22:12:59.412 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:59.412 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:59.413 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:59.454 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:59.454 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:59.639 INFO:teuthology.orchestra.run.smithi180.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8964646445785232500},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743962.861016_30.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:42.861016Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631743969.769935_105.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:49.769935Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631743968.098108_76.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:48.098108Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743945.930099_51.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:25.930099Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:12:59.640 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-09-15T22:12:59.640 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_concurrent_versioned_object_incremental_sync ... ok 2021-09-15T22:12:59.664 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:59.665 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:59.666 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:59.699 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:59.699 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:12:59.848 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:12:59.877 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631743979.677930_219.1","last_update":"2021-09-15T22:12:59.677930Z"},{"marker":"1_1631743950.486515_127.1","last_update":"2021-09-15T22:12:30.486515Z"}] 2021-09-15T22:12:59.877 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:12:59.878 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:59.878 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:12:59.879 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:12:59.917 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:12:59.918 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:00.087 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743979.677930_219.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:59.677930Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:13:00.088 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:13:00.089 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:13:00.089 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:00.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:00.091 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:00.126 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:00.126 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:00.300 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743979.677930_219.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:59.677930Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:13:00.301 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:13:00.351 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:00.351 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:00.352 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:00.394 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:00.394 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:00.563 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.6.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:00.564 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-14 2021-09-15T22:13:00.565 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:00.565 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:00.566 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:00.603 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:00.603 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:00.785 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.6.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:00.786 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-14 2021-09-15T22:13:00.786 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:00.787 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:00.787 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:00.828 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:00.828 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:01.009 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.6.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:01.010 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-14 2021-09-15T22:13:01.010 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:01.011 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:01.012 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:01.054 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:01.055 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:01.240 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.6.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:01.241 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-14 2021-09-15T22:13:01.241 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:01.241 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:01.242 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:01.324 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:01.325 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:01.496 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.8.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:01.496 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-14 2021-09-15T22:13:01.497 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:01.497 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:01.498 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:01.541 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:01.542 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:01.727 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.8.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:01.728 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-14 2021-09-15T22:13:01.728 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-14 zones={test-zone2, test-zone1} 2021-09-15T22:13:01.736 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:13:01.783 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:01.784 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:13:01.789 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:01.841 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:01.852 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:01.913 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:01.972 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-14 zones={test-zone2, test-zone1} 2021-09-15T22:13:01.984 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:01.984 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:01.985 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:02.022 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:02.023 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:02.176 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:13:02.205 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631743981.997686_233.1","last_update":"2021-09-15T22:13:01.997686Z"},{"marker":"1_1631743950.486515_127.1","last_update":"2021-09-15T22:12:30.486515Z"}] 2021-09-15T22:13:02.205 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:13:02.206 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:02.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:02.207 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:02.247 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:02.247 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:02.422 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743981.997686_233.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:01.997686Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:13:02.422 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:13:02.423 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:13:02.423 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:02.425 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:02.425 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:02.467 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:02.468 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:02.631 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743981.997686_233.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:01.997686Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:13:02.632 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:13:02.683 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:02.684 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:02.684 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:02.723 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:02.723 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:02.904 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.9.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:02.905 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-14 2021-09-15T22:13:02.906 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:02.907 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:02.907 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:02.952 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:02.952 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:03.142 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000003.9.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:03.143 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-14 2021-09-15T22:13:03.144 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:03.145 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:03.145 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:03.186 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:03.186 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:03.368 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.9.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:03.369 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-14 2021-09-15T22:13:03.370 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:03.371 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:03.371 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:03.417 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:03.417 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:03.596 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.9.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:03.596 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-14 2021-09-15T22:13:03.597 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:03.598 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:03.598 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:03.637 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:03.637 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:03.817 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.13.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:03.818 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-14 2021-09-15T22:13:03.819 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:03.820 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:03.821 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:03.864 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:03.865 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:04.062 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000003.13.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:04.063 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-14 2021-09-15T22:13:04.063 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-14 zones={test-zone2, test-zone1} 2021-09-15T22:13:04.072 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:13:04.119 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:04.120 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:04.120 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:13:04.126 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:04.127 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:04.181 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:04.193 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:04.261 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:04.321 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:04.333 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:04.399 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:04.456 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-14 zones={test-zone2, test-zone1} 2021-09-15T22:13:04.467 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:04.468 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:04.468 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:04.506 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:04.506 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:04.650 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:13:04.675 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631743984.481313_247.1","last_update":"2021-09-15T22:13:04.481313Z"},{"marker":"1_1631743950.486515_127.1","last_update":"2021-09-15T22:12:30.486515Z"}] 2021-09-15T22:13:04.676 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:13:04.676 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:04.677 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:04.677 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:04.717 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:04.717 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:04.898 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743984.481313_247.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.481313Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:13:04.898 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:13:04.899 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:13:04.899 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:04.900 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:04.902 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:04.940 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:04.941 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:05.111 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743984.481313_247.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.481313Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:13:05.112 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:13:05.167 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:05.168 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:05.170 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:05.212 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:05.213 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:05.385 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000005.13.17"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:05.386 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-14 2021-09-15T22:13:05.386 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:05.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:05.387 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:05.432 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:05.433 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:05.617 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000005.13.17"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:05.617 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-14 2021-09-15T22:13:05.618 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:05.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:05.619 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:05.662 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:05.662 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:05.840 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000005.13.17"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:05.841 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-14 2021-09-15T22:13:05.842 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:05.843 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:05.844 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:05.887 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:05.888 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:06.069 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000005.13.17"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:06.070 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-14 2021-09-15T22:13:06.071 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:06.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:06.073 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:06.111 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:06.112 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:06.287 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000005.19.17"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:06.288 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-14 2021-09-15T22:13:06.288 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:06.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:06.290 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:06.332 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:06.332 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:06.524 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000005.19.17"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:06.525 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-14 2021-09-15T22:13:06.525 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-14 zones={test-zone2, test-zone1} 2021-09-15T22:13:06.534 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:13:06.583 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:06.584 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:06.584 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:13:06.590 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:06.591 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:06.645 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:06.656 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:06.725 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:06.785 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:06.800 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:06.866 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:06.924 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-14 zones={test-zone2, test-zone1} 2021-09-15T22:13:06.925 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_version_suspended_incremental_sync ... ok 2021-09-15T22:13:06.926 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-15 2021-09-15T22:13:06.950 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-16 2021-09-15T22:13:07.025 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:07.026 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:07.027 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:07.067 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:07.067 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:07.219 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:13:07.249 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631743987.034364_271.1","last_update":"2021-09-15T22:13:07.034364Z"},{"marker":"1_1631743950.486515_127.1","last_update":"2021-09-15T22:12:30.486515Z"}] 2021-09-15T22:13:07.250 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:13:07.251 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:07.252 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:07.253 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:07.294 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:07.295 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:07.466 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743987.034364_271.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:07.034364Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:13:07.467 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:13:07.467 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:13:07.468 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:07.468 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:07.469 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:07.505 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:07.506 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:07.680 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743987.034364_271.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:07.034364Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:13:07.680 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:13:07.827 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:07.828 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:07.828 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-15 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:07.873 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:07.873 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:08.040 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.10.11"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:08.041 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-15 2021-09-15T22:13:08.042 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:08.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:08.043 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-15 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:08.100 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:08.100 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:08.266 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"un6JGZ3QxHuhLxSecQ6p.Hu7KoK-xT-","ns":""},"count":2},"inc_marker":{"position":"00000000003.10.11"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:08.267 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-15 2021-09-15T22:13:08.267 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:08.268 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:08.269 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-15 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:08.309 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:08.310 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:08.482 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.10.11"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:08.482 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-15 2021-09-15T22:13:08.483 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:08.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:08.484 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-15 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:08.527 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:08.527 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:08.711 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.10.11"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:08.711 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-15 2021-09-15T22:13:08.712 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:08.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:08.713 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-15 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:08.752 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:08.752 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:08.934 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000002.16.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:08.935 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-15 2021-09-15T22:13:08.936 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:08.936 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:08.937 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-15 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:08.980 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:08.980 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:09.173 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"un6JGZ3QxHuhLxSecQ6p.Hu7KoK-xT-","ns":""},"count":2},"inc_marker":{"position":"00000000002.16.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:09.174 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-15 2021-09-15T22:13:09.174 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-15 zones={test-zone2, test-zone1} 2021-09-15T22:13:09.183 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:13:09.231 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:09.232 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:09.233 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:13:09.239 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:09.240 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:09.297 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:09.305 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:09.320 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:09.388 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-15 zones={test-zone2, test-zone1} 2021-09-15T22:13:09.389 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:09.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:09.390 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:09.428 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:09.429 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:09.603 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000002.18.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:09.603 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-16 2021-09-15T22:13:09.604 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:09.605 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:09.606 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:09.648 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:09.648 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:09.845 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"z.9mhWTBdNZvVhcm17aiuoDrP6f3WKF","ns":""},"count":1},"inc_marker":{"position":"00000000002.18.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:09.846 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-16 2021-09-15T22:13:09.847 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:09.847 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:09.848 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:09.888 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:09.889 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:10.058 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000002.18.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:10.059 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-16 2021-09-15T22:13:10.059 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:10.061 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:10.061 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:10.103 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:10.104 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:10.289 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.18.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:10.289 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-16 2021-09-15T22:13:10.290 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:10.290 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:10.291 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:10.330 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:10.331 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:10.498 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.28.11"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:10.498 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-16 2021-09-15T22:13:10.499 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:10.499 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:10.500 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:10.542 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:10.542 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:10.719 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"z.9mhWTBdNZvVhcm17aiuoDrP6f3WKF","ns":""},"count":1},"inc_marker":{"position":"00000000003.28.11"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:10.720 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-16 2021-09-15T22:13:10.721 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-16 zones={test-zone2, test-zone1} 2021-09-15T22:13:10.729 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:13:10.779 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:10.780 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:10.780 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:13:10.786 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:10.787 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:10.841 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:10.850 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:10.861 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:10.928 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-16 zones={test-zone2, test-zone1} 2021-09-15T22:13:10.929 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_delete_marker_full_sync ... ok 2021-09-15T22:13:10.929 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-17 2021-09-15T22:13:10.954 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-18 2021-09-15T22:13:11.055 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:11.056 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:11.057 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:11.097 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:11.097 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:11.240 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:13:11.268 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631743991.063821_308.1","last_update":"2021-09-15T22:13:11.063821Z"},{"marker":"1_1631743950.486515_127.1","last_update":"2021-09-15T22:12:30.486515Z"}] 2021-09-15T22:13:11.269 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:13:11.269 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:11.270 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:11.271 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:11.309 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:11.310 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:11.496 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743991.063821_308.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:11.063821Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:13:11.497 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:13:11.498 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:13:11.498 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:11.499 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:11.500 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:11.538 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:11.538 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:11.723 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743991.063821_308.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:11.063821Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:13:11.724 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:13:11.872 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:11.873 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:11.874 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:11.915 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:11.915 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:12.076 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.22.6"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:12.077 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-17 2021-09-15T22:13:12.078 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:12.079 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:12.079 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:12.120 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:12.121 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:12.313 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"00000000003.22.6"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:12.314 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-17 2021-09-15T22:13:12.314 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:12.315 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:12.315 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:12.355 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:12.355 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:12.529 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.22.6"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:12.529 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-17 2021-09-15T22:13:12.530 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:12.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:12.531 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:12.571 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:12.571 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:12.792 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.22.6"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:12.793 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-17 2021-09-15T22:13:12.793 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:12.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:12.795 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:12.834 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:12.835 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:13.015 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.42.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:13.016 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-17 2021-09-15T22:13:13.017 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:13.018 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:13.019 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:13.063 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:13.064 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:13.263 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"00000000001.42.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:13.263 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-17 2021-09-15T22:13:13.264 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-17 zones={test-zone2, test-zone1} 2021-09-15T22:13:13.275 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:13:13.323 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:13.324 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:13:13.329 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:13.385 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:13.392 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-17 zones={test-zone2, test-zone1} 2021-09-15T22:13:13.392 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:13.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:13.394 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-18 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:13.432 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:13.433 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:13.610 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000002.26.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:13.611 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-18 2021-09-15T22:13:13.612 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:13.612 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:13.613 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-18 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:13.655 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:13.656 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:13.847 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.26.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:13.847 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-18 2021-09-15T22:13:13.848 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:13.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:13.850 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-18 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:13.892 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:13.892 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:14.075 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000002.26.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:14.076 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-18 2021-09-15T22:13:14.076 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:14.077 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:14.078 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-18 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:14.119 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:14.120 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:14.315 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:14.316 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-18 2021-09-15T22:13:14.316 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:14.317 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:14.318 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-18 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:14.355 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:14.355 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:14.538 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.40.6"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:13:14.538 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-18 2021-09-15T22:13:14.539 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:14.539 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:14.540 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-18 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:14.585 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:14.585 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:14.771 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000003.40.6"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:13:14.772 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-18 2021-09-15T22:13:14.772 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-18 zones={test-zone2, test-zone1} 2021-09-15T22:13:14.781 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:13:14.827 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:14.828 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:13:14.834 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:14.834 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-09-15T22:13:14.889 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-09-15T22:13:14.890 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_suspended_delete_marker_full_sync ... FAIL 2021-09-15T22:13:14.891 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-19 2021-09-15T22:13:14.915 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-20 2021-09-15T22:13:15.079 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_versioning ... ok 2021-09-15T22:13:15.080 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-21 2021-09-15T22:13:15.105 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-22 2021-09-15T22:13:15.295 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_acl ... ok 2021-09-15T22:13:15.296 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-23 2021-09-15T22:13:15.323 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-24 2021-09-15T22:13:16.487 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_cors ... ok 2021-09-15T22:13:16.488 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-25 2021-09-15T22:13:16.512 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-26 2021-09-15T22:13:16.555 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:16.556 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:16.557 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:16.594 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:16.594 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:16.735 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:13:16.763 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631743996.550713_373.1","last_update":"2021-09-15T22:13:16.550713Z"},{"marker":"1_1631743950.486515_127.1","last_update":"2021-09-15T22:12:30.486515Z"}] 2021-09-15T22:13:16.764 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:13:16.764 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:16.765 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:16.766 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:16.806 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:16.806 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:16.997 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743996.550713_373.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:16.550713Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:13:16.998 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:13:16.998 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:13:16.999 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:17.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:17.001 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:17.041 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:17.041 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:17.233 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743996.550713_373.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:16.550713Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:13:17.234 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:13:17.458 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_delete_notempty ... ok 2021-09-15T22:13:17.459 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-27 2021-09-15T22:13:17.483 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-28 2021-09-15T22:13:17.520 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:17.521 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:17.522 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:17.559 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:17.560 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:17.695 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=af209127-5081-4e40-be50-bf8d6eadaece 2021-09-15T22:13:17.722 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743817.278003_20.1","last_update":"2021-09-15T22:10:17.278003Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631743997.520998_384.1","last_update":"2021-09-15T22:13:17.520998Z"},{"marker":"1_1631743950.486515_127.1","last_update":"2021-09-15T22:12:30.486515Z"}] 2021-09-15T22:13:17.723 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:13:17.723 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:17.724 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:17.724 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:17.764 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:17.765 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:17.955 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743997.520998_384.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.520998Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:13:17.955 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:13:17.956 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:13:17.956 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:17.957 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:13:17.957 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:13:18.038 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:18.039 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:18.224 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"af209127-5081-4e40-be50-bf8d6eadaece","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631743997.520998_384.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.520998Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:13:18.225 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:13:18.226 DEBUG:tasks.rgw.c2.client.1:waiting for process to exit 2021-09-15T22:13:18.226 INFO:teuthology.orchestra.run:waiting for 300 2021-09-15T22:13:18.227 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:13:18.228+0000 7f580602c700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 16747) UID: 0 2021-09-15T22:13:18.228 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:13:18.228+0000 7f580a406980 -1 shutting down 2021-09-15T22:13:21.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 is failed for ~0s 2021-09-15T22:13:24.328 INFO:tasks.rgw.c2.client.1:Stopped 2021-09-15T22:13:24.329 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:13:24.329 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:13:24.330 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --master --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:13:24.369 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:24.370 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:24.398 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:13:24.396+0000 7f9f81f62980 0 NOTICE: overriding master zone: 4de7baf2-0fdf-417b-9ffb-8497dcfb5977 2021-09-15T22:13:24.399 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:13:24.400+0000 7f9f81f62980 0 failed reading obj info from .rgw.root:zone_info.4de7baf2-0fdf-417b-9ffb-8497dcfb5977: (2) No such file or directory 2021-09-15T22:13:24.399 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:13:24.400+0000 7f9f81f62980 0 WARNING: could not read zone params for zone id=4de7baf2-0fdf-417b-9ffb-8497dcfb5977 name=test-zone1 2021-09-15T22:13:24.412 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"05C2LIV22Q1515AF","secret_key":"bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6"} 2021-09-15T22:13:24.413 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:13:24.413 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:13:24.414 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:13:24.451 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:13:24.452 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:13:24.696 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"debf2df8-db5a-44b2-b2d8-222dc090a86d","epoch":1,"predecessor_uuid":"af209127-5081-4e40-be50-bf8d6eadaece","sync_status":["1_1631743817.278003_20.1","","1_1631743997.520998_384.1","1_1631743950.486515_127.1"],"period_map":{"id":"debf2df8-db5a-44b2-b2d8-222dc090a86d","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"4f4b61b1-d30a-4c5f-906c-596bca64c691","zones":[{"id":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","name":"test-zone1","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","endpoints":["http://smithi184.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","name":"test-zone3","endpoints":["http://smithi184.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","val":3863291254},{"key":"4f4b61b1-d30a-4c5f-906c-596bca64c691","val":24034659},{"key":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","val":3190180025}]},"master_zonegroup":"test-zonegroup","master_zone":"4f4b61b1-d30a-4c5f-906c-596bca64c691","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","realm_name":"test-realm","realm_epoch":3} 2021-09-15T22:13:24.697 INFO:rgw_multi.tests:Set master zone=test-zone2, waiting 60s for reconfiguration.. 2021-09-15T22:13:27.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 has been restored 2021-09-15T22:14:24.698 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-29 2021-09-15T22:14:24.754 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-30 2021-09-15T22:14:24.789 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:14:24.790 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:14:24.791 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:14:24.831 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:14:24.832 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:14:25.005 INFO:teuthology.orchestra.run.smithi184.stderr:No --period given, using current period=debf2df8-db5a-44b2-b2d8-222dc090a86d 2021-09-15T22:14:25.036 INFO:teuthology.orchestra.run.smithi184.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744064.791418_217.1","last_update":"2021-09-15T22:14:24.791418Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:14:25.037 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone1 2021-09-15T22:14:25.037 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:14:25.038 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:14:25.038 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:14:25.079 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:14:25.079 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:14:25.257 INFO:teuthology.orchestra.run.smithi180.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"debf2df8-db5a-44b2-b2d8-222dc090a86d","realm_epoch":3},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":55,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":2,"val":{"state":1,"marker":"1_1631744064.791418_217.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:14:24.791418Z","realm_epoch":3}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":3}}]},"full_sync":{"total":55,"complete":55}} 2021-09-15T22:14:25.257 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone1 2021-09-15T22:14:25.258 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:14:25.259 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'modify', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:14:25.259 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone modify --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --master --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:14:25.296 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:14:25.296 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:14:25.321 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:14:25.335+0000 7fdafeac4980 0 NOTICE: overriding master zone: 4f4b61b1-d30a-4c5f-906c-596bca64c691 2021-09-15T22:14:25.322 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:14:25.339+0000 7fdafeac4980 0 failed reading obj info from .rgw.root:zone_info.4f4b61b1-d30a-4c5f-906c-596bca64c691: (2) No such file or directory 2021-09-15T22:14:25.323 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:14:25.339+0000 7fdafeac4980 0 WARNING: could not read zone params for zone id=4f4b61b1-d30a-4c5f-906c-596bca64c691 name=test-zone2 2021-09-15T22:14:25.323 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:14:25.339+0000 7fdafeac4980 0 failed reading obj info from .rgw.root:zone_info.5f8055e7-8301-4bb3-9c3e-a1936a9c037b: (2) No such file or directory 2021-09-15T22:14:25.324 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:14:25.339+0000 7fdafeac4980 0 WARNING: could not read zone params for zone id=5f8055e7-8301-4bb3-9c3e-a1936a9c037b name=test-zone3 2021-09-15T22:14:25.333 INFO:teuthology.orchestra.run.smithi180.stdout:{"id":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"05C2LIV22Q1515AF","secret_key":"bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6"} 2021-09-15T22:14:25.334 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:14:25.335 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:14:25.335 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:14:25.412 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:14:25.413 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:14:25.652 INFO:teuthology.orchestra.run.smithi180.stdout:{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","epoch":1,"predecessor_uuid":"debf2df8-db5a-44b2-b2d8-222dc090a86d","sync_status":["","","1_1631744064.791418_217.1",""],"period_map":{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","zones":[{"id":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","name":"test-zone1","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","endpoints":["http://smithi184.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","name":"test-zone3","endpoints":["http://smithi184.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","val":3863291254},{"key":"4f4b61b1-d30a-4c5f-906c-596bca64c691","val":24034659},{"key":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","val":3190180025}]},"master_zonegroup":"test-zonegroup","master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","realm_name":"test-realm","realm_epoch":4} 2021-09-15T22:14:25.653 INFO:rgw_multi.tests:Set master zone=test-zone1, waiting 60s for reconfiguration.. 2021-09-15T22:15:25.655 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-31 2021-09-15T22:15:25.688 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-32 2021-09-15T22:15:25.741 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-09-15T22:15:25.742 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-09-15T22:15:25.745 INFO:tasks.rgw.c2.client.1:Started 2021-09-15T22:15:25.746 DEBUG:teuthology.orchestra.run.smithi184:> curl http://smithi184.front.sepia.ceph.com:8001 2021-09-15T22:15:25.760 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-09-15T22:15:25.762 INFO:teuthology.orchestra.run.smithi184.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-09-15T22:15:25.762 INFO:teuthology.orchestra.run.smithi184.stderr: Dload Upload Total Spent Left Speed 2021-09-15T22:15:25.762 INFO:teuthology.orchestra.run.smithi184.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-09-15T22:15:25.762 INFO:teuthology.orchestra.run.smithi184.stderr:curl: (7) Failed to connect to smithi184.front.sepia.ceph.com port 8001: Connection refused 2021-09-15T22:15:26.764 DEBUG:teuthology.orchestra.run.smithi184:> curl http://smithi184.front.sepia.ceph.com:8001 2021-09-15T22:15:26.779 INFO:teuthology.orchestra.run.smithi184.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-09-15T22:15:26.780 INFO:teuthology.orchestra.run.smithi184.stderr: Dload Upload Total Spent Left Speed 2021-09-15T22:15:26.781 INFO:teuthology.orchestra.run.smithi184.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 134 100 134 0 0 130k 0 --:--:-- --:--:-- --:--:-- 130k 2021-09-15T22:15:26.781 INFO:teuthology.orchestra.run.smithi184.stdout:{"Code":"MethodNotAllowed","RequestId":"tx000000000000000000001-006142707e-13a6-test-zone3","HostId":"13a6-test-zone3-test-zonegroup"} 2021-09-15T22:15:26.782 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:26.783 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:26.783 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:26.823 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:26.823 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:26.985 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:15:27.003 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744125.726764_30.1","last_update":"2021-09-15T22:15:25.726764Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:15:27.004 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:15:27.005 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:27.006 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:27.007 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:27.042 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:27.043 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:27.248 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744125.726764_30.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:25.726764Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:15:27.248 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:15:27.249 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:15:27.250 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:27.251 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:27.252 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:27.328 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:27.329 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:27.511 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744125.726764_30.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:25.726764Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:15:27.512 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:15:27.513 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-27 zones={test-zone2, test-zone1} 2021-09-15T22:15:27.527 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:15:27.579 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:15:27.634 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-27 zones={test-zone2, test-zone1} 2021-09-15T22:15:27.635 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-27 zones={test-zone1, test-zone2} 2021-09-15T22:15:27.642 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:15:27.687 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:15:27.744 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-27 zones={test-zone1, test-zone2} 2021-09-15T22:15:27.745 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-28 zones={test-zone2, test-zone1} 2021-09-15T22:15:27.756 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:15:27.807 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:15:27.865 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-28 zones={test-zone2, test-zone1} 2021-09-15T22:15:27.865 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-28 zones={test-zone1, test-zone2} 2021-09-15T22:15:27.874 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:15:27.919 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:15:27.976 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-28 zones={test-zone1, test-zone2} 2021-09-15T22:15:27.977 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-29 zones={test-zone2, test-zone1} 2021-09-15T22:15:27.986 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:15:28.031 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:15:28.088 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-29 zones={test-zone2, test-zone1} 2021-09-15T22:15:28.089 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-29 zones={test-zone1, test-zone2} 2021-09-15T22:15:28.098 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:15:28.143 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:15:28.199 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-29 zones={test-zone1, test-zone2} 2021-09-15T22:15:28.200 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-30 zones={test-zone2, test-zone1} 2021-09-15T22:15:28.211 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:15:28.259 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:15:28.317 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-30 zones={test-zone2, test-zone1} 2021-09-15T22:15:28.317 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-30 zones={test-zone1, test-zone2} 2021-09-15T22:15:28.326 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:15:28.371 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:15:28.428 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-30 zones={test-zone1, test-zone2} 2021-09-15T22:15:28.429 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-31 zones={test-zone2, test-zone1} 2021-09-15T22:15:28.438 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:15:28.487 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:15:28.545 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-31 zones={test-zone2, test-zone1} 2021-09-15T22:15:28.546 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-31 zones={test-zone1, test-zone2} 2021-09-15T22:15:28.554 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:15:28.599 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:15:28.656 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-31 zones={test-zone1, test-zone2} 2021-09-15T22:15:28.656 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-32 zones={test-zone2, test-zone1} 2021-09-15T22:15:28.664 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:15:28.711 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:15:28.769 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-32 zones={test-zone2, test-zone1} 2021-09-15T22:15:28.770 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-32 zones={test-zone1, test-zone2} 2021-09-15T22:15:28.779 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:15:28.827 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:15:28.888 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-32 zones={test-zone1, test-zone2} 2021-09-15T22:15:28.889 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'af209127-5081-4e40-be50-bf8d6eadaece', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:28.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'af209127-5081-4e40-be50-bf8d6eadaece', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:28.890 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period af209127-5081-4e40-be50-bf8d6eadaece --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:28.930 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:28.931 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:29.118 INFO:teuthology.orchestra.run.smithi180.stdout:[{"id":"1_1631743817.271234_18.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-09-15T22:10:17.271234334Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xo7AqEC6MOPJ7OacB_bFnhh","ver":1},"status":{"status":"write"}}},{"id":"1_1631743817.278003_20.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-09-15T22:10:17.278003633Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xo7AqEC6MOPJ7OacB_bFnhh","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743950.502922_59.1","section":"bucket.instance","name":"hankqd-10:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.14","timestamp":"2021-09-15T22:12:30.502922131Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_znaZPHI4AyFbHRzgSu-cu5g","ver":1},"status":{"status":"write"}}},{"id":"1_1631743950.507499_96.1","section":"bucket.instance","name":"hankqd-10:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.14","timestamp":"2021-09-15T22:12:30.507499319Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_znaZPHI4AyFbHRzgSu-cu5g","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743950.509216_97.1","section":"bucket","name":"hankqd-10","timestamp":"2021-09-15T22:12:30.509216047Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_46SxMOSdENKQL6y-zZOrCxR","ver":1},"status":{"status":"write"}}},{"id":"1_1631743950.513399_98.1","section":"bucket","name":"hankqd-10","timestamp":"2021-09-15T22:12:30.513399991Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_46SxMOSdENKQL6y-zZOrCxR","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743955.234801_99.1","section":"bucket.instance","name":"hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15","timestamp":"2021-09-15T22:12:35.234801629Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":1},"status":{"status":"write"}}},{"id":"1_1631743955.238856_121.1","section":"bucket.instance","name":"hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15","timestamp":"2021-09-15T22:12:35.238856396Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743955.240305_122.1","section":"bucket","name":"hankqd-11","timestamp":"2021-09-15T22:12:35.240305204Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_a6PXiNEjRiHTwp_ZjvX1kmZ","ver":1},"status":{"status":"write"}}},{"id":"1_1631743955.244047_123.1","section":"bucket","name":"hankqd-11","timestamp":"2021-09-15T22:12:35.244047358Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_a6PXiNEjRiHTwp_ZjvX1kmZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743955.259176_124.1","section":"bucket.instance","name":"hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16","timestamp":"2021-09-15T22:12:35.259176645Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":1},"status":{"status":"write"}}},{"id":"1_1631743955.264039_125.1","section":"bucket.instance","name":"hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16","timestamp":"2021-09-15T22:12:35.264039105Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743955.265763_126.1","section":"bucket","name":"hankqd-12","timestamp":"2021-09-15T22:12:35.265763833Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tS98Bv2PWHjKzZi9_btBZvL","ver":1},"status":{"status":"write"}}},{"id":"1_1631743955.269926_127.1","section":"bucket","name":"hankqd-12","timestamp":"2021-09-15T22:12:35.269926846Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tS98Bv2PWHjKzZi9_btBZvL","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743955.295488_128.1","section":"bucket.instance","name":"hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15","timestamp":"2021-09-15T22:12:35.295488270Z","data":{"read_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":1},"write_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":2},"status":{"status":"write"}}},{"id":"1_1631743955.302045_129.1","section":"bucket.instance","name":"hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15","timestamp":"2021-09-15T22:12:35.302045393Z","data":{"read_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":1},"write_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743955.308409_130.1","section":"bucket.instance","name":"hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16","timestamp":"2021-09-15T22:12:35.308409662Z","data":{"read_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":1},"write_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":2},"status":{"status":"write"}}},{"id":"1_1631743955.315255_131.1","section":"bucket.instance","name":"hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16","timestamp":"2021-09-15T22:12:35.315255801Z","data":{"read_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":1},"write_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743967.345497_132.1","section":"bucket.instance","name":"hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17","timestamp":"2021-09-15T22:12:47.345497266Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":1},"status":{"status":"write"}}},{"id":"1_1631743967.350181_181.1","section":"bucket.instance","name":"hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17","timestamp":"2021-09-15T22:12:47.350181537Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743967.351787_182.1","section":"bucket","name":"hankqd-13","timestamp":"2021-09-15T22:12:47.351787290Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RUC9GjHvFB6dnDxRK1CMi2j","ver":1},"status":{"status":"write"}}},{"id":"1_1631743967.355950_183.1","section":"bucket","name":"hankqd-13","timestamp":"2021-09-15T22:12:47.355950368Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RUC9GjHvFB6dnDxRK1CMi2j","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743967.360818_184.1","section":"bucket.instance","name":"hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17","timestamp":"2021-09-15T22:12:47.360818021Z","data":{"read_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":1},"write_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":2},"status":{"status":"write"}}},{"id":"1_1631743967.365759_185.1","section":"bucket.instance","name":"hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17","timestamp":"2021-09-15T22:12:47.365759572Z","data":{"read_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":1},"write_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743979.667492_186.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:12:59.667492300Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":1},"status":{"status":"write"}}},{"id":"1_1631743979.672840_217.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:12:59.672840948Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743979.674294_218.1","section":"bucket","name":"hankqd-14","timestamp":"2021-09-15T22:12:59.674294762Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_t0PIcz3Ig4B0cp6C3vb8IsR","ver":1},"status":{"status":"write"}}},{"id":"1_1631743979.677930_219.1","section":"bucket","name":"hankqd-14","timestamp":"2021-09-15T22:12:59.677930186Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_t0PIcz3Ig4B0cp6C3vb8IsR","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743981.990569_220.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:13:01.990569990Z","data":{"read_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":1},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":2},"status":{"status":"write"}}},{"id":"1_1631743981.997686_233.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:13:01.997686344Z","data":{"read_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":1},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743984.474676_234.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:13:04.474676161Z","data":{"read_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":2},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":3},"status":{"status":"write"}}},{"id":"1_1631743984.481313_247.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:13:04.481313319Z","data":{"read_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":2},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":3},"status":{"status":"complete"}}},{"id":"1_1631743986.952271_248.1","section":"bucket.instance","name":"hankqd-15:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.19","timestamp":"2021-09-15T22:13:06.952271276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":1},"status":{"status":"write"}}},{"id":"1_1631743986.957083_261.1","section":"bucket.instance","name":"hankqd-15:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.19","timestamp":"2021-09-15T22:13:06.957083555Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743986.958674_262.1","section":"bucket","name":"hankqd-15","timestamp":"2021-09-15T22:13:06.958674928Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VDpy42LJY97UbzJRFYK28Z-","ver":1},"status":{"status":"write"}}},{"id":"1_1631743986.962800_263.1","section":"bucket","name":"hankqd-15","timestamp":"2021-09-15T22:13:06.962800573Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VDpy42LJY97UbzJRFYK28Z-","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743986.980371_264.1","section":"bucket.instance","name":"hankqd-16:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.20","timestamp":"2021-09-15T22:13:06.980371215Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":1},"status":{"status":"write"}}},{"id":"1_1631743986.985226_265.1","section":"bucket.instance","name":"hankqd-16:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.20","timestamp":"2021-09-15T22:13:06.985226996Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743986.986895_266.1","section":"bucket","name":"hankqd-16","timestamp":"2021-09-15T22:13:06.986895500Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9DCOd2ibV0fyK6-66mrNaH1","ver":1},"status":{"status":"write"}}},{"id":"1_1631743986.991031_267.1","section":"bucket","name":"hankqd-16","timestamp":"2021-09-15T22:13:06.991031354Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9DCOd2ibV0fyK6-66mrNaH1","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743987.013536_268.1","section":"bucket.instance","name":"hankqd-15:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.19","timestamp":"2021-09-15T22:13:07.013536255Z","data":{"read_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":1},"write_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":2},"status":{"status":"write"}}},{"id":"1_1631743987.020330_269.1","section":"bucket.instance","name":"hankqd-15:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.19","timestamp":"2021-09-15T22:13:07.020330264Z","data":{"read_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":1},"write_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743987.028049_270.1","section":"bucket.instance","name":"hankqd-16:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.20","timestamp":"2021-09-15T22:13:07.028049674Z","data":{"read_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":1},"write_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":2},"status":{"status":"write"}}},{"id":"1_1631743987.034364_271.1","section":"bucket.instance","name":"hankqd-16:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.20","timestamp":"2021-09-15T22:13:07.034364724Z","data":{"read_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":1},"write_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743990.956757_272.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:10.956757678Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":1},"status":{"status":"write"}}},{"id":"1_1631743990.961058_294.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:10.961058671Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743990.962765_295.1","section":"bucket","name":"hankqd-17","timestamp":"2021-09-15T22:13:10.962765620Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TSvuv_glxJt6V1TGcKrOoQt","ver":1},"status":{"status":"write"}}},{"id":"1_1631743990.967052_296.1","section":"bucket","name":"hankqd-17","timestamp":"2021-09-15T22:13:10.967052278Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TSvuv_glxJt6V1TGcKrOoQt","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743990.983242_297.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:10.983242761Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":1},"status":{"status":"write"}}},{"id":"1_1631743990.988394_298.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:10.988394232Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743990.990057_299.1","section":"bucket","name":"hankqd-18","timestamp":"2021-09-15T22:13:10.990057342Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lE7ZWSDt_3efTHBsAuKGLez","ver":1},"status":{"status":"write"}}},{"id":"1_1631743990.994172_300.1","section":"bucket","name":"hankqd-18","timestamp":"2021-09-15T22:13:10.994172950Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lE7ZWSDt_3efTHBsAuKGLez","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743991.018410_301.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:11.018410444Z","data":{"read_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":1},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":2},"status":{"status":"write"}}},{"id":"1_1631743991.024587_302.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:11.024587610Z","data":{"read_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":1},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743991.028757_303.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:11.028757456Z","data":{"read_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":2},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":3},"status":{"status":"write"}}},{"id":"1_1631743991.034639_304.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:11.034639054Z","data":{"read_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":2},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":3},"status":{"status":"complete"}}},{"id":"1_1631743991.040276_305.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:11.040276709Z","data":{"read_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":1},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":2},"status":{"status":"write"}}},{"id":"1_1631743991.046539_306.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:11.046539857Z","data":{"read_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":1},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743991.057145_307.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:11.057145786Z","data":{"read_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":2},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":3},"status":{"status":"write"}}},{"id":"1_1631743991.063821_308.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:11.063821628Z","data":{"read_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":2},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":3},"status":{"status":"complete"}}},{"id":"1_1631743994.918717_309.1","section":"bucket.instance","name":"hankqd-19:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.23","timestamp":"2021-09-15T22:13:14.918717171Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":1},"status":{"status":"write"}}},{"id":"1_1631743994.923354_331.1","section":"bucket.instance","name":"hankqd-19:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.23","timestamp":"2021-09-15T22:13:14.923354504Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743994.924849_332.1","section":"bucket","name":"hankqd-19","timestamp":"2021-09-15T22:13:14.924849396Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PugD0rcUlmtCV_IKezHhV3I","ver":1},"status":{"status":"write"}}},{"id":"1_1631743994.928603_333.1","section":"bucket","name":"hankqd-19","timestamp":"2021-09-15T22:13:14.928603363Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PugD0rcUlmtCV_IKezHhV3I","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743994.944511_334.1","section":"bucket.instance","name":"hankqd-20:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.24","timestamp":"2021-09-15T22:13:14.944511954Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":1},"status":{"status":"write"}}},{"id":"1_1631743994.949303_335.1","section":"bucket.instance","name":"hankqd-20:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.24","timestamp":"2021-09-15T22:13:14.949303085Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743994.951095_336.1","section":"bucket","name":"hankqd-20","timestamp":"2021-09-15T22:13:14.951095435Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QiGLATHSTzzrGQVCEJF740f","ver":1},"status":{"status":"write"}}},{"id":"1_1631743994.955374_337.1","section":"bucket","name":"hankqd-20","timestamp":"2021-09-15T22:13:14.955374848Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QiGLATHSTzzrGQVCEJF740f","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743994.977292_338.1","section":"bucket.instance","name":"hankqd-19:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.23","timestamp":"2021-09-15T22:13:14.977292623Z","data":{"read_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":1},"write_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":2},"status":{"status":"write"}}},{"id":"1_1631743994.983715_339.1","section":"bucket.instance","name":"hankqd-19:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.23","timestamp":"2021-09-15T22:13:14.983715430Z","data":{"read_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":1},"write_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743995.034849_340.1","section":"bucket.instance","name":"hankqd-20:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.24","timestamp":"2021-09-15T22:13:15.034849757Z","data":{"read_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":1},"write_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":2},"status":{"status":"write"}}},{"id":"1_1631743995.042550_341.1","section":"bucket.instance","name":"hankqd-20:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.24","timestamp":"2021-09-15T22:13:15.042550273Z","data":{"read_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":1},"write_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743995.110226_342.1","section":"bucket.instance","name":"hankqd-21:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.25","timestamp":"2021-09-15T22:13:15.110226160Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.114423_343.1","section":"bucket.instance","name":"hankqd-21:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.25","timestamp":"2021-09-15T22:13:15.114423375Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.115788_344.1","section":"bucket","name":"hankqd-21","timestamp":"2021-09-15T22:13:15.115788860Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nWZKXhSabsjapRGh_gymr5O","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.119263_345.1","section":"bucket","name":"hankqd-21","timestamp":"2021-09-15T22:13:15.119263113Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nWZKXhSabsjapRGh_gymr5O","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.155288_346.1","section":"bucket.instance","name":"hankqd-22:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.26","timestamp":"2021-09-15T22:13:15.155288479Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.161172_347.1","section":"bucket.instance","name":"hankqd-22:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.26","timestamp":"2021-09-15T22:13:15.161172121Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.163439_348.1","section":"bucket","name":"hankqd-22","timestamp":"2021-09-15T22:13:15.163439155Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FAY8iaTnzzDnovua3Q2nfdK","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.169146_349.1","section":"bucket","name":"hankqd-22","timestamp":"2021-09-15T22:13:15.169146841Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FAY8iaTnzzDnovua3Q2nfdK","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.194355_350.1","section":"bucket.instance","name":"hankqd-21:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.25","timestamp":"2021-09-15T22:13:15.194355352Z","data":{"read_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":1},"write_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":2},"status":{"status":"write"}}},{"id":"1_1631743995.201344_351.1","section":"bucket.instance","name":"hankqd-21:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.25","timestamp":"2021-09-15T22:13:15.201344319Z","data":{"read_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":1},"write_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743995.252529_352.1","section":"bucket.instance","name":"hankqd-22:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.26","timestamp":"2021-09-15T22:13:15.252529433Z","data":{"read_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":1},"write_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":2},"status":{"status":"write"}}},{"id":"1_1631743995.260405_353.1","section":"bucket.instance","name":"hankqd-22:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.26","timestamp":"2021-09-15T22:13:15.260405788Z","data":{"read_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":1},"write_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743995.326410_354.1","section":"bucket.instance","name":"hankqd-23:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.27","timestamp":"2021-09-15T22:13:15.326410661Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.331313_355.1","section":"bucket.instance","name":"hankqd-23:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.27","timestamp":"2021-09-15T22:13:15.331313450Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.332795_356.1","section":"bucket","name":"hankqd-23","timestamp":"2021-09-15T22:13:15.332795547Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MYEnqiCGOcshjAWGANxZ5am","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.336435_357.1","section":"bucket","name":"hankqd-23","timestamp":"2021-09-15T22:13:15.336435454Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MYEnqiCGOcshjAWGANxZ5am","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.350632_358.1","section":"bucket.instance","name":"hankqd-24:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.28","timestamp":"2021-09-15T22:13:15.350632062Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.355244_359.1","section":"bucket.instance","name":"hankqd-24:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.28","timestamp":"2021-09-15T22:13:15.355244692Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.357076_360.1","section":"bucket","name":"hankqd-24","timestamp":"2021-09-15T22:13:15.357076501Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vOKAvOu7Pcaa_olzsV0pkR-","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.361398_361.1","section":"bucket","name":"hankqd-24","timestamp":"2021-09-15T22:13:15.361398783Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vOKAvOu7Pcaa_olzsV0pkR-","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.381682_362.1","section":"bucket.instance","name":"hankqd-23:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.27","timestamp":"2021-09-15T22:13:15.381682006Z","data":{"read_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":1},"write_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":2},"status":{"status":"write"}}},{"id":"1_1631743995.388238_363.1","section":"bucket.instance","name":"hankqd-23:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.27","timestamp":"2021-09-15T22:13:15.388238644Z","data":{"read_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":1},"write_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743996.443270_364.1","section":"bucket.instance","name":"hankqd-24:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.28","timestamp":"2021-09-15T22:13:16.443270365Z","data":{"read_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":1},"write_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":2},"status":{"status":"write"}}},{"id":"1_1631743996.451200_365.1","section":"bucket.instance","name":"hankqd-24:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.28","timestamp":"2021-09-15T22:13:16.451200327Z","data":{"read_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":1},"write_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743996.514657_366.1","section":"bucket.instance","name":"hankqd-25:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.29","timestamp":"2021-09-15T22:13:16.514657934Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KjP3PDFoTfeHnv9-Slxzno9","ver":1},"status":{"status":"write"}}},{"id":"1_1631743996.519433_367.1","section":"bucket.instance","name":"hankqd-25:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.29","timestamp":"2021-09-15T22:13:16.519433800Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KjP3PDFoTfeHnv9-Slxzno9","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743996.521178_368.1","section":"bucket","name":"hankqd-25","timestamp":"2021-09-15T22:13:16.521178152Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fFZRcTdOz3c9mjL_AzVPHjo","ver":1},"status":{"status":"write"}}},{"id":"1_1631743996.525074_369.1","section":"bucket","name":"hankqd-25","timestamp":"2021-09-15T22:13:16.525074316Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fFZRcTdOz3c9mjL_AzVPHjo","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743996.540442_370.1","section":"bucket.instance","name":"hankqd-26:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.30","timestamp":"2021-09-15T22:13:16.540442762Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_luSJ8yo1oJWpbltmmyVl0ln","ver":1},"status":{"status":"write"}}},{"id":"1_1631743996.545115_371.1","section":"bucket.instance","name":"hankqd-26:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.30","timestamp":"2021-09-15T22:13:16.545115188Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_luSJ8yo1oJWpbltmmyVl0ln","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743996.546837_372.1","section":"bucket","name":"hankqd-26","timestamp":"2021-09-15T22:13:16.546837638Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lEiHEBu46sCqSxbQgXQQyT6","ver":1},"status":{"status":"write"}}},{"id":"1_1631743996.550713_373.1","section":"bucket","name":"hankqd-26","timestamp":"2021-09-15T22:13:16.550713028Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lEiHEBu46sCqSxbQgXQQyT6","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743997.484630_374.1","section":"bucket.instance","name":"hankqd-27:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.31","timestamp":"2021-09-15T22:13:17.484630996Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FtVsBuWUYoWXkD8Fe6Kc6cZ","ver":1},"status":{"status":"write"}}},{"id":"1_1631743997.489440_378.1","section":"bucket.instance","name":"hankqd-27:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.31","timestamp":"2021-09-15T22:13:17.489440277Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FtVsBuWUYoWXkD8Fe6Kc6cZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743997.491920_379.1","section":"bucket","name":"hankqd-27","timestamp":"2021-09-15T22:13:17.491920896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bcx0RuWivIDlLzafzdJqBR3","ver":1},"status":{"status":"write"}}},{"id":"1_1631743997.496386_380.1","section":"bucket","name":"hankqd-27","timestamp":"2021-09-15T22:13:17.496386784Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bcx0RuWivIDlLzafzdJqBR3","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743997.511340_381.1","section":"bucket.instance","name":"hankqd-28:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.32","timestamp":"2021-09-15T22:13:17.511340710Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0az6d2dZuD-enVkRwMMgGr9","ver":1},"status":{"status":"write"}}},{"id":"1_1631743997.516223_382.1","section":"bucket.instance","name":"hankqd-28:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.32","timestamp":"2021-09-15T22:13:17.516223559Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0az6d2dZuD-enVkRwMMgGr9","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743997.517820_383.1","section":"bucket","name":"hankqd-28","timestamp":"2021-09-15T22:13:17.517820365Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2pZymphOcQ4MV_eLLE06fix","ver":1},"status":{"status":"write"}}},{"id":"1_1631743997.520998_384.1","section":"bucket","name":"hankqd-28","timestamp":"2021-09-15T22:13:17.520998420Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2pZymphOcQ4MV_eLLE06fix","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743937.659167_54.1","section":"bucket.instance","name":"hankqd-1:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.1","timestamp":"2021-09-15T22:12:17.659167670Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5cwRHF16-29R0Lkcsu-U2Ru","ver":1},"status":{"status":"write"}}},{"id":"1_1631743937.663304_58.1","section":"bucket.instance","name":"hankqd-1:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.1","timestamp":"2021-09-15T22:12:17.663304852Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5cwRHF16-29R0Lkcsu-U2Ru","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743937.664905_59.1","section":"bucket","name":"hankqd-1","timestamp":"2021-09-15T22:12:17.664905756Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Io5EpDIAcwLzEUS0gK5viyr","ver":1},"status":{"status":"write"}}},{"id":"1_1631743937.668698_60.1","section":"bucket","name":"hankqd-1","timestamp":"2021-09-15T22:12:17.668698939Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Io5EpDIAcwLzEUS0gK5viyr","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743937.685420_61.1","section":"bucket.instance","name":"hankqd-2:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.2","timestamp":"2021-09-15T22:12:17.685420677Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XZUEeRke2VDVqC_53Up_Jxq","ver":1},"status":{"status":"write"}}},{"id":"1_1631743937.689744_62.1","section":"bucket.instance","name":"hankqd-2:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.2","timestamp":"2021-09-15T22:12:17.689744314Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XZUEeRke2VDVqC_53Up_Jxq","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743937.691415_63.1","section":"bucket","name":"hankqd-2","timestamp":"2021-09-15T22:12:17.691415458Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_95kwllADHZ7achbk2Q_9qqn","ver":1},"status":{"status":"write"}}},{"id":"1_1631743937.695821_64.1","section":"bucket","name":"hankqd-2","timestamp":"2021-09-15T22:12:17.695821310Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_95kwllADHZ7achbk2Q_9qqn","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743942.275198_65.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.3","timestamp":"2021-09-15T22:12:22.275198764Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_AzycQ4WWBoBCZ2HtHd5IvgY","ver":1},"status":{"status":"write"}}},{"id":"1_1631743942.280831_67.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.3","timestamp":"2021-09-15T22:12:22.280831508Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_AzycQ4WWBoBCZ2HtHd5IvgY","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743942.282381_68.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:22.282381887Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_H0nkaB1EPZlsDJgjV3CyDp9","ver":1},"status":{"status":"write"}}},{"id":"1_1631743942.286263_69.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:22.286263414Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_H0nkaB1EPZlsDJgjV3CyDp9","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743942.300217_71.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.4","timestamp":"2021-09-15T22:12:22.300217042Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9_0mKgFpUQJxVJR4y4OJS-9","ver":1},"status":{"status":"write"}}},{"id":"1_1631743942.305430_72.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.4","timestamp":"2021-09-15T22:12:22.305430722Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9_0mKgFpUQJxVJR4y4OJS-9","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743942.307495_73.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:22.307495873Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PB3PAsnC65MjF6xStQAkfq8","ver":1},"status":{"status":"write"}}},{"id":"1_1631743942.312355_74.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:22.312355814Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PB3PAsnC65MjF6xStQAkfq8","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.023724_77.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.5","timestamp":"2021-09-15T22:12:23.023724893Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0eDmuivrlKsaYcgYe_sjUHH","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.028869_78.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.5","timestamp":"2021-09-15T22:12:23.028869491Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0eDmuivrlKsaYcgYe_sjUHH","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.030661_79.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:23.030661824Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__hsE-3JEFMHY0lqnWxC2ZnV","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.033863_80.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:23.033863025Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__hsE-3JEFMHY0lqnWxC2ZnV","ver":1},"status":{"status":"abort"}}},{"id":"1_1631743943.053878_82.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.6","timestamp":"2021-09-15T22:12:23.053878356Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UTLUV4_XosaRXQa2kAoqDsz","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.058502_83.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.6","timestamp":"2021-09-15T22:12:23.058502048Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UTLUV4_XosaRXQa2kAoqDsz","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.060196_84.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:23.060196936Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CZ_LW9KZ8QtNtekZwBhRzy1","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.063333_85.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:23.063333358Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CZ_LW9KZ8QtNtekZwBhRzy1","ver":1},"status":{"status":"abort"}}},{"id":"1_1631743943.087049_86.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.7","timestamp":"2021-09-15T22:12:23.087049711Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BpK0zYZI19XIqO9yuM8xqJ0","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.091832_87.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.7","timestamp":"2021-09-15T22:12:23.091832174Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BpK0zYZI19XIqO9yuM8xqJ0","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.093539_88.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:23.093539224Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_144jKnihoRMezOKobXHx7Vw","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.096863_89.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:23.096863862Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_144jKnihoRMezOKobXHx7Vw","ver":1},"status":{"status":"abort"}}},{"id":"1_1631743943.137904_91.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.8","timestamp":"2021-09-15T22:12:23.137904973Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0DtGO5JfyJP8_6Av-Zql3IQ","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.142603_92.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.8","timestamp":"2021-09-15T22:12:23.142603806Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0DtGO5JfyJP8_6Av-Zql3IQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.144115_93.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:23.144115202Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Iday9Dcph6GVUKDPl8hDaYc","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.146773_94.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:23.146773683Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Iday9Dcph6GVUKDPl8hDaYc","ver":1},"status":{"status":"abort"}}},{"id":"1_1631743943.902515_98.1","section":"bucket.instance","name":"hankqd-5:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.9","timestamp":"2021-09-15T22:12:23.902515394Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pugWTIyfu0Vz6pkXXIz-TcK","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.907513_99.1","section":"bucket.instance","name":"hankqd-5:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.9","timestamp":"2021-09-15T22:12:23.907513173Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pugWTIyfu0Vz6pkXXIz-TcK","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.909419_100.1","section":"bucket","name":"hankqd-5","timestamp":"2021-09-15T22:12:23.909419805Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.913682_101.1","section":"bucket","name":"hankqd-5","timestamp":"2021-09-15T22:12:23.913682171Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.929258_102.1","section":"bucket.instance","name":"hankqd-6:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.10","timestamp":"2021-09-15T22:12:23.929258868Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_660i0JJ4j9-_zOyHTnAYaT0","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.933885_103.1","section":"bucket.instance","name":"hankqd-6:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.10","timestamp":"2021-09-15T22:12:23.933885084Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_660i0JJ4j9-_zOyHTnAYaT0","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.935419_104.1","section":"bucket","name":"hankqd-6","timestamp":"2021-09-15T22:12:23.935419218Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.939854_105.1","section":"bucket","name":"hankqd-6","timestamp":"2021-09-15T22:12:23.939854257Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743944.664778_106.1","section":"bucket","name":"hankqd-5","timestamp":"2021-09-15T22:12:24.664778523Z","data":{"read_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":1},"write_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":2},"status":{"status":"remove"}}},{"id":"1_1631743944.669089_108.1","section":"bucket","name":"hankqd-5","timestamp":"2021-09-15T22:12:24.669089716Z","data":{"read_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":1},"write_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743944.709840_109.1","section":"bucket","name":"hankqd-6","timestamp":"2021-09-15T22:12:24.709840508Z","data":{"read_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":1},"write_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":2},"status":{"status":"remove"}}},{"id":"1_1631743944.716073_110.1","section":"bucket","name":"hankqd-6","timestamp":"2021-09-15T22:12:24.716073955Z","data":{"read_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":1},"write_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743945.464352_111.1","section":"bucket.instance","name":"hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11","timestamp":"2021-09-15T22:12:25.464352734Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_b6ayLL59Y9o7wOZW0FGozy-","ver":1},"status":{"status":"write"}}},{"id":"1_1631743945.469866_113.1","section":"bucket.instance","name":"hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11","timestamp":"2021-09-15T22:12:25.469866428Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_b6ayLL59Y9o7wOZW0FGozy-","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743945.471171_114.1","section":"bucket","name":"hankqd-7","timestamp":"2021-09-15T22:12:25.471171963Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_JPVWc1DiB8OnzCSO5rd4wI8","ver":1},"status":{"status":"write"}}},{"id":"1_1631743945.474747_115.1","section":"bucket","name":"hankqd-7","timestamp":"2021-09-15T22:12:25.474747340Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_JPVWc1DiB8OnzCSO5rd4wI8","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743945.488230_116.1","section":"bucket.instance","name":"hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12","timestamp":"2021-09-15T22:12:25.488230335Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_f8JFACXCUvrNmkd3pBY9FH5","ver":1},"status":{"status":"write"}}},{"id":"1_1631743945.492743_117.1","section":"bucket.instance","name":"hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12","timestamp":"2021-09-15T22:12:25.492743011Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_f8JFACXCUvrNmkd3pBY9FH5","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743945.494423_118.1","section":"bucket","name":"hankqd-8","timestamp":"2021-09-15T22:12:25.494423225Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6JGK40raGd1DF50pdx5AQgf","ver":1},"status":{"status":"write"}}},{"id":"1_1631743945.498539_119.1","section":"bucket","name":"hankqd-8","timestamp":"2021-09-15T22:12:25.498539113Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6JGK40raGd1DF50pdx5AQgf","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743950.477075_120.1","section":"bucket.instance","name":"hankqd-9:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.13","timestamp":"2021-09-15T22:12:30.477075888Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_yY0I9vcghWG39r2rLPLHXtI","ver":1},"status":{"status":"write"}}},{"id":"1_1631743950.481516_125.1","section":"bucket.instance","name":"hankqd-9:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.13","timestamp":"2021-09-15T22:12:30.481516555Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_yY0I9vcghWG39r2rLPLHXtI","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743950.482960_126.1","section":"bucket","name":"hankqd-9","timestamp":"2021-09-15T22:12:30.482960777Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_o88BD0nNkjD8nOj-3RMOpBj","ver":1},"status":{"status":"write"}}},{"id":"1_1631743950.486515_127.1","section":"bucket","name":"hankqd-9","timestamp":"2021-09-15T22:12:30.486515920Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_o88BD0nNkjD8nOj-3RMOpBj","ver":1},"status":{"status":"complete"}}}] 2021-09-15T22:15:29.124 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'af209127-5081-4e40-be50-bf8d6eadaece', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:29.124 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'af209127-5081-4e40-be50-bf8d6eadaece', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:29.125 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period af209127-5081-4e40-be50-bf8d6eadaece --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:29.163 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:29.163 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:29.356 INFO:teuthology.orchestra.run.smithi184.stdout:[{"id":"1_1631743817.271234_18.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-09-15T22:10:17.271234334Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xo7AqEC6MOPJ7OacB_bFnhh","ver":1},"status":{"status":"write"}}},{"id":"1_1631743817.278003_20.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-09-15T22:10:17.278003633Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xo7AqEC6MOPJ7OacB_bFnhh","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743950.502922_59.1","section":"bucket.instance","name":"hankqd-10:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.14","timestamp":"2021-09-15T22:12:30.502922131Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_znaZPHI4AyFbHRzgSu-cu5g","ver":1},"status":{"status":"write"}}},{"id":"1_1631743950.507499_96.1","section":"bucket.instance","name":"hankqd-10:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.14","timestamp":"2021-09-15T22:12:30.507499319Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_znaZPHI4AyFbHRzgSu-cu5g","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743950.509216_97.1","section":"bucket","name":"hankqd-10","timestamp":"2021-09-15T22:12:30.509216047Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_46SxMOSdENKQL6y-zZOrCxR","ver":1},"status":{"status":"write"}}},{"id":"1_1631743950.513399_98.1","section":"bucket","name":"hankqd-10","timestamp":"2021-09-15T22:12:30.513399991Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_46SxMOSdENKQL6y-zZOrCxR","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743955.234801_99.1","section":"bucket.instance","name":"hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15","timestamp":"2021-09-15T22:12:35.234801629Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":1},"status":{"status":"write"}}},{"id":"1_1631743955.238856_121.1","section":"bucket.instance","name":"hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15","timestamp":"2021-09-15T22:12:35.238856396Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743955.240305_122.1","section":"bucket","name":"hankqd-11","timestamp":"2021-09-15T22:12:35.240305204Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_a6PXiNEjRiHTwp_ZjvX1kmZ","ver":1},"status":{"status":"write"}}},{"id":"1_1631743955.244047_123.1","section":"bucket","name":"hankqd-11","timestamp":"2021-09-15T22:12:35.244047358Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_a6PXiNEjRiHTwp_ZjvX1kmZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743955.259176_124.1","section":"bucket.instance","name":"hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16","timestamp":"2021-09-15T22:12:35.259176645Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":1},"status":{"status":"write"}}},{"id":"1_1631743955.264039_125.1","section":"bucket.instance","name":"hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16","timestamp":"2021-09-15T22:12:35.264039105Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743955.265763_126.1","section":"bucket","name":"hankqd-12","timestamp":"2021-09-15T22:12:35.265763833Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tS98Bv2PWHjKzZi9_btBZvL","ver":1},"status":{"status":"write"}}},{"id":"1_1631743955.269926_127.1","section":"bucket","name":"hankqd-12","timestamp":"2021-09-15T22:12:35.269926846Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tS98Bv2PWHjKzZi9_btBZvL","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743955.295488_128.1","section":"bucket.instance","name":"hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15","timestamp":"2021-09-15T22:12:35.295488270Z","data":{"read_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":1},"write_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":2},"status":{"status":"write"}}},{"id":"1_1631743955.302045_129.1","section":"bucket.instance","name":"hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15","timestamp":"2021-09-15T22:12:35.302045393Z","data":{"read_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":1},"write_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743955.308409_130.1","section":"bucket.instance","name":"hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16","timestamp":"2021-09-15T22:12:35.308409662Z","data":{"read_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":1},"write_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":2},"status":{"status":"write"}}},{"id":"1_1631743955.315255_131.1","section":"bucket.instance","name":"hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16","timestamp":"2021-09-15T22:12:35.315255801Z","data":{"read_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":1},"write_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743967.345497_132.1","section":"bucket.instance","name":"hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17","timestamp":"2021-09-15T22:12:47.345497266Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":1},"status":{"status":"write"}}},{"id":"1_1631743967.350181_181.1","section":"bucket.instance","name":"hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17","timestamp":"2021-09-15T22:12:47.350181537Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743967.351787_182.1","section":"bucket","name":"hankqd-13","timestamp":"2021-09-15T22:12:47.351787290Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RUC9GjHvFB6dnDxRK1CMi2j","ver":1},"status":{"status":"write"}}},{"id":"1_1631743967.355950_183.1","section":"bucket","name":"hankqd-13","timestamp":"2021-09-15T22:12:47.355950368Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RUC9GjHvFB6dnDxRK1CMi2j","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743967.360818_184.1","section":"bucket.instance","name":"hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17","timestamp":"2021-09-15T22:12:47.360818021Z","data":{"read_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":1},"write_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":2},"status":{"status":"write"}}},{"id":"1_1631743967.365759_185.1","section":"bucket.instance","name":"hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17","timestamp":"2021-09-15T22:12:47.365759572Z","data":{"read_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":1},"write_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743979.667492_186.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:12:59.667492300Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":1},"status":{"status":"write"}}},{"id":"1_1631743979.672840_217.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:12:59.672840948Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743979.674294_218.1","section":"bucket","name":"hankqd-14","timestamp":"2021-09-15T22:12:59.674294762Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_t0PIcz3Ig4B0cp6C3vb8IsR","ver":1},"status":{"status":"write"}}},{"id":"1_1631743979.677930_219.1","section":"bucket","name":"hankqd-14","timestamp":"2021-09-15T22:12:59.677930186Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_t0PIcz3Ig4B0cp6C3vb8IsR","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743981.990569_220.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:13:01.990569990Z","data":{"read_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":1},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":2},"status":{"status":"write"}}},{"id":"1_1631743981.997686_233.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:13:01.997686344Z","data":{"read_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":1},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743984.474676_234.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:13:04.474676161Z","data":{"read_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":2},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":3},"status":{"status":"write"}}},{"id":"1_1631743984.481313_247.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:13:04.481313319Z","data":{"read_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":2},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":3},"status":{"status":"complete"}}},{"id":"1_1631743986.952271_248.1","section":"bucket.instance","name":"hankqd-15:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.19","timestamp":"2021-09-15T22:13:06.952271276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":1},"status":{"status":"write"}}},{"id":"1_1631743986.957083_261.1","section":"bucket.instance","name":"hankqd-15:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.19","timestamp":"2021-09-15T22:13:06.957083555Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743986.958674_262.1","section":"bucket","name":"hankqd-15","timestamp":"2021-09-15T22:13:06.958674928Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VDpy42LJY97UbzJRFYK28Z-","ver":1},"status":{"status":"write"}}},{"id":"1_1631743986.962800_263.1","section":"bucket","name":"hankqd-15","timestamp":"2021-09-15T22:13:06.962800573Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VDpy42LJY97UbzJRFYK28Z-","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743986.980371_264.1","section":"bucket.instance","name":"hankqd-16:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.20","timestamp":"2021-09-15T22:13:06.980371215Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":1},"status":{"status":"write"}}},{"id":"1_1631743986.985226_265.1","section":"bucket.instance","name":"hankqd-16:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.20","timestamp":"2021-09-15T22:13:06.985226996Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743986.986895_266.1","section":"bucket","name":"hankqd-16","timestamp":"2021-09-15T22:13:06.986895500Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9DCOd2ibV0fyK6-66mrNaH1","ver":1},"status":{"status":"write"}}},{"id":"1_1631743986.991031_267.1","section":"bucket","name":"hankqd-16","timestamp":"2021-09-15T22:13:06.991031354Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9DCOd2ibV0fyK6-66mrNaH1","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743987.013536_268.1","section":"bucket.instance","name":"hankqd-15:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.19","timestamp":"2021-09-15T22:13:07.013536255Z","data":{"read_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":1},"write_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":2},"status":{"status":"write"}}},{"id":"1_1631743987.020330_269.1","section":"bucket.instance","name":"hankqd-15:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.19","timestamp":"2021-09-15T22:13:07.020330264Z","data":{"read_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":1},"write_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743987.028049_270.1","section":"bucket.instance","name":"hankqd-16:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.20","timestamp":"2021-09-15T22:13:07.028049674Z","data":{"read_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":1},"write_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":2},"status":{"status":"write"}}},{"id":"1_1631743987.034364_271.1","section":"bucket.instance","name":"hankqd-16:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.20","timestamp":"2021-09-15T22:13:07.034364724Z","data":{"read_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":1},"write_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743990.956757_272.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:10.956757678Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":1},"status":{"status":"write"}}},{"id":"1_1631743990.961058_294.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:10.961058671Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743990.962765_295.1","section":"bucket","name":"hankqd-17","timestamp":"2021-09-15T22:13:10.962765620Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TSvuv_glxJt6V1TGcKrOoQt","ver":1},"status":{"status":"write"}}},{"id":"1_1631743990.967052_296.1","section":"bucket","name":"hankqd-17","timestamp":"2021-09-15T22:13:10.967052278Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TSvuv_glxJt6V1TGcKrOoQt","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743990.983242_297.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:10.983242761Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":1},"status":{"status":"write"}}},{"id":"1_1631743990.988394_298.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:10.988394232Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743990.990057_299.1","section":"bucket","name":"hankqd-18","timestamp":"2021-09-15T22:13:10.990057342Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lE7ZWSDt_3efTHBsAuKGLez","ver":1},"status":{"status":"write"}}},{"id":"1_1631743990.994172_300.1","section":"bucket","name":"hankqd-18","timestamp":"2021-09-15T22:13:10.994172950Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lE7ZWSDt_3efTHBsAuKGLez","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743991.018410_301.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:11.018410444Z","data":{"read_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":1},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":2},"status":{"status":"write"}}},{"id":"1_1631743991.024587_302.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:11.024587610Z","data":{"read_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":1},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743991.028757_303.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:11.028757456Z","data":{"read_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":2},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":3},"status":{"status":"write"}}},{"id":"1_1631743991.034639_304.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:11.034639054Z","data":{"read_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":2},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":3},"status":{"status":"complete"}}},{"id":"1_1631743991.040276_305.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:11.040276709Z","data":{"read_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":1},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":2},"status":{"status":"write"}}},{"id":"1_1631743991.046539_306.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:11.046539857Z","data":{"read_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":1},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743991.057145_307.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:11.057145786Z","data":{"read_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":2},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":3},"status":{"status":"write"}}},{"id":"1_1631743991.063821_308.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:11.063821628Z","data":{"read_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":2},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":3},"status":{"status":"complete"}}},{"id":"1_1631743994.918717_309.1","section":"bucket.instance","name":"hankqd-19:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.23","timestamp":"2021-09-15T22:13:14.918717171Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":1},"status":{"status":"write"}}},{"id":"1_1631743994.923354_331.1","section":"bucket.instance","name":"hankqd-19:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.23","timestamp":"2021-09-15T22:13:14.923354504Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743994.924849_332.1","section":"bucket","name":"hankqd-19","timestamp":"2021-09-15T22:13:14.924849396Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PugD0rcUlmtCV_IKezHhV3I","ver":1},"status":{"status":"write"}}},{"id":"1_1631743994.928603_333.1","section":"bucket","name":"hankqd-19","timestamp":"2021-09-15T22:13:14.928603363Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PugD0rcUlmtCV_IKezHhV3I","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743994.944511_334.1","section":"bucket.instance","name":"hankqd-20:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.24","timestamp":"2021-09-15T22:13:14.944511954Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":1},"status":{"status":"write"}}},{"id":"1_1631743994.949303_335.1","section":"bucket.instance","name":"hankqd-20:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.24","timestamp":"2021-09-15T22:13:14.949303085Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743994.951095_336.1","section":"bucket","name":"hankqd-20","timestamp":"2021-09-15T22:13:14.951095435Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QiGLATHSTzzrGQVCEJF740f","ver":1},"status":{"status":"write"}}},{"id":"1_1631743994.955374_337.1","section":"bucket","name":"hankqd-20","timestamp":"2021-09-15T22:13:14.955374848Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QiGLATHSTzzrGQVCEJF740f","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743994.977292_338.1","section":"bucket.instance","name":"hankqd-19:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.23","timestamp":"2021-09-15T22:13:14.977292623Z","data":{"read_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":1},"write_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":2},"status":{"status":"write"}}},{"id":"1_1631743994.983715_339.1","section":"bucket.instance","name":"hankqd-19:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.23","timestamp":"2021-09-15T22:13:14.983715430Z","data":{"read_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":1},"write_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743995.034849_340.1","section":"bucket.instance","name":"hankqd-20:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.24","timestamp":"2021-09-15T22:13:15.034849757Z","data":{"read_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":1},"write_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":2},"status":{"status":"write"}}},{"id":"1_1631743995.042550_341.1","section":"bucket.instance","name":"hankqd-20:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.24","timestamp":"2021-09-15T22:13:15.042550273Z","data":{"read_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":1},"write_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743995.110226_342.1","section":"bucket.instance","name":"hankqd-21:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.25","timestamp":"2021-09-15T22:13:15.110226160Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.114423_343.1","section":"bucket.instance","name":"hankqd-21:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.25","timestamp":"2021-09-15T22:13:15.114423375Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.115788_344.1","section":"bucket","name":"hankqd-21","timestamp":"2021-09-15T22:13:15.115788860Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nWZKXhSabsjapRGh_gymr5O","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.119263_345.1","section":"bucket","name":"hankqd-21","timestamp":"2021-09-15T22:13:15.119263113Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nWZKXhSabsjapRGh_gymr5O","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.155288_346.1","section":"bucket.instance","name":"hankqd-22:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.26","timestamp":"2021-09-15T22:13:15.155288479Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.161172_347.1","section":"bucket.instance","name":"hankqd-22:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.26","timestamp":"2021-09-15T22:13:15.161172121Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.163439_348.1","section":"bucket","name":"hankqd-22","timestamp":"2021-09-15T22:13:15.163439155Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FAY8iaTnzzDnovua3Q2nfdK","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.169146_349.1","section":"bucket","name":"hankqd-22","timestamp":"2021-09-15T22:13:15.169146841Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FAY8iaTnzzDnovua3Q2nfdK","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.194355_350.1","section":"bucket.instance","name":"hankqd-21:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.25","timestamp":"2021-09-15T22:13:15.194355352Z","data":{"read_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":1},"write_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":2},"status":{"status":"write"}}},{"id":"1_1631743995.201344_351.1","section":"bucket.instance","name":"hankqd-21:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.25","timestamp":"2021-09-15T22:13:15.201344319Z","data":{"read_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":1},"write_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743995.252529_352.1","section":"bucket.instance","name":"hankqd-22:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.26","timestamp":"2021-09-15T22:13:15.252529433Z","data":{"read_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":1},"write_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":2},"status":{"status":"write"}}},{"id":"1_1631743995.260405_353.1","section":"bucket.instance","name":"hankqd-22:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.26","timestamp":"2021-09-15T22:13:15.260405788Z","data":{"read_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":1},"write_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743995.326410_354.1","section":"bucket.instance","name":"hankqd-23:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.27","timestamp":"2021-09-15T22:13:15.326410661Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.331313_355.1","section":"bucket.instance","name":"hankqd-23:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.27","timestamp":"2021-09-15T22:13:15.331313450Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.332795_356.1","section":"bucket","name":"hankqd-23","timestamp":"2021-09-15T22:13:15.332795547Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MYEnqiCGOcshjAWGANxZ5am","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.336435_357.1","section":"bucket","name":"hankqd-23","timestamp":"2021-09-15T22:13:15.336435454Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MYEnqiCGOcshjAWGANxZ5am","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.350632_358.1","section":"bucket.instance","name":"hankqd-24:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.28","timestamp":"2021-09-15T22:13:15.350632062Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.355244_359.1","section":"bucket.instance","name":"hankqd-24:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.28","timestamp":"2021-09-15T22:13:15.355244692Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.357076_360.1","section":"bucket","name":"hankqd-24","timestamp":"2021-09-15T22:13:15.357076501Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vOKAvOu7Pcaa_olzsV0pkR-","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.361398_361.1","section":"bucket","name":"hankqd-24","timestamp":"2021-09-15T22:13:15.361398783Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vOKAvOu7Pcaa_olzsV0pkR-","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.381682_362.1","section":"bucket.instance","name":"hankqd-23:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.27","timestamp":"2021-09-15T22:13:15.381682006Z","data":{"read_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":1},"write_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":2},"status":{"status":"write"}}},{"id":"1_1631743995.388238_363.1","section":"bucket.instance","name":"hankqd-23:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.27","timestamp":"2021-09-15T22:13:15.388238644Z","data":{"read_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":1},"write_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743996.443270_364.1","section":"bucket.instance","name":"hankqd-24:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.28","timestamp":"2021-09-15T22:13:16.443270365Z","data":{"read_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":1},"write_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":2},"status":{"status":"write"}}},{"id":"1_1631743996.451200_365.1","section":"bucket.instance","name":"hankqd-24:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.28","timestamp":"2021-09-15T22:13:16.451200327Z","data":{"read_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":1},"write_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743996.514657_366.1","section":"bucket.instance","name":"hankqd-25:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.29","timestamp":"2021-09-15T22:13:16.514657934Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KjP3PDFoTfeHnv9-Slxzno9","ver":1},"status":{"status":"write"}}},{"id":"1_1631743996.519433_367.1","section":"bucket.instance","name":"hankqd-25:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.29","timestamp":"2021-09-15T22:13:16.519433800Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KjP3PDFoTfeHnv9-Slxzno9","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743996.521178_368.1","section":"bucket","name":"hankqd-25","timestamp":"2021-09-15T22:13:16.521178152Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fFZRcTdOz3c9mjL_AzVPHjo","ver":1},"status":{"status":"write"}}},{"id":"1_1631743996.525074_369.1","section":"bucket","name":"hankqd-25","timestamp":"2021-09-15T22:13:16.525074316Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fFZRcTdOz3c9mjL_AzVPHjo","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743996.540442_370.1","section":"bucket.instance","name":"hankqd-26:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.30","timestamp":"2021-09-15T22:13:16.540442762Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_luSJ8yo1oJWpbltmmyVl0ln","ver":1},"status":{"status":"write"}}},{"id":"1_1631743996.545115_371.1","section":"bucket.instance","name":"hankqd-26:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.30","timestamp":"2021-09-15T22:13:16.545115188Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_luSJ8yo1oJWpbltmmyVl0ln","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743996.546837_372.1","section":"bucket","name":"hankqd-26","timestamp":"2021-09-15T22:13:16.546837638Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lEiHEBu46sCqSxbQgXQQyT6","ver":1},"status":{"status":"write"}}},{"id":"1_1631743996.550713_373.1","section":"bucket","name":"hankqd-26","timestamp":"2021-09-15T22:13:16.550713028Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lEiHEBu46sCqSxbQgXQQyT6","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743997.484630_374.1","section":"bucket.instance","name":"hankqd-27:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.31","timestamp":"2021-09-15T22:13:17.484630996Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FtVsBuWUYoWXkD8Fe6Kc6cZ","ver":1},"status":{"status":"write"}}},{"id":"1_1631743997.489440_378.1","section":"bucket.instance","name":"hankqd-27:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.31","timestamp":"2021-09-15T22:13:17.489440277Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FtVsBuWUYoWXkD8Fe6Kc6cZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743997.491920_379.1","section":"bucket","name":"hankqd-27","timestamp":"2021-09-15T22:13:17.491920896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bcx0RuWivIDlLzafzdJqBR3","ver":1},"status":{"status":"write"}}},{"id":"1_1631743997.496386_380.1","section":"bucket","name":"hankqd-27","timestamp":"2021-09-15T22:13:17.496386784Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bcx0RuWivIDlLzafzdJqBR3","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743997.511340_381.1","section":"bucket.instance","name":"hankqd-28:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.32","timestamp":"2021-09-15T22:13:17.511340710Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0az6d2dZuD-enVkRwMMgGr9","ver":1},"status":{"status":"write"}}},{"id":"1_1631743997.516223_382.1","section":"bucket.instance","name":"hankqd-28:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.32","timestamp":"2021-09-15T22:13:17.516223559Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0az6d2dZuD-enVkRwMMgGr9","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743997.517820_383.1","section":"bucket","name":"hankqd-28","timestamp":"2021-09-15T22:13:17.517820365Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2pZymphOcQ4MV_eLLE06fix","ver":1},"status":{"status":"write"}}},{"id":"1_1631743997.520998_384.1","section":"bucket","name":"hankqd-28","timestamp":"2021-09-15T22:13:17.520998420Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2pZymphOcQ4MV_eLLE06fix","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743937.659167_54.1","section":"bucket.instance","name":"hankqd-1:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.1","timestamp":"2021-09-15T22:12:17.659167670Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5cwRHF16-29R0Lkcsu-U2Ru","ver":1},"status":{"status":"write"}}},{"id":"1_1631743937.663304_58.1","section":"bucket.instance","name":"hankqd-1:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.1","timestamp":"2021-09-15T22:12:17.663304852Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5cwRHF16-29R0Lkcsu-U2Ru","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743937.664905_59.1","section":"bucket","name":"hankqd-1","timestamp":"2021-09-15T22:12:17.664905756Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Io5EpDIAcwLzEUS0gK5viyr","ver":1},"status":{"status":"write"}}},{"id":"1_1631743937.668698_60.1","section":"bucket","name":"hankqd-1","timestamp":"2021-09-15T22:12:17.668698939Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Io5EpDIAcwLzEUS0gK5viyr","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743937.685420_61.1","section":"bucket.instance","name":"hankqd-2:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.2","timestamp":"2021-09-15T22:12:17.685420677Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XZUEeRke2VDVqC_53Up_Jxq","ver":1},"status":{"status":"write"}}},{"id":"1_1631743937.689744_62.1","section":"bucket.instance","name":"hankqd-2:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.2","timestamp":"2021-09-15T22:12:17.689744314Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XZUEeRke2VDVqC_53Up_Jxq","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743937.691415_63.1","section":"bucket","name":"hankqd-2","timestamp":"2021-09-15T22:12:17.691415458Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_95kwllADHZ7achbk2Q_9qqn","ver":1},"status":{"status":"write"}}},{"id":"1_1631743937.695821_64.1","section":"bucket","name":"hankqd-2","timestamp":"2021-09-15T22:12:17.695821310Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_95kwllADHZ7achbk2Q_9qqn","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743942.275198_65.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.3","timestamp":"2021-09-15T22:12:22.275198764Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_AzycQ4WWBoBCZ2HtHd5IvgY","ver":1},"status":{"status":"write"}}},{"id":"1_1631743942.280831_67.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.3","timestamp":"2021-09-15T22:12:22.280831508Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_AzycQ4WWBoBCZ2HtHd5IvgY","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743942.282381_68.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:22.282381887Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_H0nkaB1EPZlsDJgjV3CyDp9","ver":1},"status":{"status":"write"}}},{"id":"1_1631743942.286263_69.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:22.286263414Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_H0nkaB1EPZlsDJgjV3CyDp9","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743942.300217_71.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.4","timestamp":"2021-09-15T22:12:22.300217042Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9_0mKgFpUQJxVJR4y4OJS-9","ver":1},"status":{"status":"write"}}},{"id":"1_1631743942.305430_72.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.4","timestamp":"2021-09-15T22:12:22.305430722Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9_0mKgFpUQJxVJR4y4OJS-9","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743942.307495_73.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:22.307495873Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PB3PAsnC65MjF6xStQAkfq8","ver":1},"status":{"status":"write"}}},{"id":"1_1631743942.312355_74.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:22.312355814Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PB3PAsnC65MjF6xStQAkfq8","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.023724_77.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.5","timestamp":"2021-09-15T22:12:23.023724893Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0eDmuivrlKsaYcgYe_sjUHH","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.028869_78.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.5","timestamp":"2021-09-15T22:12:23.028869491Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0eDmuivrlKsaYcgYe_sjUHH","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.030661_79.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:23.030661824Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__hsE-3JEFMHY0lqnWxC2ZnV","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.033863_80.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:23.033863025Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__hsE-3JEFMHY0lqnWxC2ZnV","ver":1},"status":{"status":"abort"}}},{"id":"1_1631743943.053878_82.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.6","timestamp":"2021-09-15T22:12:23.053878356Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UTLUV4_XosaRXQa2kAoqDsz","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.058502_83.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.6","timestamp":"2021-09-15T22:12:23.058502048Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UTLUV4_XosaRXQa2kAoqDsz","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.060196_84.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:23.060196936Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CZ_LW9KZ8QtNtekZwBhRzy1","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.063333_85.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:23.063333358Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CZ_LW9KZ8QtNtekZwBhRzy1","ver":1},"status":{"status":"abort"}}},{"id":"1_1631743943.087049_86.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.7","timestamp":"2021-09-15T22:12:23.087049711Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BpK0zYZI19XIqO9yuM8xqJ0","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.091832_87.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.7","timestamp":"2021-09-15T22:12:23.091832174Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BpK0zYZI19XIqO9yuM8xqJ0","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.093539_88.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:23.093539224Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_144jKnihoRMezOKobXHx7Vw","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.096863_89.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:23.096863862Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_144jKnihoRMezOKobXHx7Vw","ver":1},"status":{"status":"abort"}}},{"id":"1_1631743943.137904_91.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.8","timestamp":"2021-09-15T22:12:23.137904973Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0DtGO5JfyJP8_6Av-Zql3IQ","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.142603_92.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.8","timestamp":"2021-09-15T22:12:23.142603806Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0DtGO5JfyJP8_6Av-Zql3IQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.144115_93.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:23.144115202Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Iday9Dcph6GVUKDPl8hDaYc","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.146773_94.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:23.146773683Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Iday9Dcph6GVUKDPl8hDaYc","ver":1},"status":{"status":"abort"}}},{"id":"1_1631743943.902515_98.1","section":"bucket.instance","name":"hankqd-5:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.9","timestamp":"2021-09-15T22:12:23.902515394Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pugWTIyfu0Vz6pkXXIz-TcK","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.907513_99.1","section":"bucket.instance","name":"hankqd-5:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.9","timestamp":"2021-09-15T22:12:23.907513173Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pugWTIyfu0Vz6pkXXIz-TcK","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.909419_100.1","section":"bucket","name":"hankqd-5","timestamp":"2021-09-15T22:12:23.909419805Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.913682_101.1","section":"bucket","name":"hankqd-5","timestamp":"2021-09-15T22:12:23.913682171Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.929258_102.1","section":"bucket.instance","name":"hankqd-6:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.10","timestamp":"2021-09-15T22:12:23.929258868Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_660i0JJ4j9-_zOyHTnAYaT0","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.933885_103.1","section":"bucket.instance","name":"hankqd-6:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.10","timestamp":"2021-09-15T22:12:23.933885084Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_660i0JJ4j9-_zOyHTnAYaT0","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.935419_104.1","section":"bucket","name":"hankqd-6","timestamp":"2021-09-15T22:12:23.935419218Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.939854_105.1","section":"bucket","name":"hankqd-6","timestamp":"2021-09-15T22:12:23.939854257Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743944.664778_106.1","section":"bucket","name":"hankqd-5","timestamp":"2021-09-15T22:12:24.664778523Z","data":{"read_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":1},"write_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":2},"status":{"status":"remove"}}},{"id":"1_1631743944.669089_108.1","section":"bucket","name":"hankqd-5","timestamp":"2021-09-15T22:12:24.669089716Z","data":{"read_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":1},"write_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743944.709840_109.1","section":"bucket","name":"hankqd-6","timestamp":"2021-09-15T22:12:24.709840508Z","data":{"read_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":1},"write_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":2},"status":{"status":"remove"}}},{"id":"1_1631743944.716073_110.1","section":"bucket","name":"hankqd-6","timestamp":"2021-09-15T22:12:24.716073955Z","data":{"read_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":1},"write_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743945.464352_111.1","section":"bucket.instance","name":"hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11","timestamp":"2021-09-15T22:12:25.464352734Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_b6ayLL59Y9o7wOZW0FGozy-","ver":1},"status":{"status":"write"}}},{"id":"1_1631743945.469866_113.1","section":"bucket.instance","name":"hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11","timestamp":"2021-09-15T22:12:25.469866428Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_b6ayLL59Y9o7wOZW0FGozy-","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743945.471171_114.1","section":"bucket","name":"hankqd-7","timestamp":"2021-09-15T22:12:25.471171963Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_JPVWc1DiB8OnzCSO5rd4wI8","ver":1},"status":{"status":"write"}}},{"id":"1_1631743945.474747_115.1","section":"bucket","name":"hankqd-7","timestamp":"2021-09-15T22:12:25.474747340Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_JPVWc1DiB8OnzCSO5rd4wI8","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743945.488230_116.1","section":"bucket.instance","name":"hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12","timestamp":"2021-09-15T22:12:25.488230335Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_f8JFACXCUvrNmkd3pBY9FH5","ver":1},"status":{"status":"write"}}},{"id":"1_1631743945.492743_117.1","section":"bucket.instance","name":"hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12","timestamp":"2021-09-15T22:12:25.492743011Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_f8JFACXCUvrNmkd3pBY9FH5","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743945.494423_118.1","section":"bucket","name":"hankqd-8","timestamp":"2021-09-15T22:12:25.494423225Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6JGK40raGd1DF50pdx5AQgf","ver":1},"status":{"status":"write"}}},{"id":"1_1631743945.498539_119.1","section":"bucket","name":"hankqd-8","timestamp":"2021-09-15T22:12:25.498539113Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6JGK40raGd1DF50pdx5AQgf","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743950.477075_120.1","section":"bucket.instance","name":"hankqd-9:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.13","timestamp":"2021-09-15T22:12:30.477075888Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_yY0I9vcghWG39r2rLPLHXtI","ver":1},"status":{"status":"write"}}},{"id":"1_1631743950.481516_125.1","section":"bucket.instance","name":"hankqd-9:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.13","timestamp":"2021-09-15T22:12:30.481516555Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_yY0I9vcghWG39r2rLPLHXtI","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743950.482960_126.1","section":"bucket","name":"hankqd-9","timestamp":"2021-09-15T22:12:30.482960777Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_o88BD0nNkjD8nOj-3RMOpBj","ver":1},"status":{"status":"write"}}},{"id":"1_1631743950.486515_127.1","section":"bucket","name":"hankqd-9","timestamp":"2021-09-15T22:12:30.486515920Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_o88BD0nNkjD8nOj-3RMOpBj","ver":1},"status":{"status":"complete"}}}] 2021-09-15T22:15:29.358 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'af209127-5081-4e40-be50-bf8d6eadaece', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:29.359 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'af209127-5081-4e40-be50-bf8d6eadaece', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:29.359 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period af209127-5081-4e40-be50-bf8d6eadaece --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:29.393 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:29.394 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:29.590 INFO:teuthology.orchestra.run.smithi184.stdout:[{"id":"1_1631743817.271234_18.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-09-15T22:10:17.271234334Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xo7AqEC6MOPJ7OacB_bFnhh","ver":1},"status":{"status":"write"}}},{"id":"1_1631743817.278003_20.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-09-15T22:10:17.278003633Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xo7AqEC6MOPJ7OacB_bFnhh","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743950.502922_59.1","section":"bucket.instance","name":"hankqd-10:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.14","timestamp":"2021-09-15T22:12:30.502922131Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_znaZPHI4AyFbHRzgSu-cu5g","ver":1},"status":{"status":"write"}}},{"id":"1_1631743950.507499_96.1","section":"bucket.instance","name":"hankqd-10:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.14","timestamp":"2021-09-15T22:12:30.507499319Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_znaZPHI4AyFbHRzgSu-cu5g","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743950.509216_97.1","section":"bucket","name":"hankqd-10","timestamp":"2021-09-15T22:12:30.509216047Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_46SxMOSdENKQL6y-zZOrCxR","ver":1},"status":{"status":"write"}}},{"id":"1_1631743950.513399_98.1","section":"bucket","name":"hankqd-10","timestamp":"2021-09-15T22:12:30.513399991Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_46SxMOSdENKQL6y-zZOrCxR","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743955.234801_99.1","section":"bucket.instance","name":"hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15","timestamp":"2021-09-15T22:12:35.234801629Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":1},"status":{"status":"write"}}},{"id":"1_1631743955.238856_121.1","section":"bucket.instance","name":"hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15","timestamp":"2021-09-15T22:12:35.238856396Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743955.240305_122.1","section":"bucket","name":"hankqd-11","timestamp":"2021-09-15T22:12:35.240305204Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_a6PXiNEjRiHTwp_ZjvX1kmZ","ver":1},"status":{"status":"write"}}},{"id":"1_1631743955.244047_123.1","section":"bucket","name":"hankqd-11","timestamp":"2021-09-15T22:12:35.244047358Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_a6PXiNEjRiHTwp_ZjvX1kmZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743955.259176_124.1","section":"bucket.instance","name":"hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16","timestamp":"2021-09-15T22:12:35.259176645Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":1},"status":{"status":"write"}}},{"id":"1_1631743955.264039_125.1","section":"bucket.instance","name":"hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16","timestamp":"2021-09-15T22:12:35.264039105Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743955.265763_126.1","section":"bucket","name":"hankqd-12","timestamp":"2021-09-15T22:12:35.265763833Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tS98Bv2PWHjKzZi9_btBZvL","ver":1},"status":{"status":"write"}}},{"id":"1_1631743955.269926_127.1","section":"bucket","name":"hankqd-12","timestamp":"2021-09-15T22:12:35.269926846Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tS98Bv2PWHjKzZi9_btBZvL","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743955.295488_128.1","section":"bucket.instance","name":"hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15","timestamp":"2021-09-15T22:12:35.295488270Z","data":{"read_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":1},"write_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":2},"status":{"status":"write"}}},{"id":"1_1631743955.302045_129.1","section":"bucket.instance","name":"hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15","timestamp":"2021-09-15T22:12:35.302045393Z","data":{"read_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":1},"write_version":{"tag":"_N8U6FHop4IKXTNUwC6tHmtN","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743955.308409_130.1","section":"bucket.instance","name":"hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16","timestamp":"2021-09-15T22:12:35.308409662Z","data":{"read_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":1},"write_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":2},"status":{"status":"write"}}},{"id":"1_1631743955.315255_131.1","section":"bucket.instance","name":"hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16","timestamp":"2021-09-15T22:12:35.315255801Z","data":{"read_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":1},"write_version":{"tag":"__NC8bhCCT73w3dbHFFi2KPy","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743967.345497_132.1","section":"bucket.instance","name":"hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17","timestamp":"2021-09-15T22:12:47.345497266Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":1},"status":{"status":"write"}}},{"id":"1_1631743967.350181_181.1","section":"bucket.instance","name":"hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17","timestamp":"2021-09-15T22:12:47.350181537Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743967.351787_182.1","section":"bucket","name":"hankqd-13","timestamp":"2021-09-15T22:12:47.351787290Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RUC9GjHvFB6dnDxRK1CMi2j","ver":1},"status":{"status":"write"}}},{"id":"1_1631743967.355950_183.1","section":"bucket","name":"hankqd-13","timestamp":"2021-09-15T22:12:47.355950368Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RUC9GjHvFB6dnDxRK1CMi2j","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743967.360818_184.1","section":"bucket.instance","name":"hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17","timestamp":"2021-09-15T22:12:47.360818021Z","data":{"read_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":1},"write_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":2},"status":{"status":"write"}}},{"id":"1_1631743967.365759_185.1","section":"bucket.instance","name":"hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17","timestamp":"2021-09-15T22:12:47.365759572Z","data":{"read_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":1},"write_version":{"tag":"_EBSOYoN1ncLsxSDWeTF6QBo","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743979.667492_186.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:12:59.667492300Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":1},"status":{"status":"write"}}},{"id":"1_1631743979.672840_217.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:12:59.672840948Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743979.674294_218.1","section":"bucket","name":"hankqd-14","timestamp":"2021-09-15T22:12:59.674294762Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_t0PIcz3Ig4B0cp6C3vb8IsR","ver":1},"status":{"status":"write"}}},{"id":"1_1631743979.677930_219.1","section":"bucket","name":"hankqd-14","timestamp":"2021-09-15T22:12:59.677930186Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_t0PIcz3Ig4B0cp6C3vb8IsR","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743981.990569_220.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:13:01.990569990Z","data":{"read_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":1},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":2},"status":{"status":"write"}}},{"id":"1_1631743981.997686_233.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:13:01.997686344Z","data":{"read_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":1},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743984.474676_234.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:13:04.474676161Z","data":{"read_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":2},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":3},"status":{"status":"write"}}},{"id":"1_1631743984.481313_247.1","section":"bucket.instance","name":"hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18","timestamp":"2021-09-15T22:13:04.481313319Z","data":{"read_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":2},"write_version":{"tag":"_8ApCRLO0o8CV00NWz8dYfRj","ver":3},"status":{"status":"complete"}}},{"id":"1_1631743986.952271_248.1","section":"bucket.instance","name":"hankqd-15:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.19","timestamp":"2021-09-15T22:13:06.952271276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":1},"status":{"status":"write"}}},{"id":"1_1631743986.957083_261.1","section":"bucket.instance","name":"hankqd-15:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.19","timestamp":"2021-09-15T22:13:06.957083555Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743986.958674_262.1","section":"bucket","name":"hankqd-15","timestamp":"2021-09-15T22:13:06.958674928Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VDpy42LJY97UbzJRFYK28Z-","ver":1},"status":{"status":"write"}}},{"id":"1_1631743986.962800_263.1","section":"bucket","name":"hankqd-15","timestamp":"2021-09-15T22:13:06.962800573Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VDpy42LJY97UbzJRFYK28Z-","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743986.980371_264.1","section":"bucket.instance","name":"hankqd-16:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.20","timestamp":"2021-09-15T22:13:06.980371215Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":1},"status":{"status":"write"}}},{"id":"1_1631743986.985226_265.1","section":"bucket.instance","name":"hankqd-16:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.20","timestamp":"2021-09-15T22:13:06.985226996Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743986.986895_266.1","section":"bucket","name":"hankqd-16","timestamp":"2021-09-15T22:13:06.986895500Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9DCOd2ibV0fyK6-66mrNaH1","ver":1},"status":{"status":"write"}}},{"id":"1_1631743986.991031_267.1","section":"bucket","name":"hankqd-16","timestamp":"2021-09-15T22:13:06.991031354Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9DCOd2ibV0fyK6-66mrNaH1","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743987.013536_268.1","section":"bucket.instance","name":"hankqd-15:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.19","timestamp":"2021-09-15T22:13:07.013536255Z","data":{"read_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":1},"write_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":2},"status":{"status":"write"}}},{"id":"1_1631743987.020330_269.1","section":"bucket.instance","name":"hankqd-15:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.19","timestamp":"2021-09-15T22:13:07.020330264Z","data":{"read_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":1},"write_version":{"tag":"_rigzQSIIfuoEBMXk-0z0O-D","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743987.028049_270.1","section":"bucket.instance","name":"hankqd-16:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.20","timestamp":"2021-09-15T22:13:07.028049674Z","data":{"read_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":1},"write_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":2},"status":{"status":"write"}}},{"id":"1_1631743987.034364_271.1","section":"bucket.instance","name":"hankqd-16:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.20","timestamp":"2021-09-15T22:13:07.034364724Z","data":{"read_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":1},"write_version":{"tag":"_x_YxbWD5AhSwFK3c3JlQWM4","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743990.956757_272.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:10.956757678Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":1},"status":{"status":"write"}}},{"id":"1_1631743990.961058_294.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:10.961058671Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743990.962765_295.1","section":"bucket","name":"hankqd-17","timestamp":"2021-09-15T22:13:10.962765620Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TSvuv_glxJt6V1TGcKrOoQt","ver":1},"status":{"status":"write"}}},{"id":"1_1631743990.967052_296.1","section":"bucket","name":"hankqd-17","timestamp":"2021-09-15T22:13:10.967052278Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TSvuv_glxJt6V1TGcKrOoQt","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743990.983242_297.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:10.983242761Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":1},"status":{"status":"write"}}},{"id":"1_1631743990.988394_298.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:10.988394232Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743990.990057_299.1","section":"bucket","name":"hankqd-18","timestamp":"2021-09-15T22:13:10.990057342Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lE7ZWSDt_3efTHBsAuKGLez","ver":1},"status":{"status":"write"}}},{"id":"1_1631743990.994172_300.1","section":"bucket","name":"hankqd-18","timestamp":"2021-09-15T22:13:10.994172950Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lE7ZWSDt_3efTHBsAuKGLez","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743991.018410_301.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:11.018410444Z","data":{"read_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":1},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":2},"status":{"status":"write"}}},{"id":"1_1631743991.024587_302.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:11.024587610Z","data":{"read_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":1},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743991.028757_303.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:11.028757456Z","data":{"read_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":2},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":3},"status":{"status":"write"}}},{"id":"1_1631743991.034639_304.1","section":"bucket.instance","name":"hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21","timestamp":"2021-09-15T22:13:11.034639054Z","data":{"read_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":2},"write_version":{"tag":"_SfHEV2aEqYlFlBG9ZZGELwf","ver":3},"status":{"status":"complete"}}},{"id":"1_1631743991.040276_305.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:11.040276709Z","data":{"read_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":1},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":2},"status":{"status":"write"}}},{"id":"1_1631743991.046539_306.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:11.046539857Z","data":{"read_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":1},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743991.057145_307.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:11.057145786Z","data":{"read_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":2},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":3},"status":{"status":"write"}}},{"id":"1_1631743991.063821_308.1","section":"bucket.instance","name":"hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22","timestamp":"2021-09-15T22:13:11.063821628Z","data":{"read_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":2},"write_version":{"tag":"_MgrR2tWd6hkpWbzjNOzDOAQ","ver":3},"status":{"status":"complete"}}},{"id":"1_1631743994.918717_309.1","section":"bucket.instance","name":"hankqd-19:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.23","timestamp":"2021-09-15T22:13:14.918717171Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":1},"status":{"status":"write"}}},{"id":"1_1631743994.923354_331.1","section":"bucket.instance","name":"hankqd-19:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.23","timestamp":"2021-09-15T22:13:14.923354504Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743994.924849_332.1","section":"bucket","name":"hankqd-19","timestamp":"2021-09-15T22:13:14.924849396Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PugD0rcUlmtCV_IKezHhV3I","ver":1},"status":{"status":"write"}}},{"id":"1_1631743994.928603_333.1","section":"bucket","name":"hankqd-19","timestamp":"2021-09-15T22:13:14.928603363Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PugD0rcUlmtCV_IKezHhV3I","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743994.944511_334.1","section":"bucket.instance","name":"hankqd-20:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.24","timestamp":"2021-09-15T22:13:14.944511954Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":1},"status":{"status":"write"}}},{"id":"1_1631743994.949303_335.1","section":"bucket.instance","name":"hankqd-20:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.24","timestamp":"2021-09-15T22:13:14.949303085Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743994.951095_336.1","section":"bucket","name":"hankqd-20","timestamp":"2021-09-15T22:13:14.951095435Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QiGLATHSTzzrGQVCEJF740f","ver":1},"status":{"status":"write"}}},{"id":"1_1631743994.955374_337.1","section":"bucket","name":"hankqd-20","timestamp":"2021-09-15T22:13:14.955374848Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QiGLATHSTzzrGQVCEJF740f","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743994.977292_338.1","section":"bucket.instance","name":"hankqd-19:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.23","timestamp":"2021-09-15T22:13:14.977292623Z","data":{"read_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":1},"write_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":2},"status":{"status":"write"}}},{"id":"1_1631743994.983715_339.1","section":"bucket.instance","name":"hankqd-19:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.23","timestamp":"2021-09-15T22:13:14.983715430Z","data":{"read_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":1},"write_version":{"tag":"_TDIyh3_BQzH7j0CT3jKNtGe","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743995.034849_340.1","section":"bucket.instance","name":"hankqd-20:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.24","timestamp":"2021-09-15T22:13:15.034849757Z","data":{"read_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":1},"write_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":2},"status":{"status":"write"}}},{"id":"1_1631743995.042550_341.1","section":"bucket.instance","name":"hankqd-20:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.24","timestamp":"2021-09-15T22:13:15.042550273Z","data":{"read_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":1},"write_version":{"tag":"_7xy8PWBIGLLSQzzoY3oawgD","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743995.110226_342.1","section":"bucket.instance","name":"hankqd-21:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.25","timestamp":"2021-09-15T22:13:15.110226160Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.114423_343.1","section":"bucket.instance","name":"hankqd-21:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.25","timestamp":"2021-09-15T22:13:15.114423375Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.115788_344.1","section":"bucket","name":"hankqd-21","timestamp":"2021-09-15T22:13:15.115788860Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nWZKXhSabsjapRGh_gymr5O","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.119263_345.1","section":"bucket","name":"hankqd-21","timestamp":"2021-09-15T22:13:15.119263113Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nWZKXhSabsjapRGh_gymr5O","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.155288_346.1","section":"bucket.instance","name":"hankqd-22:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.26","timestamp":"2021-09-15T22:13:15.155288479Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.161172_347.1","section":"bucket.instance","name":"hankqd-22:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.26","timestamp":"2021-09-15T22:13:15.161172121Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.163439_348.1","section":"bucket","name":"hankqd-22","timestamp":"2021-09-15T22:13:15.163439155Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FAY8iaTnzzDnovua3Q2nfdK","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.169146_349.1","section":"bucket","name":"hankqd-22","timestamp":"2021-09-15T22:13:15.169146841Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FAY8iaTnzzDnovua3Q2nfdK","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.194355_350.1","section":"bucket.instance","name":"hankqd-21:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.25","timestamp":"2021-09-15T22:13:15.194355352Z","data":{"read_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":1},"write_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":2},"status":{"status":"write"}}},{"id":"1_1631743995.201344_351.1","section":"bucket.instance","name":"hankqd-21:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.25","timestamp":"2021-09-15T22:13:15.201344319Z","data":{"read_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":1},"write_version":{"tag":"_SC8BesyNoRlJBwiq9lyehqZ","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743995.252529_352.1","section":"bucket.instance","name":"hankqd-22:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.26","timestamp":"2021-09-15T22:13:15.252529433Z","data":{"read_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":1},"write_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":2},"status":{"status":"write"}}},{"id":"1_1631743995.260405_353.1","section":"bucket.instance","name":"hankqd-22:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.26","timestamp":"2021-09-15T22:13:15.260405788Z","data":{"read_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":1},"write_version":{"tag":"_NwFrhWZ2dvvYpJumH7mTMhF","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743995.326410_354.1","section":"bucket.instance","name":"hankqd-23:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.27","timestamp":"2021-09-15T22:13:15.326410661Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.331313_355.1","section":"bucket.instance","name":"hankqd-23:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.27","timestamp":"2021-09-15T22:13:15.331313450Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.332795_356.1","section":"bucket","name":"hankqd-23","timestamp":"2021-09-15T22:13:15.332795547Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MYEnqiCGOcshjAWGANxZ5am","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.336435_357.1","section":"bucket","name":"hankqd-23","timestamp":"2021-09-15T22:13:15.336435454Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MYEnqiCGOcshjAWGANxZ5am","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.350632_358.1","section":"bucket.instance","name":"hankqd-24:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.28","timestamp":"2021-09-15T22:13:15.350632062Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.355244_359.1","section":"bucket.instance","name":"hankqd-24:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.28","timestamp":"2021-09-15T22:13:15.355244692Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.357076_360.1","section":"bucket","name":"hankqd-24","timestamp":"2021-09-15T22:13:15.357076501Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vOKAvOu7Pcaa_olzsV0pkR-","ver":1},"status":{"status":"write"}}},{"id":"1_1631743995.361398_361.1","section":"bucket","name":"hankqd-24","timestamp":"2021-09-15T22:13:15.361398783Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vOKAvOu7Pcaa_olzsV0pkR-","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743995.381682_362.1","section":"bucket.instance","name":"hankqd-23:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.27","timestamp":"2021-09-15T22:13:15.381682006Z","data":{"read_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":1},"write_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":2},"status":{"status":"write"}}},{"id":"1_1631743995.388238_363.1","section":"bucket.instance","name":"hankqd-23:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.27","timestamp":"2021-09-15T22:13:15.388238644Z","data":{"read_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":1},"write_version":{"tag":"_Q3szA5Fy1s7vBisQMqdAkSa","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743996.443270_364.1","section":"bucket.instance","name":"hankqd-24:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.28","timestamp":"2021-09-15T22:13:16.443270365Z","data":{"read_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":1},"write_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":2},"status":{"status":"write"}}},{"id":"1_1631743996.451200_365.1","section":"bucket.instance","name":"hankqd-24:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.28","timestamp":"2021-09-15T22:13:16.451200327Z","data":{"read_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":1},"write_version":{"tag":"_UqXGMJ64chYX5UB8vHH49u8","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743996.514657_366.1","section":"bucket.instance","name":"hankqd-25:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.29","timestamp":"2021-09-15T22:13:16.514657934Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KjP3PDFoTfeHnv9-Slxzno9","ver":1},"status":{"status":"write"}}},{"id":"1_1631743996.519433_367.1","section":"bucket.instance","name":"hankqd-25:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.29","timestamp":"2021-09-15T22:13:16.519433800Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KjP3PDFoTfeHnv9-Slxzno9","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743996.521178_368.1","section":"bucket","name":"hankqd-25","timestamp":"2021-09-15T22:13:16.521178152Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fFZRcTdOz3c9mjL_AzVPHjo","ver":1},"status":{"status":"write"}}},{"id":"1_1631743996.525074_369.1","section":"bucket","name":"hankqd-25","timestamp":"2021-09-15T22:13:16.525074316Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fFZRcTdOz3c9mjL_AzVPHjo","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743996.540442_370.1","section":"bucket.instance","name":"hankqd-26:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.30","timestamp":"2021-09-15T22:13:16.540442762Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_luSJ8yo1oJWpbltmmyVl0ln","ver":1},"status":{"status":"write"}}},{"id":"1_1631743996.545115_371.1","section":"bucket.instance","name":"hankqd-26:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.30","timestamp":"2021-09-15T22:13:16.545115188Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_luSJ8yo1oJWpbltmmyVl0ln","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743996.546837_372.1","section":"bucket","name":"hankqd-26","timestamp":"2021-09-15T22:13:16.546837638Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lEiHEBu46sCqSxbQgXQQyT6","ver":1},"status":{"status":"write"}}},{"id":"1_1631743996.550713_373.1","section":"bucket","name":"hankqd-26","timestamp":"2021-09-15T22:13:16.550713028Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lEiHEBu46sCqSxbQgXQQyT6","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743997.484630_374.1","section":"bucket.instance","name":"hankqd-27:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.31","timestamp":"2021-09-15T22:13:17.484630996Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FtVsBuWUYoWXkD8Fe6Kc6cZ","ver":1},"status":{"status":"write"}}},{"id":"1_1631743997.489440_378.1","section":"bucket.instance","name":"hankqd-27:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.31","timestamp":"2021-09-15T22:13:17.489440277Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FtVsBuWUYoWXkD8Fe6Kc6cZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743997.491920_379.1","section":"bucket","name":"hankqd-27","timestamp":"2021-09-15T22:13:17.491920896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bcx0RuWivIDlLzafzdJqBR3","ver":1},"status":{"status":"write"}}},{"id":"1_1631743997.496386_380.1","section":"bucket","name":"hankqd-27","timestamp":"2021-09-15T22:13:17.496386784Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Bcx0RuWivIDlLzafzdJqBR3","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743997.511340_381.1","section":"bucket.instance","name":"hankqd-28:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.32","timestamp":"2021-09-15T22:13:17.511340710Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0az6d2dZuD-enVkRwMMgGr9","ver":1},"status":{"status":"write"}}},{"id":"1_1631743997.516223_382.1","section":"bucket.instance","name":"hankqd-28:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.32","timestamp":"2021-09-15T22:13:17.516223559Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0az6d2dZuD-enVkRwMMgGr9","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743997.517820_383.1","section":"bucket","name":"hankqd-28","timestamp":"2021-09-15T22:13:17.517820365Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2pZymphOcQ4MV_eLLE06fix","ver":1},"status":{"status":"write"}}},{"id":"1_1631743997.520998_384.1","section":"bucket","name":"hankqd-28","timestamp":"2021-09-15T22:13:17.520998420Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2pZymphOcQ4MV_eLLE06fix","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743937.659167_54.1","section":"bucket.instance","name":"hankqd-1:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.1","timestamp":"2021-09-15T22:12:17.659167670Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5cwRHF16-29R0Lkcsu-U2Ru","ver":1},"status":{"status":"write"}}},{"id":"1_1631743937.663304_58.1","section":"bucket.instance","name":"hankqd-1:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.1","timestamp":"2021-09-15T22:12:17.663304852Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5cwRHF16-29R0Lkcsu-U2Ru","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743937.664905_59.1","section":"bucket","name":"hankqd-1","timestamp":"2021-09-15T22:12:17.664905756Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Io5EpDIAcwLzEUS0gK5viyr","ver":1},"status":{"status":"write"}}},{"id":"1_1631743937.668698_60.1","section":"bucket","name":"hankqd-1","timestamp":"2021-09-15T22:12:17.668698939Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Io5EpDIAcwLzEUS0gK5viyr","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743937.685420_61.1","section":"bucket.instance","name":"hankqd-2:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.2","timestamp":"2021-09-15T22:12:17.685420677Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XZUEeRke2VDVqC_53Up_Jxq","ver":1},"status":{"status":"write"}}},{"id":"1_1631743937.689744_62.1","section":"bucket.instance","name":"hankqd-2:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.2","timestamp":"2021-09-15T22:12:17.689744314Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XZUEeRke2VDVqC_53Up_Jxq","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743937.691415_63.1","section":"bucket","name":"hankqd-2","timestamp":"2021-09-15T22:12:17.691415458Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_95kwllADHZ7achbk2Q_9qqn","ver":1},"status":{"status":"write"}}},{"id":"1_1631743937.695821_64.1","section":"bucket","name":"hankqd-2","timestamp":"2021-09-15T22:12:17.695821310Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_95kwllADHZ7achbk2Q_9qqn","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743942.275198_65.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.3","timestamp":"2021-09-15T22:12:22.275198764Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_AzycQ4WWBoBCZ2HtHd5IvgY","ver":1},"status":{"status":"write"}}},{"id":"1_1631743942.280831_67.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.3","timestamp":"2021-09-15T22:12:22.280831508Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_AzycQ4WWBoBCZ2HtHd5IvgY","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743942.282381_68.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:22.282381887Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_H0nkaB1EPZlsDJgjV3CyDp9","ver":1},"status":{"status":"write"}}},{"id":"1_1631743942.286263_69.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:22.286263414Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_H0nkaB1EPZlsDJgjV3CyDp9","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743942.300217_71.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.4","timestamp":"2021-09-15T22:12:22.300217042Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9_0mKgFpUQJxVJR4y4OJS-9","ver":1},"status":{"status":"write"}}},{"id":"1_1631743942.305430_72.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.4","timestamp":"2021-09-15T22:12:22.305430722Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9_0mKgFpUQJxVJR4y4OJS-9","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743942.307495_73.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:22.307495873Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PB3PAsnC65MjF6xStQAkfq8","ver":1},"status":{"status":"write"}}},{"id":"1_1631743942.312355_74.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:22.312355814Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PB3PAsnC65MjF6xStQAkfq8","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.023724_77.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.5","timestamp":"2021-09-15T22:12:23.023724893Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0eDmuivrlKsaYcgYe_sjUHH","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.028869_78.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.5","timestamp":"2021-09-15T22:12:23.028869491Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0eDmuivrlKsaYcgYe_sjUHH","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.030661_79.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:23.030661824Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__hsE-3JEFMHY0lqnWxC2ZnV","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.033863_80.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:23.033863025Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__hsE-3JEFMHY0lqnWxC2ZnV","ver":1},"status":{"status":"abort"}}},{"id":"1_1631743943.053878_82.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.6","timestamp":"2021-09-15T22:12:23.053878356Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UTLUV4_XosaRXQa2kAoqDsz","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.058502_83.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.6","timestamp":"2021-09-15T22:12:23.058502048Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UTLUV4_XosaRXQa2kAoqDsz","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.060196_84.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:23.060196936Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CZ_LW9KZ8QtNtekZwBhRzy1","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.063333_85.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:23.063333358Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CZ_LW9KZ8QtNtekZwBhRzy1","ver":1},"status":{"status":"abort"}}},{"id":"1_1631743943.087049_86.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.7","timestamp":"2021-09-15T22:12:23.087049711Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BpK0zYZI19XIqO9yuM8xqJ0","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.091832_87.1","section":"bucket.instance","name":"hankqd-3:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.7","timestamp":"2021-09-15T22:12:23.091832174Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BpK0zYZI19XIqO9yuM8xqJ0","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.093539_88.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:23.093539224Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_144jKnihoRMezOKobXHx7Vw","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.096863_89.1","section":"bucket","name":"hankqd-3","timestamp":"2021-09-15T22:12:23.096863862Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_144jKnihoRMezOKobXHx7Vw","ver":1},"status":{"status":"abort"}}},{"id":"1_1631743943.137904_91.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.8","timestamp":"2021-09-15T22:12:23.137904973Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0DtGO5JfyJP8_6Av-Zql3IQ","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.142603_92.1","section":"bucket.instance","name":"hankqd-4:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.8","timestamp":"2021-09-15T22:12:23.142603806Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0DtGO5JfyJP8_6Av-Zql3IQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.144115_93.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:23.144115202Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Iday9Dcph6GVUKDPl8hDaYc","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.146773_94.1","section":"bucket","name":"hankqd-4","timestamp":"2021-09-15T22:12:23.146773683Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Iday9Dcph6GVUKDPl8hDaYc","ver":1},"status":{"status":"abort"}}},{"id":"1_1631743943.902515_98.1","section":"bucket.instance","name":"hankqd-5:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.9","timestamp":"2021-09-15T22:12:23.902515394Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pugWTIyfu0Vz6pkXXIz-TcK","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.907513_99.1","section":"bucket.instance","name":"hankqd-5:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.9","timestamp":"2021-09-15T22:12:23.907513173Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pugWTIyfu0Vz6pkXXIz-TcK","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.909419_100.1","section":"bucket","name":"hankqd-5","timestamp":"2021-09-15T22:12:23.909419805Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.913682_101.1","section":"bucket","name":"hankqd-5","timestamp":"2021-09-15T22:12:23.913682171Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.929258_102.1","section":"bucket.instance","name":"hankqd-6:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.10","timestamp":"2021-09-15T22:12:23.929258868Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_660i0JJ4j9-_zOyHTnAYaT0","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.933885_103.1","section":"bucket.instance","name":"hankqd-6:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.10","timestamp":"2021-09-15T22:12:23.933885084Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_660i0JJ4j9-_zOyHTnAYaT0","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743943.935419_104.1","section":"bucket","name":"hankqd-6","timestamp":"2021-09-15T22:12:23.935419218Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":1},"status":{"status":"write"}}},{"id":"1_1631743943.939854_105.1","section":"bucket","name":"hankqd-6","timestamp":"2021-09-15T22:12:23.939854257Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743944.664778_106.1","section":"bucket","name":"hankqd-5","timestamp":"2021-09-15T22:12:24.664778523Z","data":{"read_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":1},"write_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":2},"status":{"status":"remove"}}},{"id":"1_1631743944.669089_108.1","section":"bucket","name":"hankqd-5","timestamp":"2021-09-15T22:12:24.669089716Z","data":{"read_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":1},"write_version":{"tag":"_Ip8OJcFAX5ayEDa0ErAvX85","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743944.709840_109.1","section":"bucket","name":"hankqd-6","timestamp":"2021-09-15T22:12:24.709840508Z","data":{"read_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":1},"write_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":2},"status":{"status":"remove"}}},{"id":"1_1631743944.716073_110.1","section":"bucket","name":"hankqd-6","timestamp":"2021-09-15T22:12:24.716073955Z","data":{"read_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":1},"write_version":{"tag":"_jcKiwuEFEST7i5l4Nf5UvW-","ver":2},"status":{"status":"complete"}}},{"id":"1_1631743945.464352_111.1","section":"bucket.instance","name":"hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11","timestamp":"2021-09-15T22:12:25.464352734Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_b6ayLL59Y9o7wOZW0FGozy-","ver":1},"status":{"status":"write"}}},{"id":"1_1631743945.469866_113.1","section":"bucket.instance","name":"hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11","timestamp":"2021-09-15T22:12:25.469866428Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_b6ayLL59Y9o7wOZW0FGozy-","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743945.471171_114.1","section":"bucket","name":"hankqd-7","timestamp":"2021-09-15T22:12:25.471171963Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_JPVWc1DiB8OnzCSO5rd4wI8","ver":1},"status":{"status":"write"}}},{"id":"1_1631743945.474747_115.1","section":"bucket","name":"hankqd-7","timestamp":"2021-09-15T22:12:25.474747340Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_JPVWc1DiB8OnzCSO5rd4wI8","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743945.488230_116.1","section":"bucket.instance","name":"hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12","timestamp":"2021-09-15T22:12:25.488230335Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_f8JFACXCUvrNmkd3pBY9FH5","ver":1},"status":{"status":"write"}}},{"id":"1_1631743945.492743_117.1","section":"bucket.instance","name":"hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12","timestamp":"2021-09-15T22:12:25.492743011Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_f8JFACXCUvrNmkd3pBY9FH5","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743945.494423_118.1","section":"bucket","name":"hankqd-8","timestamp":"2021-09-15T22:12:25.494423225Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6JGK40raGd1DF50pdx5AQgf","ver":1},"status":{"status":"write"}}},{"id":"1_1631743945.498539_119.1","section":"bucket","name":"hankqd-8","timestamp":"2021-09-15T22:12:25.498539113Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6JGK40raGd1DF50pdx5AQgf","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743950.477075_120.1","section":"bucket.instance","name":"hankqd-9:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.13","timestamp":"2021-09-15T22:12:30.477075888Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_yY0I9vcghWG39r2rLPLHXtI","ver":1},"status":{"status":"write"}}},{"id":"1_1631743950.481516_125.1","section":"bucket.instance","name":"hankqd-9:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.13","timestamp":"2021-09-15T22:12:30.481516555Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_yY0I9vcghWG39r2rLPLHXtI","ver":1},"status":{"status":"complete"}}},{"id":"1_1631743950.482960_126.1","section":"bucket","name":"hankqd-9","timestamp":"2021-09-15T22:12:30.482960777Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_o88BD0nNkjD8nOj-3RMOpBj","ver":1},"status":{"status":"write"}}},{"id":"1_1631743950.486515_127.1","section":"bucket","name":"hankqd-9","timestamp":"2021-09-15T22:12:30.486515920Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_o88BD0nNkjD8nOj-3RMOpBj","ver":1},"status":{"status":"complete"}}}] 2021-09-15T22:15:29.592 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'debf2df8-db5a-44b2-b2d8-222dc090a86d', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:29.593 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'debf2df8-db5a-44b2-b2d8-222dc090a86d', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:29.593 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period debf2df8-db5a-44b2-b2d8-222dc090a86d --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:29.630 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:29.631 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:29.815 INFO:teuthology.orchestra.run.smithi180.stdout:[{"id":"1_1631744064.729369_210.1","section":"bucket.instance","name":"hankqd-29:4f4b61b1-d30a-4c5f-906c-596bca64c691.5016.1","timestamp":"2021-09-15T22:14:24.729369290Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6hOa3h_9Jy11-WIpltO_gat","ver":1},"status":{"status":"write"}}},{"id":"1_1631744064.734021_211.1","section":"bucket.instance","name":"hankqd-29:4f4b61b1-d30a-4c5f-906c-596bca64c691.5016.1","timestamp":"2021-09-15T22:14:24.734021229Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6hOa3h_9Jy11-WIpltO_gat","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744064.735750_212.1","section":"bucket","name":"hankqd-29","timestamp":"2021-09-15T22:14:24.735750667Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pEE_-bMZ6dGiUY4cU7JUT-Q","ver":1},"status":{"status":"write"}}},{"id":"1_1631744064.740230_213.1","section":"bucket","name":"hankqd-29","timestamp":"2021-09-15T22:14:24.740230686Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pEE_-bMZ6dGiUY4cU7JUT-Q","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744064.777176_214.1","section":"bucket.instance","name":"hankqd-30:4f4b61b1-d30a-4c5f-906c-596bca64c691.5016.2","timestamp":"2021-09-15T22:14:24.777176107Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KzzOgrEmGXNqx2siAxX8R_2","ver":1},"status":{"status":"write"}}},{"id":"1_1631744064.781881_215.1","section":"bucket.instance","name":"hankqd-30:4f4b61b1-d30a-4c5f-906c-596bca64c691.5016.2","timestamp":"2021-09-15T22:14:24.781881714Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KzzOgrEmGXNqx2siAxX8R_2","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744064.783326_216.1","section":"bucket","name":"hankqd-30","timestamp":"2021-09-15T22:14:24.783326220Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_dWn2r-rzay7DRQPpGWEOedm","ver":1},"status":{"status":"write"}}},{"id":"1_1631744064.791418_217.1","section":"bucket","name":"hankqd-30","timestamp":"2021-09-15T22:14:24.791418576Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_dWn2r-rzay7DRQPpGWEOedm","ver":1},"status":{"status":"complete"}}}] 2021-09-15T22:15:29.816 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'debf2df8-db5a-44b2-b2d8-222dc090a86d', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:29.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'debf2df8-db5a-44b2-b2d8-222dc090a86d', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:29.817 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period debf2df8-db5a-44b2-b2d8-222dc090a86d --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:29.855 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:29.855 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:30.046 INFO:teuthology.orchestra.run.smithi184.stdout:[{"id":"1_1631744064.729369_210.1","section":"bucket.instance","name":"hankqd-29:4f4b61b1-d30a-4c5f-906c-596bca64c691.5016.1","timestamp":"2021-09-15T22:14:24.729369290Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6hOa3h_9Jy11-WIpltO_gat","ver":1},"status":{"status":"write"}}},{"id":"1_1631744064.734021_211.1","section":"bucket.instance","name":"hankqd-29:4f4b61b1-d30a-4c5f-906c-596bca64c691.5016.1","timestamp":"2021-09-15T22:14:24.734021229Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6hOa3h_9Jy11-WIpltO_gat","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744064.735750_212.1","section":"bucket","name":"hankqd-29","timestamp":"2021-09-15T22:14:24.735750667Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pEE_-bMZ6dGiUY4cU7JUT-Q","ver":1},"status":{"status":"write"}}},{"id":"1_1631744064.740230_213.1","section":"bucket","name":"hankqd-29","timestamp":"2021-09-15T22:14:24.740230686Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pEE_-bMZ6dGiUY4cU7JUT-Q","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744064.777176_214.1","section":"bucket.instance","name":"hankqd-30:4f4b61b1-d30a-4c5f-906c-596bca64c691.5016.2","timestamp":"2021-09-15T22:14:24.777176107Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KzzOgrEmGXNqx2siAxX8R_2","ver":1},"status":{"status":"write"}}},{"id":"1_1631744064.781881_215.1","section":"bucket.instance","name":"hankqd-30:4f4b61b1-d30a-4c5f-906c-596bca64c691.5016.2","timestamp":"2021-09-15T22:14:24.781881714Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KzzOgrEmGXNqx2siAxX8R_2","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744064.783326_216.1","section":"bucket","name":"hankqd-30","timestamp":"2021-09-15T22:14:24.783326220Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_dWn2r-rzay7DRQPpGWEOedm","ver":1},"status":{"status":"write"}}},{"id":"1_1631744064.791418_217.1","section":"bucket","name":"hankqd-30","timestamp":"2021-09-15T22:14:24.791418576Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_dWn2r-rzay7DRQPpGWEOedm","ver":1},"status":{"status":"complete"}}}] 2021-09-15T22:15:30.046 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'debf2df8-db5a-44b2-b2d8-222dc090a86d', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:30.047 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'debf2df8-db5a-44b2-b2d8-222dc090a86d', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:30.048 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period debf2df8-db5a-44b2-b2d8-222dc090a86d --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:30.084 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:30.084 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:30.274 INFO:teuthology.orchestra.run.smithi184.stdout:[{"id":"1_1631744064.729369_210.1","section":"bucket.instance","name":"hankqd-29:4f4b61b1-d30a-4c5f-906c-596bca64c691.5016.1","timestamp":"2021-09-15T22:14:24.729369290Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6hOa3h_9Jy11-WIpltO_gat","ver":1},"status":{"status":"write"}}},{"id":"1_1631744064.734021_211.1","section":"bucket.instance","name":"hankqd-29:4f4b61b1-d30a-4c5f-906c-596bca64c691.5016.1","timestamp":"2021-09-15T22:14:24.734021229Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6hOa3h_9Jy11-WIpltO_gat","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744064.735750_212.1","section":"bucket","name":"hankqd-29","timestamp":"2021-09-15T22:14:24.735750667Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pEE_-bMZ6dGiUY4cU7JUT-Q","ver":1},"status":{"status":"write"}}},{"id":"1_1631744064.740230_213.1","section":"bucket","name":"hankqd-29","timestamp":"2021-09-15T22:14:24.740230686Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pEE_-bMZ6dGiUY4cU7JUT-Q","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744064.777176_214.1","section":"bucket.instance","name":"hankqd-30:4f4b61b1-d30a-4c5f-906c-596bca64c691.5016.2","timestamp":"2021-09-15T22:14:24.777176107Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KzzOgrEmGXNqx2siAxX8R_2","ver":1},"status":{"status":"write"}}},{"id":"1_1631744064.781881_215.1","section":"bucket.instance","name":"hankqd-30:4f4b61b1-d30a-4c5f-906c-596bca64c691.5016.2","timestamp":"2021-09-15T22:14:24.781881714Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KzzOgrEmGXNqx2siAxX8R_2","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744064.783326_216.1","section":"bucket","name":"hankqd-30","timestamp":"2021-09-15T22:14:24.783326220Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_dWn2r-rzay7DRQPpGWEOedm","ver":1},"status":{"status":"write"}}},{"id":"1_1631744064.791418_217.1","section":"bucket","name":"hankqd-30","timestamp":"2021-09-15T22:14:24.791418576Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_dWn2r-rzay7DRQPpGWEOedm","ver":1},"status":{"status":"complete"}}}] 2021-09-15T22:15:30.274 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'fc8d61ff-709a-4d9b-a65c-86a8ab621cb2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:30.275 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'fc8d61ff-709a-4d9b-a65c-86a8ab621cb2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:30.276 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:30.315 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:30.316 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:30.502 INFO:teuthology.orchestra.run.smithi180.stdout:[{"id":"1_1631744125.680651_23.1","section":"bucket.instance","name":"hankqd-31:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.1","timestamp":"2021-09-15T22:15:25.680651050Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iW_beNqyn-hSzQEaxpFqVso","ver":1},"status":{"status":"write"}}},{"id":"1_1631744125.685095_24.1","section":"bucket.instance","name":"hankqd-31:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.1","timestamp":"2021-09-15T22:15:25.685095796Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iW_beNqyn-hSzQEaxpFqVso","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744125.686445_25.1","section":"bucket","name":"hankqd-31","timestamp":"2021-09-15T22:15:25.686445276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Dm2rEOexGmQHw5mfx9sw2H7","ver":1},"status":{"status":"write"}}},{"id":"1_1631744125.690242_26.1","section":"bucket","name":"hankqd-31","timestamp":"2021-09-15T22:15:25.690242994Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Dm2rEOexGmQHw5mfx9sw2H7","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744125.715869_27.1","section":"bucket.instance","name":"hankqd-32:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.2","timestamp":"2021-09-15T22:15:25.715869951Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xxSNE7KGT3uJwJG6PGuf8j","ver":1},"status":{"status":"write"}}},{"id":"1_1631744125.721411_28.1","section":"bucket.instance","name":"hankqd-32:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.2","timestamp":"2021-09-15T22:15:25.721411285Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xxSNE7KGT3uJwJG6PGuf8j","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744125.722841_29.1","section":"bucket","name":"hankqd-32","timestamp":"2021-09-15T22:15:25.722841906Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ttyx3FJTcegsAvvkKJ6UusZ","ver":1},"status":{"status":"write"}}},{"id":"1_1631744125.726764_30.1","section":"bucket","name":"hankqd-32","timestamp":"2021-09-15T22:15:25.726764015Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ttyx3FJTcegsAvvkKJ6UusZ","ver":1},"status":{"status":"complete"}}}] 2021-09-15T22:15:30.503 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'fc8d61ff-709a-4d9b-a65c-86a8ab621cb2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:30.504 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'fc8d61ff-709a-4d9b-a65c-86a8ab621cb2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:30.504 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:30.541 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:30.541 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:30.717 INFO:teuthology.orchestra.run.smithi184.stdout:[{"id":"1_1631744125.680651_23.1","section":"bucket.instance","name":"hankqd-31:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.1","timestamp":"2021-09-15T22:15:25.680651050Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iW_beNqyn-hSzQEaxpFqVso","ver":1},"status":{"status":"write"}}},{"id":"1_1631744125.685095_24.1","section":"bucket.instance","name":"hankqd-31:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.1","timestamp":"2021-09-15T22:15:25.685095796Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iW_beNqyn-hSzQEaxpFqVso","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744125.686445_25.1","section":"bucket","name":"hankqd-31","timestamp":"2021-09-15T22:15:25.686445276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Dm2rEOexGmQHw5mfx9sw2H7","ver":1},"status":{"status":"write"}}},{"id":"1_1631744125.690242_26.1","section":"bucket","name":"hankqd-31","timestamp":"2021-09-15T22:15:25.690242994Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Dm2rEOexGmQHw5mfx9sw2H7","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744125.715869_27.1","section":"bucket.instance","name":"hankqd-32:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.2","timestamp":"2021-09-15T22:15:25.715869951Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xxSNE7KGT3uJwJG6PGuf8j","ver":1},"status":{"status":"write"}}},{"id":"1_1631744125.721411_28.1","section":"bucket.instance","name":"hankqd-32:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.2","timestamp":"2021-09-15T22:15:25.721411285Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xxSNE7KGT3uJwJG6PGuf8j","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744125.722841_29.1","section":"bucket","name":"hankqd-32","timestamp":"2021-09-15T22:15:25.722841906Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ttyx3FJTcegsAvvkKJ6UusZ","ver":1},"status":{"status":"write"}}},{"id":"1_1631744125.726764_30.1","section":"bucket","name":"hankqd-32","timestamp":"2021-09-15T22:15:25.726764015Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ttyx3FJTcegsAvvkKJ6UusZ","ver":1},"status":{"status":"complete"}}}] 2021-09-15T22:15:30.718 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'fc8d61ff-709a-4d9b-a65c-86a8ab621cb2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:30.718 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'fc8d61ff-709a-4d9b-a65c-86a8ab621cb2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:30.719 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:30.795 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:30.795 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:30.982 INFO:teuthology.orchestra.run.smithi184.stdout:[{"id":"1_1631744125.680651_23.1","section":"bucket.instance","name":"hankqd-31:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.1","timestamp":"2021-09-15T22:15:25.680651050Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iW_beNqyn-hSzQEaxpFqVso","ver":1},"status":{"status":"write"}}},{"id":"1_1631744125.685095_24.1","section":"bucket.instance","name":"hankqd-31:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.1","timestamp":"2021-09-15T22:15:25.685095796Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iW_beNqyn-hSzQEaxpFqVso","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744125.686445_25.1","section":"bucket","name":"hankqd-31","timestamp":"2021-09-15T22:15:25.686445276Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Dm2rEOexGmQHw5mfx9sw2H7","ver":1},"status":{"status":"write"}}},{"id":"1_1631744125.690242_26.1","section":"bucket","name":"hankqd-31","timestamp":"2021-09-15T22:15:25.690242994Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Dm2rEOexGmQHw5mfx9sw2H7","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744125.715869_27.1","section":"bucket.instance","name":"hankqd-32:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.2","timestamp":"2021-09-15T22:15:25.715869951Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xxSNE7KGT3uJwJG6PGuf8j","ver":1},"status":{"status":"write"}}},{"id":"1_1631744125.721411_28.1","section":"bucket.instance","name":"hankqd-32:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.2","timestamp":"2021-09-15T22:15:25.721411285Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xxSNE7KGT3uJwJG6PGuf8j","ver":1},"status":{"status":"complete"}}},{"id":"1_1631744125.722841_29.1","section":"bucket","name":"hankqd-32","timestamp":"2021-09-15T22:15:25.722841906Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ttyx3FJTcegsAvvkKJ6UusZ","ver":1},"status":{"status":"write"}}},{"id":"1_1631744125.726764_30.1","section":"bucket","name":"hankqd-32","timestamp":"2021-09-15T22:15:25.726764015Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ttyx3FJTcegsAvvkKJ6UusZ","ver":1},"status":{"status":"complete"}}}] 2021-09-15T22:15:30.983 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:15:30.983 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:15:30.984 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:15:31.018 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:31.019 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:31.236 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:15:31.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:15:31.238 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:15:31.273 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:31.274 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:31.500 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:15:31.501 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:15:31.501 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:15:31.533 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:31.533 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:31.736 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'af209127-5081-4e40-be50-bf8d6eadaece', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:31.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'af209127-5081-4e40-be50-bf8d6eadaece', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:31.737 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period af209127-5081-4e40-be50-bf8d6eadaece --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:31.777 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:31.778 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:31.961 INFO:teuthology.orchestra.run.smithi180.stdout:[] 2021-09-15T22:15:31.962 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'af209127-5081-4e40-be50-bf8d6eadaece', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:31.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'af209127-5081-4e40-be50-bf8d6eadaece', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:31.963 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period af209127-5081-4e40-be50-bf8d6eadaece --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:32.000 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:32.001 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:32.189 INFO:teuthology.orchestra.run.smithi184.stdout:[] 2021-09-15T22:15:32.190 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'af209127-5081-4e40-be50-bf8d6eadaece', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:32.191 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'af209127-5081-4e40-be50-bf8d6eadaece', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:32.191 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period af209127-5081-4e40-be50-bf8d6eadaece --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:32.229 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:32.230 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:32.415 INFO:teuthology.orchestra.run.smithi184.stdout:[] 2021-09-15T22:15:32.416 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'debf2df8-db5a-44b2-b2d8-222dc090a86d', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:32.416 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'debf2df8-db5a-44b2-b2d8-222dc090a86d', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:32.417 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period debf2df8-db5a-44b2-b2d8-222dc090a86d --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:32.456 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:32.456 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:32.629 INFO:teuthology.orchestra.run.smithi180.stdout:[] 2021-09-15T22:15:32.630 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'debf2df8-db5a-44b2-b2d8-222dc090a86d', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:32.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'debf2df8-db5a-44b2-b2d8-222dc090a86d', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:32.631 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period debf2df8-db5a-44b2-b2d8-222dc090a86d --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:32.670 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:32.670 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:32.856 INFO:teuthology.orchestra.run.smithi184.stdout:[] 2021-09-15T22:15:32.856 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'debf2df8-db5a-44b2-b2d8-222dc090a86d', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:32.857 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'debf2df8-db5a-44b2-b2d8-222dc090a86d', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:32.858 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period debf2df8-db5a-44b2-b2d8-222dc090a86d --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:32.934 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:32.935 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:33.120 INFO:teuthology.orchestra.run.smithi184.stdout:[] 2021-09-15T22:15:33.121 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'fc8d61ff-709a-4d9b-a65c-86a8ab621cb2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:33.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'fc8d61ff-709a-4d9b-a65c-86a8ab621cb2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:33.122 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:33.161 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:33.161 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:33.344 INFO:teuthology.orchestra.run.smithi180.stdout:[] 2021-09-15T22:15:33.345 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'fc8d61ff-709a-4d9b-a65c-86a8ab621cb2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:33.346 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'fc8d61ff-709a-4d9b-a65c-86a8ab621cb2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:33.347 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:33.386 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:33.386 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:33.578 INFO:teuthology.orchestra.run.smithi184.stdout:[] 2021-09-15T22:15:33.579 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'fc8d61ff-709a-4d9b-a65c-86a8ab621cb2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:33.579 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'fc8d61ff-709a-4d9b-a65c-86a8ab621cb2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:33.580 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:33.613 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:33.614 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:33.807 INFO:teuthology.orchestra.run.smithi184.stdout:[] 2021-09-15T22:15:33.808 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_period_incremental_sync ... ok 2021-09-15T22:15:33.809 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-33 2021-09-15T22:15:33.835 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-34 2021-09-15T22:15:33.926 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:15:33.922+0000 7fda5d7f2700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:15:33.926 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:15:33.922+0000 7f52f8fe9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:15:33.927 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:15:33.926+0000 7f53007f8700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:15:33.928 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:15:33.926+0000 7fda5c7f0700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:15:33.983 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:33.984 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:33.985 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:34.021 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:34.022 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:34.184 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743984.718795_37.2","last_update":"2021-09-15T22:13:04.718795Z"},{"marker":"1_1631744134.153889_252.1","last_update":"2021-09-15T22:15:34.153889Z"},{"marker":"1_1631743984.718795_63.3","last_update":"2021-09-15T22:13:04.718795Z"},{"marker":"1_1631743997.486633_119.1","last_update":"2021-09-15T22:13:17.486633Z"}] 2021-09-15T22:15:34.185 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-09-15T22:15:34.185 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:34.186 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:34.186 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:34.227 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:34.228 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:34.426 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":2214498870205982451},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_63.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:15:34.426 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-09-15T22:15:34.427 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:34.427 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:34.428 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:34.467 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:34.467 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:34.634 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743984.718795_37.2","last_update":"2021-09-15T22:13:04.718795Z"},{"marker":"1_1631744134.153889_252.1","last_update":"2021-09-15T22:15:34.153889Z"},{"marker":"1_1631743984.718795_63.3","last_update":"2021-09-15T22:13:04.718795Z"},{"marker":"1_1631743997.486633_119.1","last_update":"2021-09-15T22:13:17.486633Z"}] 2021-09-15T22:15:34.634 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-09-15T22:15:34.635 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:34.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:34.636 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:34.676 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:34.677 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:34.865 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16115054566166127550},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_63.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:15:34.866 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-09-15T22:15:34.867 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:34.867 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:34.868 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:34.942 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:34.943 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:35.135 INFO:teuthology.orchestra.run.smithi184.stdout:[{"marker":"1_1631743984.878211_33.1","last_update":"2021-09-15T22:13:04.878211Z"},{"marker":"1_1631744133.984770_212.1","last_update":"2021-09-15T22:15:33.984770Z"},{"marker":"1_1631743984.878211_82.3","last_update":"2021-09-15T22:13:04.878211Z"},{"marker":"1_1631743997.362777_99.1","last_update":"2021-09-15T22:13:17.362777Z"}] 2021-09-15T22:15:35.136 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-09-15T22:15:35.137 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:35.137 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:35.138 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:35.178 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:35.179 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:35.372 INFO:teuthology.orchestra.run.smithi180.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8964646445785232500},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.878211_33.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.878211Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744133.984770_212.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:33.984770Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631743984.878211_82.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.878211Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.362777_99.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.362777Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:15:35.373 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-09-15T22:15:35.373 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:35.374 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:35.374 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:35.406 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:35.406 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:35.589 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631743984.718795_37.2","last_update":"2021-09-15T22:13:04.718795Z"},{"marker":"1_1631744134.153889_252.1","last_update":"2021-09-15T22:15:34.153889Z"},{"marker":"1_1631743984.718795_63.3","last_update":"2021-09-15T22:13:04.718795Z"},{"marker":"1_1631743997.486633_119.1","last_update":"2021-09-15T22:13:17.486633Z"}] 2021-09-15T22:15:35.590 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:15:35.590 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:15:35.591 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:15:35.662 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:35.662 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:35.855 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:35.856 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:35.857 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 0 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:35.893 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:35.893 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:36.078 INFO:teuthology.orchestra.run.smithi180.stdout:[] 2021-09-15T22:15:36.079 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:36.080 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:36.080 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 1 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:36.116 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:36.117 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:36.303 INFO:teuthology.orchestra.run.smithi180.stdout:[] 2021-09-15T22:15:36.304 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:36.305 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:36.306 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 2 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:36.381 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:36.382 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:36.563 INFO:teuthology.orchestra.run.smithi180.stdout:[] 2021-09-15T22:15:36.563 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:36.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:36.564 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 3 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:36.600 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:36.601 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:36.779 INFO:teuthology.orchestra.run.smithi180.stdout:[] 2021-09-15T22:15:36.780 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:36.780 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:36.781 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:36.815 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:36.816 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:37.001 INFO:teuthology.orchestra.run.smithi184.stdout:[{"marker":"1_1631743984.878211_33.1","last_update":"2021-09-15T22:13:04.878211Z"},{"marker":"1_1631744133.984770_212.1","last_update":"2021-09-15T22:15:33.984770Z"},{"marker":"1_1631743984.878211_82.3","last_update":"2021-09-15T22:13:04.878211Z"},{"marker":"1_1631743997.362777_99.1","last_update":"2021-09-15T22:13:17.362777Z"}] 2021-09-15T22:15:37.001 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:15:37.002 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:15:37.003 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:15:37.041 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:37.042 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:37.247 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:37.248 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:37.249 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 0 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:37.330 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:37.330 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:37.511 INFO:teuthology.orchestra.run.smithi184.stdout:[] 2021-09-15T22:15:37.511 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:37.512 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:37.513 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 1 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:37.552 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:37.552 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:37.742 INFO:teuthology.orchestra.run.smithi184.stdout:[] 2021-09-15T22:15:37.742 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:37.743 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:37.743 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 2 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:37.782 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:37.782 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:37.984 INFO:teuthology.orchestra.run.smithi184.stdout:[] 2021-09-15T22:15:37.985 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:37.985 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:15:37.986 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 3 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:15:38.024 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:38.024 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:38.223 INFO:teuthology.orchestra.run.smithi184.stdout:[] 2021-09-15T22:15:38.224 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_datalog_autotrim ... ok 2021-09-15T22:15:38.225 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:15:38.225 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:15:38.226 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=false --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:15:38.305 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:38.305 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:38.331 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:15:38.330+0000 7fd71481c980 0 failed reading obj info from .rgw.root:zone_info.4de7baf2-0fdf-417b-9ffb-8497dcfb5977: (2) No such file or directory 2021-09-15T22:15:38.331 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:15:38.330+0000 7fd71481c980 0 WARNING: could not read zone params for zone id=4de7baf2-0fdf-417b-9ffb-8497dcfb5977 name=test-zone1 2021-09-15T22:15:38.344 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"05C2LIV22Q1515AF","secret_key":"bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6"} 2021-09-15T22:15:38.344 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:15:38.345 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:15:38.345 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:15:38.386 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:15:38.386 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:15:38.568 INFO:teuthology.orchestra.run.smithi184.stderr:Sending period to new master zone 4de7baf2-0fdf-417b-9ffb-8497dcfb5977 2021-09-15T22:15:38.661 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","epoch":2,"predecessor_uuid":"debf2df8-db5a-44b2-b2d8-222dc090a86d","sync_status":["","","1_1631744064.791418_217.1",""],"period_map":{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","zones":[{"id":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","name":"test-zone1","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","endpoints":["http://smithi184.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"false","sync_from":[],"redirect_zone":""},{"id":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","name":"test-zone3","endpoints":["http://smithi184.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","val":3863291254},{"key":"4f4b61b1-d30a-4c5f-906c-596bca64c691","val":24034659},{"key":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","val":3190180025}]},"master_zonegroup":"test-zonegroup","master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","realm_name":"test-realm","realm_epoch":4} 2021-09-15T22:15:38.662 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to false 2021-09-15T22:16:38.664 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-35 2021-09-15T22:16:38.743 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:16:38.744 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:16:38.745 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:16:38.786 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:16:38.786 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:16:38.947 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:16:38.976 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744198.692860_53.1","last_update":"2021-09-15T22:16:38.692860Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:16:38.977 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:16:38.977 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:16:38.978 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:16:38.979 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:16:39.019 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:16:39.019 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:16:39.214 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744133.864406_45.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:33.864406Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:16:39.215 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744198.692860_53.1 target=1_1631744133.864406_45.1 2021-09-15T22:16:44.216 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:16:44.217 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:16:44.217 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:16:44.258 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:16:44.258 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:16:44.447 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744133.864406_45.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:33.864406Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:16:44.448 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744198.692860_53.1 target=1_1631744133.864406_45.1 2021-09-15T22:16:49.449 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:16:49.450 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:16:49.451 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:16:49.492 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:16:49.493 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:16:49.693 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744133.864406_45.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:33.864406Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:16:49.693 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744198.692860_53.1 target=1_1631744133.864406_45.1 2021-09-15T22:16:54.695 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:16:54.696 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:16:54.696 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:16:54.737 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:16:54.737 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:16:54.936 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744133.864406_45.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:33.864406Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:16:54.937 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744198.692860_53.1 target=1_1631744133.864406_45.1 2021-09-15T22:16:59.938 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:16:59.939 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:16:59.940 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:16:59.979 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:16:59.980 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:17:00.151 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744133.864406_45.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:33.864406Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:17:00.151 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744198.692860_53.1 target=1_1631744133.864406_45.1 2021-09-15T22:17:05.153 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:05.154 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:05.154 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:17:05.196 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:17:05.196 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:17:05.379 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744133.864406_45.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:33.864406Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:17:05.380 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744198.692860_53.1 target=1_1631744133.864406_45.1 2021-09-15T22:17:10.381 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:10.381 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:10.382 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:17:10.423 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:17:10.424 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:17:10.600 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744133.864406_45.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:33.864406Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:17:10.601 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744198.692860_53.1 target=1_1631744133.864406_45.1 2021-09-15T22:17:15.602 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:15.603 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:15.604 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:17:15.644 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:17:15.645 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:17:15.840 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744133.864406_45.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:33.864406Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:17:15.841 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744198.692860_53.1 target=1_1631744133.864406_45.1 2021-09-15T22:17:20.842 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:20.843 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:20.844 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:17:20.882 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:17:20.883 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:17:21.079 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744133.864406_45.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:33.864406Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:17:21.080 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744198.692860_53.1 target=1_1631744133.864406_45.1 2021-09-15T22:17:26.081 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:26.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:26.083 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:17:26.124 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:17:26.124 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:17:26.311 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744133.864406_45.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:33.864406Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:17:26.312 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744198.692860_53.1 target=1_1631744133.864406_45.1 2021-09-15T22:17:31.313 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:31.314 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:31.314 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:17:31.358 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:17:31.358 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:17:31.525 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744133.864406_45.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:33.864406Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:17:31.526 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744198.692860_53.1 target=1_1631744133.864406_45.1 2021-09-15T22:17:36.528 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:36.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:36.529 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:17:36.570 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:17:36.571 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:17:36.758 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744133.864406_45.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:33.864406Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:17:36.759 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744198.692860_53.1 target=1_1631744133.864406_45.1 2021-09-15T22:17:38.760 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:17:38.752+0000 7f5300ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:17:41.761 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:41.761 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:41.762 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:17:41.806 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:17:41.806 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:17:41.994 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744198.692860_53.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:16:38.692860Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:17:41.995 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:17:41.998 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:17:41.999 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:41.999 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:17:42.000 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:17:42.037 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:17:42.038 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:17:42.212 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744198.692860_53.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:16:38.692860Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:17:42.213 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:17:42.227 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=4de7baf2-0fdf-417b-9ffb-8497dcfb5977', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:17:42.228 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=4de7baf2-0fdf-417b-9ffb-8497dcfb5977', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:17:42.229 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone=4de7baf2-0fdf-417b-9ffb-8497dcfb5977 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:17:42.264 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:17:42.264 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:17:42.290 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:17:42.284+0000 7f874ae88980 0 failed reading obj info from .rgw.root:zone_info.4de7baf2-0fdf-417b-9ffb-8497dcfb5977: (2) No such file or directory 2021-09-15T22:17:42.290 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:17:42.284+0000 7f874ae88980 0 WARNING: could not read zone params for zone id=4de7baf2-0fdf-417b-9ffb-8497dcfb5977 name=test-zone1 2021-09-15T22:17:42.306 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"05C2LIV22Q1515AF","secret_key":"bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6"} 2021-09-15T22:17:42.307 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:17:42.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:17:42.310 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:17:42.387 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:17:42.387 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:17:42.559 INFO:teuthology.orchestra.run.smithi184.stderr:Sending period to new master zone 4de7baf2-0fdf-417b-9ffb-8497dcfb5977 2021-09-15T22:17:42.642 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","epoch":3,"predecessor_uuid":"debf2df8-db5a-44b2-b2d8-222dc090a86d","sync_status":["","","1_1631744064.791418_217.1",""],"period_map":{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","zones":[{"id":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","name":"test-zone1","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","endpoints":["http://smithi184.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"false","sync_from":[],"redirect_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977"},{"id":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","name":"test-zone3","endpoints":["http://smithi184.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","val":3863291254},{"key":"4f4b61b1-d30a-4c5f-906c-596bca64c691","val":24034659},{"key":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","val":3190180025}]},"master_zonegroup":"test-zonegroup","master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","realm_name":"test-realm","realm_epoch":4} 2021-09-15T22:17:42.642 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "4de7baf2-0fdf-417b-9ffb-8497dcfb5977" 2021-09-15T22:18:42.975 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:18:42.976 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:18:42.978 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=true --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:18:43.017 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:18:43.018 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:18:43.046 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:18:43.040+0000 7ff3173b3980 0 failed reading obj info from .rgw.root:zone_info.4de7baf2-0fdf-417b-9ffb-8497dcfb5977: (2) No such file or directory 2021-09-15T22:18:43.046 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:18:43.040+0000 7ff3173b3980 0 WARNING: could not read zone params for zone id=4de7baf2-0fdf-417b-9ffb-8497dcfb5977 name=test-zone1 2021-09-15T22:18:43.062 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"05C2LIV22Q1515AF","secret_key":"bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6"} 2021-09-15T22:18:43.063 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:18:43.064 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:18:43.064 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:18:43.100 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:18:43.101 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:18:43.317 INFO:teuthology.orchestra.run.smithi184.stderr:Sending period to new master zone 4de7baf2-0fdf-417b-9ffb-8497dcfb5977 2021-09-15T22:18:43.401 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","epoch":4,"predecessor_uuid":"debf2df8-db5a-44b2-b2d8-222dc090a86d","sync_status":["","","1_1631744064.791418_217.1",""],"period_map":{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","zones":[{"id":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","name":"test-zone1","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","endpoints":["http://smithi184.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977"},{"id":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","name":"test-zone3","endpoints":["http://smithi184.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","val":3863291254},{"key":"4f4b61b1-d30a-4c5f-906c-596bca64c691","val":24034659},{"key":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","val":3190180025}]},"master_zonegroup":"test-zonegroup","master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","realm_name":"test-realm","realm_epoch":4} 2021-09-15T22:18:43.402 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to true 2021-09-15T22:19:43.404 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:19:43.405 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:19:43.406 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone= --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:19:43.447 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:19:43.447 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:19:43.477 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:19:43.475+0000 7f27350be980 0 failed reading obj info from .rgw.root:zone_info.4de7baf2-0fdf-417b-9ffb-8497dcfb5977: (2) No such file or directory 2021-09-15T22:19:43.477 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:19:43.475+0000 7f27350be980 0 WARNING: could not read zone params for zone id=4de7baf2-0fdf-417b-9ffb-8497dcfb5977 name=test-zone1 2021-09-15T22:19:43.491 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"05C2LIV22Q1515AF","secret_key":"bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6"} 2021-09-15T22:19:43.492 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:19:43.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:19:43.493 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:19:43.530 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:19:43.531 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:19:43.749 INFO:teuthology.orchestra.run.smithi184.stderr:Sending period to new master zone 4de7baf2-0fdf-417b-9ffb-8497dcfb5977 2021-09-15T22:19:43.833 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","epoch":5,"predecessor_uuid":"debf2df8-db5a-44b2-b2d8-222dc090a86d","sync_status":["","","1_1631744064.791418_217.1",""],"period_map":{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","zones":[{"id":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","name":"test-zone1","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","endpoints":["http://smithi184.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","name":"test-zone3","endpoints":["http://smithi184.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","val":3863291254},{"key":"4f4b61b1-d30a-4c5f-906c-596bca64c691","val":24034659},{"key":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","val":3190180025}]},"master_zonegroup":"test-zonegroup","master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","realm_name":"test-realm","realm_epoch":4} 2021-09-15T22:19:43.834 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "" 2021-09-15T22:20:43.836 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_zone_redirect ... ok 2021-09-15T22:20:43.838 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:20:43.839 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:20:43.839 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:20:43.878 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:43.878 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:44.042 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:20:44.072 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744198.692860_53.1","last_update":"2021-09-15T22:16:38.692860Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:20:44.073 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:20:44.074 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:20:44.074 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:20:44.075 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:20:44.116 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:44.116 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:44.298 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744198.692860_53.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:16:38.692860Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:20:44.299 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:20:44.299 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:20:44.300 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:20:44.300 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:20:44.301 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:20:44.339 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:44.339 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:44.510 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744198.692860_53.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:16:38.692860Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:20:44.510 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:20:44.511 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', '05C2LIV22Q1515AF', '--secret', 'bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:44.512 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', '05C2LIV22Q1515AF', '--secret', 'bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:44.512 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key 05C2LIV22Q1515AF --secret bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:20:44.551 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:44.551 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:44.601 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:20:44.598+0000 7f2a8bb56980 0 failed reading obj info from .rgw.root:zone_info.4de7baf2-0fdf-417b-9ffb-8497dcfb5977: (2) No such file or directory 2021-09-15T22:20:44.601 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:20:44.598+0000 7f2a8bb56980 0 WARNING: could not read zone params for zone id=4de7baf2-0fdf-417b-9ffb-8497dcfb5977 name=test-zone1 2021-09-15T22:20:44.610 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"087bf3ea-f6bf-4558-be55-3615ae88bd48","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","roles_pool":"remove.rgw.meta:roles","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","system_key":{"access_key":"05C2LIV22Q1515AF","secret_key":"bclUeEnBWXLTlnrBtpi2r6fOIPKnnNhk"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0}}],"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6"} 2021-09-15T22:20:44.610 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:44.611 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:44.611 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:20:44.688 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:44.688 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:52.741 INFO:teuthology.orchestra.run.smithi184.stderr:Sending period to new master zone 4de7baf2-0fdf-417b-9ffb-8497dcfb5977 2021-09-15T22:20:52.822 INFO:teuthology.orchestra.run.smithi184.stdout:{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","epoch":6,"predecessor_uuid":"debf2df8-db5a-44b2-b2d8-222dc090a86d","sync_status":["","","1_1631744064.791418_217.1",""],"period_map":{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","zones":[{"id":"087bf3ea-f6bf-4558-be55-3615ae88bd48","name":"remove","endpoints":[],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","name":"test-zone1","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","endpoints":["http://smithi184.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","name":"test-zone3","endpoints":["http://smithi184.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"087bf3ea-f6bf-4558-be55-3615ae88bd48","val":1759854662},{"key":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","val":3863291254},{"key":"4f4b61b1-d30a-4c5f-906c-596bca64c691","val":24034659},{"key":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","val":3190180025}]},"master_zonegroup":"test-zonegroup","master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","realm_name":"test-realm","realm_epoch":4} 2021-09-15T22:20:52.823 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:52.823 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:52.824 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:20:52.863 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:52.863 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:52.885 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:20:52.879+0000 7fb33d398980 0 failed reading obj info from .rgw.root:zone_info.4f4b61b1-d30a-4c5f-906c-596bca64c691: (2) No such file or directory 2021-09-15T22:20:52.885 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:20:52.879+0000 7fb33d398980 0 WARNING: could not read zone params for zone id=4f4b61b1-d30a-4c5f-906c-596bca64c691 name=test-zone2 2021-09-15T22:20:52.885 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:20:52.879+0000 7fb33d398980 0 failed reading obj info from .rgw.root:zone_info.5f8055e7-8301-4bb3-9c3e-a1936a9c037b: (2) No such file or directory 2021-09-15T22:20:52.886 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:20:52.879+0000 7fb33d398980 0 WARNING: could not read zone params for zone id=5f8055e7-8301-4bb3-9c3e-a1936a9c037b name=test-zone3 2021-09-15T22:20:52.893 INFO:teuthology.orchestra.run.smithi180.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","zones":[{"id":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","name":"test-zone1","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","endpoints":["http://smithi184.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","name":"test-zone3","endpoints":["http://smithi184.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","sync_policy":{"groups":[]}} 2021-09-15T22:20:52.893 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:52.894 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:52.895 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:20:52.932 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:52.932 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:52.950 INFO:teuthology.orchestra.run.smithi180.stderr:zone name remove not found in zonegroup test-zonegroup 2021-09-15T22:20:52.955 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-09-15T22:20:52.956 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:52.957 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:52.957 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone delete --rgw-zone remove --cluster c2 --debug-rgw 0 --debug-ms 0 2021-09-15T22:20:52.993 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:52.993 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:53.025 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:20:53.021+0000 7ff12897b980 0 failed reading obj info from .rgw.root:zone_info.4de7baf2-0fdf-417b-9ffb-8497dcfb5977: (2) No such file or directory 2021-09-15T22:20:53.026 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:20:53.021+0000 7ff12897b980 0 WARNING: could not read zone params for zone id=4de7baf2-0fdf-417b-9ffb-8497dcfb5977 name=test-zone1 2021-09-15T22:20:53.029 INFO:teuthology.orchestra.run.smithi184.stderr:2021-09-15T22:20:53.025+0000 7ff12897b980 0 zone id 087bf3ea-f6bf-4558-be55-3615ae88bd48 is not a part of zonegroup default 2021-09-15T22:20:53.044 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:53.045 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:53.046 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:20:53.087 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:53.087 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:53.124 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:20:53.119+0000 7f99e2569980 0 WARNING: can't generate connection for zone 087bf3ea-f6bf-4558-be55-3615ae88bd48 id remove: no endpoints defined 2021-09-15T22:20:53.262 INFO:teuthology.orchestra.run.smithi180.stdout:{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","epoch":7,"predecessor_uuid":"debf2df8-db5a-44b2-b2d8-222dc090a86d","sync_status":["","","1_1631744064.791418_217.1",""],"period_map":{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","zones":[{"id":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","name":"test-zone1","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","endpoints":["http://smithi184.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","name":"test-zone3","endpoints":["http://smithi184.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","val":3863291254},{"key":"4f4b61b1-d30a-4c5f-906c-596bca64c691","val":24034659},{"key":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","val":3190180025}]},"master_zonegroup":"test-zonegroup","master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","realm_name":"test-realm","realm_epoch":4} 2021-09-15T22:20:53.263 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_zonegroup_remove ... ok 2021-09-15T22:20:53.264 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:53.264 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:53.265 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup create --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:20:53.301 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:53.301 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:53.330 INFO:teuthology.orchestra.run.smithi180.stdout:{"id":"97af4ce7-8b8f-43d7-b24a-c7215a601060","name":"remove_zg","api_name":"remove_zg","is_master":"false","endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[],"default_placement":"","realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","sync_policy":{"groups":[]}} 2021-09-15T22:20:53.330 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:53.331 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:53.332 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:20:53.408 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:53.409 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:53.459 INFO:teuthology.orchestra.run.smithi180.stdout:{"id":"bff2b82d-6d71-4e40-b285-4d58353ca106","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","roles_pool":"remove.rgw.meta:roles","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0}}],"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6"} 2021-09-15T22:20:53.460 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:53.461 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:53.461 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:20:53.499 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:53.500 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:53.687 INFO:teuthology.orchestra.run.smithi180.stdout:{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","epoch":8,"predecessor_uuid":"debf2df8-db5a-44b2-b2d8-222dc090a86d","sync_status":["","","1_1631744064.791418_217.1",""],"period_map":{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","zonegroups":[{"id":"97af4ce7-8b8f-43d7-b24a-c7215a601060","name":"remove_zg","api_name":"remove_zg","is_master":"false","endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"bff2b82d-6d71-4e40-b285-4d58353ca106","zones":[{"id":"bff2b82d-6d71-4e40-b285-4d58353ca106","name":"remove","endpoints":[],"log_meta":"false","log_data":"false","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","sync_policy":{"groups":[]}},{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","zones":[{"id":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","name":"test-zone1","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","endpoints":["http://smithi184.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","name":"test-zone3","endpoints":["http://smithi184.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","val":3863291254},{"key":"4f4b61b1-d30a-4c5f-906c-596bca64c691","val":24034659},{"key":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","val":3190180025},{"key":"bff2b82d-6d71-4e40-b285-4d58353ca106","val":3000479744}]},"master_zonegroup":"test-zonegroup","master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","realm_name":"test-realm","realm_epoch":4} 2021-09-15T22:20:53.688 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:53.689 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:53.690 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone delete --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:20:53.727 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:53.727 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:53.761 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:20:53.755+0000 7fade52e5980 0 zone id bff2b82d-6d71-4e40-b285-4d58353ca106 is not a part of zonegroup test-zonegroup 2021-09-15T22:20:53.762 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:20:53.755+0000 7fade52e5980 0 zone id bff2b82d-6d71-4e40-b285-4d58353ca106 is not a part of zonegroup default 2021-09-15T22:20:53.770 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:53.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:53.772 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:20:53.848 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:53.848 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:53.883 INFO:teuthology.orchestra.run.smithi180.stderr:2021-09-15T22:20:53.879+0000 7f1657622980 0 ERROR: zonegroup remove_zg has a non existent master zone 2021-09-15T22:20:53.890 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-09-15T22:20:53.891 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:53.891 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:53.892 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup delete --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:20:53.928 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:53.929 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:53.958 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:53.958 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:53.959 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:20:53.998 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:53.999 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:54.178 INFO:teuthology.orchestra.run.smithi180.stdout:{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","epoch":9,"predecessor_uuid":"debf2df8-db5a-44b2-b2d8-222dc090a86d","sync_status":["","","1_1631744064.791418_217.1",""],"period_map":{"id":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","zones":[{"id":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","name":"test-zone1","endpoints":["http://smithi180.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"4f4b61b1-d30a-4c5f-906c-596bca64c691","name":"test-zone2","endpoints":["http://smithi184.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","name":"test-zone3","endpoints":["http://smithi184.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","val":3863291254},{"key":"4f4b61b1-d30a-4c5f-906c-596bca64c691","val":24034659},{"key":"5f8055e7-8301-4bb3-9c3e-a1936a9c037b","val":3190180025}]},"master_zonegroup":"test-zonegroup","master_zone":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"7b8f35c2-e353-409a-bb72-b775418364c6","realm_name":"test-realm","realm_epoch":4} 2021-09-15T22:20:54.179 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_zg_master_zone_delete ... ok 2021-09-15T22:20:54.180 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-36 2021-09-15T22:20:54.257 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-37 2021-09-15T22:20:54.363 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-38 2021-09-15T22:20:54.385 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-39 2021-09-15T22:20:56.219 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_set_bucket_website ... rgw_multi.tests.test_set_bucket_policy ... ok 2021-09-15T22:20:56.220 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-40 2021-09-15T22:20:56.245 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-41 2021-09-15T22:20:56.290 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'hankqd-40', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:56.291 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'hankqd-40', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:56.292 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket hankqd-40 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:20:56.334 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:56.334 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:56.563 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'hankqd-41', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:56.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'hankqd-41', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:20:56.564 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket hankqd-41 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:20:56.599 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:56.600 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:56.827 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:20:56.828 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:20:56.829 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 log list --rgw-zone test-zone1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:20:56.907 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:56.907 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:57.117 INFO:teuthology.orchestra.run.smithi180.stdout:["obj_delete_at_hint.0000000078","meta.history","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.31-hankqd-27","obj_delete_at_hint.0000000040","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.9-hankqd-5","meta.full-sync.index.0","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17:8","obj_delete_at_hint.0000000015","datalog.sync-status.shard.4f4b61b1-d30a-4c5f-906c-596bca64c691.2","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.19-hankqd-15","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","datalog.sync-status.shard.4f4b61b1-d30a-4c5f-906c-596bca64c691.3","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.30-hankqd-26","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15:5","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_log.3","datalog.sync-status.shard.4f4b61b1-d30a-4c5f-906c-596bca64c691.0.retry","datalog.sync-status.shard.4f4b61b1-d30a-4c5f-906c-596bca64c691.3.retry","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18:8","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17:5","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15:3","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.23-hankqd-19","obj_delete_at_hint.0000000096","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11:8","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","data.full-sync.index.4f4b61b1-d30a-4c5f-906c-596bca64c691.3","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.29-hankqd-25","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16:1","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-10:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.14:1","bilog.trim","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.3-hankqd-3","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4936.6-hankqd-41","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-26:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.30:10","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12:1","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21:8","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","data_log.1","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.1-hankqd-1","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16:3","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4936.2-hankqd-37","meta.full-sync.index.1","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.26-hankqd-22","datalog.sync-status.shard.4f4b61b1-d30a-4c5f-906c-596bca64c691.1","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4842.1-hankqd-35","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18-hankqd-14","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11:3","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.14-hankqd-10","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.1-hankqd-31","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12-hankqd-8","mdlog.sync-status.shard.2","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.4-hankqd-4","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15-hankqd-11","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22:8","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","mdlog.sync-status.shard.1","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11-hankqd-7","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11:1","obj_delete_at_hint.0000000068","datalog.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17-hankqd-13","meta.full-sync.index.3","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","datalog.sync-status.shard.4f4b61b1-d30a-4c5f-906c-596bca64c691.1.retry","mdlog.sync-status.shard.3","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.4-hankqd-34","mdlog.sync-status.shard.0","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","2021-09-15-22-4f4b61b1-d30a-4c5f-906c-596bca64c691.5016.2-hankqd-30","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-35:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4842.1:5","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","data.full-sync.index.4f4b61b1-d30a-4c5f-906c-596bca64c691.0","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16:5","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16-hankqd-12","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.28-hankqd-24","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.10-hankqd-6","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4936.4-hankqd-39","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21-hankqd-17","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.24-hankqd-20","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.2-hankqd-2","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4936.1-hankqd-36","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-33:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.3:8","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-15:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.19:8","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12:8","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.20-hankqd-16","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-34:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.4:8","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4936.3-hankqd-38","obj_delete_at_hint.0000000051","data.full-sync.index.4f4b61b1-d30a-4c5f-906c-596bca64c691.2","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.2-hankqd-32","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12:7","obj_delete_at_hint.0000000023","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.3-hankqd-33","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15:1","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","meta.full-sync.index.2","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22-hankqd-18","data_log.2","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-25:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.29:10","obj_delete_at_hint.0000000067","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.25-hankqd-21","data.full-sync.index.4f4b61b1-d30a-4c5f-906c-596bca64c691.1","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12:3","obj_delete_at_hint.0000000086","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4936.5-hankqd-40","datalog.sync-status.shard.4f4b61b1-d30a-4c5f-906c-596bca64c691.0","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-9:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.13:1","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.27-hankqd-23","meta.log.fc8d61ff-709a-4d9b-a65c-86a8ab621cb2.2","2021-09-15-22-4f4b61b1-d30a-4c5f-906c-596bca64c691.5016.1-hankqd-29","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.13-hankqd-9","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-16:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.20:8","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.32-hankqd-28","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","bucket.sync-status.4f4b61b1-d30a-4c5f-906c-596bca64c691:hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11:7","obj_delete_at_hint.0000000042","datalog.sync-status.shard.4f4b61b1-d30a-4c5f-906c-596bca64c691.2.retry","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2021-09-15T22:20:57.144 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:20:57.145 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:20:57.145 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 log list --rgw-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:20:57.182 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:57.183 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:57.378 INFO:teuthology.orchestra.run.smithi184.stdout:["obj_delete_at_hint.0000000078","meta.history","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.31-hankqd-27","obj_delete_at_hint.0000000040","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.9-hankqd-5","meta.full-sync.index.0","obj_delete_at_hint.0000000015","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.19-hankqd-15","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","datalog.sync-status.shard.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.0.retry","obj_delete_at_hint.0000000047","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-26:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.30:10","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.30-hankqd-26","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_log.3","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15:3","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12:8","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12:7","obj_delete_at_hint.0000000110","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-33:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.3:8","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.29-hankqd-25","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bilog.trim","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.3-hankqd-3","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4936.6-hankqd-41","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-9:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.13:1","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","data_log.1","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11:1","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.1-hankqd-1","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4936.2-hankqd-37","meta.full-sync.index.1","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21:8","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.26-hankqd-22","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4842.1-hankqd-35","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18-hankqd-14","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","datalog.sync-status.shard.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.1","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11:7","datalog.sync-status.shard.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.2","data.full-sync.index.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.0","obj_delete_at_hint.0000000053","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15:5","obj_delete_at_hint.0000000091","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12:3","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.14-hankqd-10","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.1-hankqd-31","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12-hankqd-8","mdlog.sync-status.shard.2","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.4-hankqd-4","datalog.sync-status.shard.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.0","data.full-sync.index.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.3","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","data.full-sync.index.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.2","obj_delete_at_hint.0000000116","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15-hankqd-11","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-35:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4842.1:5","mdlog.sync-status.shard.1","datalog.sync-status.shard.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.3.retry","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-10:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.14:1","obj_delete_at_hint.0000000066","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11-hankqd-7","datalog.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17-hankqd-13","meta.full-sync.index.3","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12:1","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18:8","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.4-hankqd-34","mdlog.sync-status.shard.0","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-34:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.4:8","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-15:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.19:8","obj_delete_at_hint.0000000039","datalog.sync-status.shard.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.2.retry","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","2021-09-15-22-4f4b61b1-d30a-4c5f-906c-596bca64c691.5016.2-hankqd-30","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16:5","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-16:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.20:8","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22:8","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16-hankqd-12","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.28-hankqd-24","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.10-hankqd-6","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4936.4-hankqd-39","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21-hankqd-17","obj_delete_at_hint.0000000072","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16:3","obj_delete_at_hint.0000000062","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.24-hankqd-20","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.2-hankqd-2","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.20-hankqd-16","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15:1","datalog.sync-status.shard.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.3","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11:3","obj_delete_at_hint.0000000013","data.full-sync.index.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.1","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.2-hankqd-32","obj_delete_at_hint.0000000023","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.3-hankqd-33","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11:8","meta.full-sync.index.2","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22-hankqd-18","data_log.2","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16:1","obj_delete_at_hint.0000000067","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-25:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.29:10","obj_delete_at_hint.0000000086","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17:5","meta.log.fc8d61ff-709a-4d9b-a65c-86a8ab621cb2.2","2021-09-15-22-4f4b61b1-d30a-4c5f-906c-596bca64c691.5016.1-hankqd-29","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17:8","datalog.sync-status.shard.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.1.retry","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.13-hankqd-9","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","2021-09-15-22-4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.32-hankqd-28","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2021-09-15T22:20:57.404 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['log', 'list', '--rgw-zone', 'test-zone3', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:20:57.405 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'log', 'list', '--rgw-zone', 'test-zone3', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:20:57.406 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 log list --rgw-zone test-zone3 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:20:57.481 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:57.481 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:57.673 INFO:teuthology.orchestra.run.smithi184.stdout:["obj_delete_at_hint.0000000078","meta.history","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","meta.full-sync.index.0","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","datalog.sync-status.shard.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.0.retry","obj_delete_at_hint.0000000047","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-26:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.30:10","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15:3","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12:8","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12:7","obj_delete_at_hint.0000000110","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-33:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.3:8","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bilog.trim","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","meta.log.af209127-5081-4e40-be50-bf8d6eadaece.3","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-9:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.13:1","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11:1","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","meta.full-sync.index.1","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-17:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.21:8","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","datalog.sync-status.shard.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.1","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11:7","datalog.sync-status.shard.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.2","data.full-sync.index.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.0","obj_delete_at_hint.0000000053","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15:5","obj_delete_at_hint.0000000091","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12:3","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","mdlog.sync-status.shard.2","datalog.sync-status.shard.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.0","data.full-sync.index.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.3","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","data.full-sync.index.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.2","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-35:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4842.1:5","mdlog.sync-status.shard.1","datalog.sync-status.shard.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.3.retry","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-10:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.14:1","obj_delete_at_hint.0000000066","datalog.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","meta.full-sync.index.3","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-8:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.12:1","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-14:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.18:8","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","mdlog.sync-status.shard.0","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-34:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4737.4:8","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-15:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.19:8","obj_delete_at_hint.0000000039","datalog.sync-status.shard.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.2.retry","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","obj_delete_at_hint.0000000012","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16:5","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-16:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.20:8","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-18:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.22:8","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16:3","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","meta.log.debf2df8-db5a-44b2-b2d8-222dc090a86d.2","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-11:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.15:1","datalog.sync-status.shard.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.3","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","meta.log.af209127-5081-4e40-be50-bf8d6eadaece.2","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11:3","obj_delete_at_hint.0000000013","data.full-sync.index.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.1","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-7:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.11:8","meta.full-sync.index.2","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-12:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.16:1","obj_delete_at_hint.0000000067","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-25:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.29:10","meta.log.af209127-5081-4e40-be50-bf8d6eadaece.0","obj_delete_at_hint.0000000086","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17:5","meta.log.fc8d61ff-709a-4d9b-a65c-86a8ab621cb2.2","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","bucket.sync-status.4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-13:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4273.17:8","datalog.sync-status.shard.4de7baf2-0fdf-417b-9ffb-8497dcfb5977.1.retry","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2021-09-15T22:20:57.700 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:20:57.700 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:20:57.701 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:20:57.739 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:57.740 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:57.934 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631744456.795968_139.2","last_update":"2021-09-15T22:20:56.795968Z"},{"marker":"1_1631744456.795968_423.3","last_update":"2021-09-15T22:20:56.795968Z"},{"marker":"1_1631744456.795968_205.3","last_update":"2021-09-15T22:20:56.795968Z"},{"marker":"1_1631744456.795968_242.3","last_update":"2021-09-15T22:20:56.795968Z"}] 2021-09-15T22:20:57.934 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-09-15T22:20:57.935 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:20:57.936 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:20:57.936 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:20:57.978 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:20:57.978 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:20:58.175 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":2214498870205982451},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:20:58.176 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:21:03.177 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:03.178 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:03.179 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:21:03.221 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:21:03.221 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:21:03.420 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":2214498870205982451},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:21:03.421 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:21:08.422 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:08.423 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:08.424 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:21:08.467 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:21:08.467 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:21:08.660 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":2214498870205982451},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:21:08.660 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:21:13.662 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:13.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:13.663 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:21:13.709 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:21:13.709 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:21:13.906 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":2214498870205982451},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:21:13.906 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:21:18.907 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:18.908 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:18.909 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:21:18.951 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:21:18.952 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:21:19.146 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":2214498870205982451},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:21:19.147 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:21:24.148 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:24.149 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:24.150 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:21:24.190 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:21:24.191 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:21:24.389 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":2214498870205982451},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:21:24.390 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:21:29.391 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:29.391 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:29.392 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:21:29.431 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:21:29.431 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:21:29.628 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":2214498870205982451},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:21:29.629 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:21:34.630 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:34.631 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:34.632 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:21:34.673 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:21:34.674 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:21:34.875 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":2214498870205982451},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:21:34.876 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:21:39.878 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:39.879 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:39.879 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:21:39.923 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:21:39.924 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:21:40.133 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":2214498870205982451},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:21:40.134 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:21:45.135 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:45.136 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:45.136 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:21:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:21:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:21:45.403 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":2214498870205982451},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:21:45.404 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:21:50.405 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:50.406 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:50.407 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:21:50.451 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:21:50.451 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:21:50.638 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":2214498870205982451},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:21:50.639 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:21:55.641 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:55.641 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:21:55.642 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:21:55.684 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:21:55.684 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:21:55.898 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":2214498870205982451},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:21:55.899 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:21:56.075 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:21:56.068+0000 7fda6a7fc700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:21:56.076 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:21:56.068+0000 7fda767fc700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:21:56.080 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:21:56.072+0000 7fda6bfff700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:21:56.080 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:21:56.072+0000 7fda627fc700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:21:56.081 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:21:56.072+0000 7fda607f8700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:21:56.081 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:21:56.072+0000 7fda5fff7700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:21:56.081 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:21:56.076+0000 7fda5eff5700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:21:56.081 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:21:56.076+0000 7fda5f7f6700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:21:56.082 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:21:56.076+0000 7fda5bfef700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:21:56.082 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:21:56.076+0000 7fda5d7f2700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:21:56.082 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:21:56.076+0000 7fda777fe700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:00.900 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:00.901 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:00.901 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:22:00.943 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:22:00.944 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:22:01.161 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":2214498870205982451},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631744456.795968_139.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:20:56.795968Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744456.795968_423.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:20:56.795968Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744456.795968_205.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:20:56.795968Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631744456.795968_242.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:20:56.795968Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:22:01.161 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-09-15T22:22:01.162 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:01.162 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:01.163 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:22:01.202 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:22:01.203 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:22:01.393 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631744456.795968_139.2","last_update":"2021-09-15T22:20:56.795968Z"},{"marker":"1_1631744456.795968_423.3","last_update":"2021-09-15T22:20:56.795968Z"},{"marker":"1_1631744456.795968_205.3","last_update":"2021-09-15T22:20:56.795968Z"},{"marker":"1_1631744456.795968_242.3","last_update":"2021-09-15T22:20:56.795968Z"}] 2021-09-15T22:22:01.394 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-09-15T22:22:01.394 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:01.395 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:01.395 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:22:01.434 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:22:01.435 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:22:01.637 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16115054566166127550},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:22:01.638 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:22:06.640 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:06.640 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:06.641 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:22:06.681 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:22:06.682 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:22:06.872 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16115054566166127550},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:22:06.873 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:22:11.875 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:11.875 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:11.876 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:22:11.918 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:22:11.918 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:22:12.125 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16115054566166127550},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:22:12.126 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:22:17.127 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:17.127 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:17.128 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:22:17.169 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:22:17.170 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:22:17.371 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16115054566166127550},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:22:17.372 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:22:22.373 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:22.374 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:22.375 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:22:22.417 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:22:22.417 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:22:22.597 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16115054566166127550},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:22:22.598 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:22:27.601 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:27.602 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:27.602 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:22:27.643 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:22:27.643 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:22:27.837 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16115054566166127550},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:22:27.838 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:22:32.839 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:32.840 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:32.840 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:22:32.881 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:22:32.882 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:22:33.085 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16115054566166127550},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:22:33.086 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:22:38.087 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:38.088 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:38.089 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:22:38.128 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:22:38.128 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:22:38.327 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16115054566166127550},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:22:38.327 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:22:43.329 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:43.330 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:43.330 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:22:43.373 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:22:43.373 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:22:43.564 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16115054566166127550},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:22:43.564 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:22:48.565 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:48.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:48.567 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:22:48.611 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:22:48.611 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:22:48.799 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16115054566166127550},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:22:48.800 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:22:53.802 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:53.802 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:53.803 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:22:53.847 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:22:53.847 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:22:54.045 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16115054566166127550},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631743984.718795_37.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:04.718795Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744134.153889_252.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:15:34.153889Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744323.399139_166.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:18:43.399139Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631743997.486633_119.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:13:17.486633Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:22:54.045 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1631744456.795968_139.2 target=1_1631743984.718795_37.2, shard=1 master=1_1631744456.795968_423.3 target=1_1631744134.153889_252.1, shard=2 master=1_1631744456.795968_205.3 target=1_1631744323.399139_166.1, shard=3 master=1_1631744456.795968_242.3 target=1_1631743997.486633_119.1 2021-09-15T22:22:55.478 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.475+0000 7f52ff7f6700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.479 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.475+0000 7f52ffff7700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.479 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.475+0000 7f5301ffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.479 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.475+0000 7f5300ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.481 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.479+0000 7f52fdff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.481 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.479+0000 7f52fdff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.481 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.479+0000 7f52fbfef700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.482 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.479+0000 7f52fdff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.482 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.479+0000 7f52fd7f2700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.482 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.479+0000 7f52fbfef700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.482 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.479+0000 7f52f9feb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.483 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.479+0000 7f52fa7ec700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.483 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.479+0000 7f52f9feb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.483 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.479+0000 7f52fb7ee700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.483 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.479+0000 7f52f97ea700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.483 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.479+0000 7f530affd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.486 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.483+0000 7f52fdff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.487 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.483+0000 7f52fdff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.487 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.483+0000 7f52fafed700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.487 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.483+0000 7f52fdff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.487 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.483+0000 7f52fbfef700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:55.488 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:55.483+0000 7f52f8fe9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:59.047 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:59.048 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:59.048 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:22:59.092 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:22:59.092 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:22:59.290 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16115054566166127550},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631744456.795968_139.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:20:56.795968Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744456.795968_423.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:20:56.795968Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744456.795968_205.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:20:56.795968Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631744456.795968_242.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:20:56.795968Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:22:59.290 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-09-15T22:22:59.291 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:59.291 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:59.292 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:22:59.329 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:22:59.330 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:22:59.533 INFO:teuthology.orchestra.run.smithi184.stdout:[{"marker":"1_1631744577.333407_149.1","last_update":"2021-09-15T22:22:57.333407Z"},{"marker":"1_1631744577.336340_393.1","last_update":"2021-09-15T22:22:57.336340Z"},{"marker":"1_1631744577.341302_247.1","last_update":"2021-09-15T22:22:57.341302Z"},{"marker":"1_1631744577.343913_253.1","last_update":"2021-09-15T22:22:57.343913Z"}] 2021-09-15T22:22:59.533 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-09-15T22:22:59.534 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:59.536 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:22:59.536 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:22:59.577 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:22:59.578 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:22:59.770 INFO:teuthology.orchestra.run.smithi180.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8964646445785232500},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631744577.333407_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:22:57.333407Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744577.336340_393.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:22:57.336340Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744577.341302_247.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:22:57.341302Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631744577.343913_253.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:22:57.343913Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:22:59.770 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-09-15T22:22:59.771 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_disable ... ok 2021-09-15T22:22:59.772 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-42 2021-09-15T22:22:59.801 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-43 2021-09-15T22:22:59.906 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:22:59.903+0000 7fda76ffd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:59.906 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:59.903+0000 7f52f8fe9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:59.908 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:22:59.907+0000 7fda5dff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:22:59.909 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:22:59.907+0000 7f52fd7f2700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:23:00.247 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:00.248 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:00.248 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:00.289 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:00.289 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:00.443 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000001.26.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.34.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.37.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.37.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:23:00.444 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-42 2021-09-15T22:23:00.444 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:00.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:00.445 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:00.487 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:00.488 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:00.700 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.26.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.34.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.37.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.37.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:23:00.701 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-42 2021-09-15T22:23:00.701 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:00.702 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:00.703 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:00.744 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:00.744 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:00.935 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000001.26.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.34.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.37.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.37.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:23:00.936 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-42 2021-09-15T22:23:00.936 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:00.937 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:00.937 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:00.981 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:00.982 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:01.199 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.26.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.34.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.37.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.37.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:23:01.200 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-42 2021-09-15T22:23:01.200 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:01.201 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:01.201 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:01.238 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:01.238 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:01.460 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":"00000000001.33.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.59.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.33.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.52.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:23:01.461 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-42 2021-09-15T22:23:01.461 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:01.462 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:01.463 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:01.508 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:01.509 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:01.703 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.33.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.59.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.33.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.52.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:23:01.704 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-42 2021-09-15T22:23:01.704 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-42 zones={test-zone2, test-zone1} 2021-09-15T22:23:01.714 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:23:01.720 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-09-15T22:23:01.721 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-09-15T22:23:01.721 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-09-15T22:23:01.722 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-09-15T22:23:01.722 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:23:01.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-09-15T22:23:01.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-09-15T22:23:01.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-09-15T22:23:01.729 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-09-15T22:23:01.786 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:01.839 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:01.954 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:02.053 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:02.107 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:02.219 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:02.321 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:02.375 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:02.482 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:02.586 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:02.638 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:02.746 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:02.845 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-42 zones={test-zone2, test-zone1} 2021-09-15T22:23:02.846 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:02.847 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:02.847 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:02.889 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:02.889 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:03.085 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000001.32.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.33.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.68.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.70.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:23:03.086 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-43 2021-09-15T22:23:03.086 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:03.087 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:03.087 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:03.129 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:03.130 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:03.349 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.32.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.33.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.68.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.70.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:23:03.350 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-43 2021-09-15T22:23:03.350 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:03.351 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:03.352 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:03.391 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:03.391 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:03.579 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000001.32.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.33.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.68.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.70.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:23:03.580 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-43 2021-09-15T22:23:03.580 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:03.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:03.582 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:03.625 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:03.626 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:03.830 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.32.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.33.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.68.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.70.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:23:03.831 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-43 2021-09-15T22:23:03.831 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:03.832 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:03.832 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:03.909 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:03.910 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:04.116 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":"00000000001.39.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.52.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.87.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.89.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:23:04.117 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-43 2021-09-15T22:23:04.118 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:04.118 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:04.119 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:04.165 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:04.165 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:04.381 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.39.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.52.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.87.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.89.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:23:04.381 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-43 2021-09-15T22:23:04.382 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-43 zones={test-zone2, test-zone1} 2021-09-15T22:23:04.391 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:23:04.395 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-09-15T22:23:04.395 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-09-15T22:23:04.396 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-09-15T22:23:04.396 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-09-15T22:23:04.397 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:23:04.402 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-09-15T22:23:04.403 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-09-15T22:23:04.403 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-09-15T22:23:04.404 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-09-15T22:23:04.414 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:04.467 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:04.583 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:04.682 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:04.735 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:04.842 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:04.946 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:04.999 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:05.107 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:05.211 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:05.267 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:05.374 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:05.477 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-43 zones={test-zone2, test-zone1} 2021-09-15T22:23:05.478 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'hankqd-42', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:23:05.479 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'hankqd-42', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:23:05.479 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket hankqd-42 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:23:05.516 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:05.517 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:05.755 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'hankqd-42', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:23:05.755 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'hankqd-42', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:23:05.756 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket hankqd-42 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:23:05.837 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:05.838 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:06.079 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'hankqd-43', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:23:06.080 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'hankqd-43', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:23:06.081 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket hankqd-43 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:23:06.119 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:06.119 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:06.361 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'hankqd-43', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:23:06.361 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'hankqd-43', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:23:06.362 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket hankqd-43 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:23:06.399 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:06.400 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:07.031 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:07.032 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:07.032 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:07.073 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:07.073 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:07.250 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000006.36.5"},{"key":1,"val":"00000000004.34.1"},{"key":2,"val":"00000000006.40.5"},{"key":3,"val":"00000000004.126.1"},{"key":4,"val":"00000000006.43.5"},{"key":5,"val":"00000000004.21.1"},{"key":6,"val":"00000000004.127.1"},{"key":7,"val":"00000000006.47.5"},{"key":8,"val":"00000000004.45.1"},{"key":9,"val":"00000000004.22.1"},{"key":10,"val":"00000000004.37.1"}]} 2021-09-15T22:23:07.251 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-42 2021-09-15T22:23:07.251 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:07.252 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:07.252 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:07.295 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:07.296 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:07.489 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.36.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.40.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.126.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.43.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.127.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.47.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}}] 2021-09-15T22:23:07.490 WARNING:rgw_multi.tests:bucket hankqd-42 zone test-zone2 behind zone test-zone1: shard=1 master=00000000004.34.1 target=, shard=5 master=00000000004.21.1 target=, shard=9 master=00000000004.22.1 target= 2021-09-15T22:23:12.491 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:12.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:12.492 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:12.528 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:12.529 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:12.725 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.36.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.40.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.126.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.43.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.127.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.47.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}}] 2021-09-15T22:23:12.726 WARNING:rgw_multi.tests:bucket hankqd-42 zone test-zone2 behind zone test-zone1: shard=1 master=00000000004.34.1 target=, shard=5 master=00000000004.21.1 target=, shard=9 master=00000000004.22.1 target= 2021-09-15T22:23:17.727 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:17.729 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:17.730 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:17.777 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:17.777 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:17.983 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.36.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.40.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.126.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.43.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.21.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.127.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.47.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.22.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}}] 2021-09-15T22:23:17.985 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-42 2021-09-15T22:23:17.985 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:17.986 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:17.987 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:18.026 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:18.026 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:18.221 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000006.36.5"},{"key":1,"val":"00000000004.34.1"},{"key":2,"val":"00000000006.40.5"},{"key":3,"val":"00000000004.126.1"},{"key":4,"val":"00000000006.43.5"},{"key":5,"val":"00000000004.21.1"},{"key":6,"val":"00000000004.127.1"},{"key":7,"val":"00000000006.47.5"},{"key":8,"val":"00000000004.45.1"},{"key":9,"val":"00000000004.22.1"},{"key":10,"val":"00000000004.37.1"}]} 2021-09-15T22:23:18.222 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-42 2021-09-15T22:23:18.222 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:18.223 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:18.224 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:18.267 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:18.267 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:18.473 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.36.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.40.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.126.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.43.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.21.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.127.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.47.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.22.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}}] 2021-09-15T22:23:18.473 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-42 2021-09-15T22:23:18.474 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:18.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:18.475 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:18.509 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:18.509 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:18.689 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":"00000000002.35.5"},{"key":1,"val":""},{"key":2,"val":"00000000002.61.5"},{"key":3,"val":""},{"key":4,"val":"00000000002.35.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000002.54.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:23:18.690 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-42 2021-09-15T22:23:18.690 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:18.691 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:18.693 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:18.736 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:18.736 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:18.949 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.35.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.61.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.35.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.54.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:23:18.950 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-42 2021-09-15T22:23:18.951 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-42 zones={test-zone2, test-zone1} 2021-09-15T22:23:18.960 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:23:18.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-09-15T22:23:18.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-09-15T22:23:18.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-09-15T22:23:18.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-09-15T22:23:18.968 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-09-15T22:23:18.969 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-09-15T22:23:18.969 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-09-15T22:23:18.969 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-09-15T22:23:18.970 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:23:18.976 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-09-15T22:23:18.977 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-09-15T22:23:18.977 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-09-15T22:23:18.978 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-09-15T22:23:18.979 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-09-15T22:23:18.980 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-09-15T22:23:18.980 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-09-15T22:23:18.980 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-09-15T22:23:18.992 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:19.047 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:19.158 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:19.257 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:19.315 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:19.422 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:19.529 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:19.588 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:19.697 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:19.801 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:19.860 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:19.972 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:20.077 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-09-15T22:23:20.135 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-09-15T22:23:20.242 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-09-15T22:23:20.347 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-09-15T22:23:20.398 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-09-15T22:23:20.503 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-09-15T22:23:20.606 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-09-15T22:23:20.661 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-09-15T22:23:20.772 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-09-15T22:23:20.877 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-09-15T22:23:20.932 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-09-15T22:23:21.043 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-09-15T22:23:21.154 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-42 zones={test-zone2, test-zone1} 2021-09-15T22:23:21.155 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:21.155 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:21.156 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:21.198 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:21.199 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:21.397 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000006.42.5"},{"key":1,"val":"00000000004.83.1"},{"key":2,"val":"00000000006.39.5"},{"key":3,"val":"00000000004.41.1"},{"key":4,"val":"00000000006.88.5"},{"key":5,"val":"00000000004.18.1"},{"key":6,"val":"00000000004.22.1"},{"key":7,"val":"00000000006.90.5"},{"key":8,"val":"00000000004.52.1"},{"key":9,"val":"00000000004.86.1"},{"key":10,"val":"00000000004.40.1"}]} 2021-09-15T22:23:21.398 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-43 2021-09-15T22:23:21.398 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:21.399 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:21.400 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:21.442 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:21.443 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:21.657 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.42.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.83.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.39.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.88.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.18.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.22.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.90.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.86.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}}] 2021-09-15T22:23:21.657 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-43 2021-09-15T22:23:21.658 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:21.659 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:21.659 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:21.700 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:21.700 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:21.893 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000006.42.5"},{"key":1,"val":"00000000004.83.1"},{"key":2,"val":"00000000006.39.5"},{"key":3,"val":"00000000004.41.1"},{"key":4,"val":"00000000006.88.5"},{"key":5,"val":"00000000004.18.1"},{"key":6,"val":"00000000004.22.1"},{"key":7,"val":"00000000006.90.5"},{"key":8,"val":"00000000004.52.1"},{"key":9,"val":"00000000004.86.1"},{"key":10,"val":"00000000004.40.1"}]} 2021-09-15T22:23:21.893 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-43 2021-09-15T22:23:21.894 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:21.894 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:21.895 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:21.939 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:21.939 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:22.144 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.42.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.83.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.39.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.88.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.18.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.22.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.90.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.86.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}}] 2021-09-15T22:23:22.145 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-43 2021-09-15T22:23:22.145 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:22.146 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:22.146 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:22.185 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:22.186 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:22.386 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":"00000000002.41.5"},{"key":1,"val":""},{"key":2,"val":"00000000002.54.5"},{"key":3,"val":""},{"key":4,"val":"00000000002.91.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000002.93.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:23:22.386 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-43 2021-09-15T22:23:22.387 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:22.388 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:22.388 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:22.431 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:22.431 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:22.639 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.41.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.54.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.91.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.93.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:23:22.639 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-43 2021-09-15T22:23:22.640 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-43 zones={test-zone2, test-zone1} 2021-09-15T22:23:22.648 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:23:22.654 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-09-15T22:23:22.654 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-09-15T22:23:22.655 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-09-15T22:23:22.655 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-09-15T22:23:22.655 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-09-15T22:23:22.656 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-09-15T22:23:22.656 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-09-15T22:23:22.657 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-09-15T22:23:22.657 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:23:22.664 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-09-15T22:23:22.664 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-09-15T22:23:22.665 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-09-15T22:23:22.665 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-09-15T22:23:22.665 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-09-15T22:23:22.666 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-09-15T22:23:22.666 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-09-15T22:23:22.667 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-09-15T22:23:22.680 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:22.737 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:22.848 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:22.957 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:23.012 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:23.123 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:23.229 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:23.284 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:23.394 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:23.501 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:23.555 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:23.664 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:23.774 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-09-15T22:23:23.831 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-09-15T22:23:23.939 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-09-15T22:23:24.050 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-09-15T22:23:24.103 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-09-15T22:23:24.210 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-09-15T22:23:24.313 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-09-15T22:23:24.368 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-09-15T22:23:24.479 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-09-15T22:23:24.586 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-09-15T22:23:24.639 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-09-15T22:23:24.788 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-09-15T22:23:24.895 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-43 zones={test-zone2, test-zone1} 2021-09-15T22:23:24.895 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:24.896 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:24.896 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:24.934 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:24.934 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:25.125 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631744586.595792_159.2","last_update":"2021-09-15T22:23:06.595792Z"},{"marker":"1_1631744586.595792_471.3","last_update":"2021-09-15T22:23:06.595792Z"},{"marker":"1_1631744586.595792_287.3","last_update":"2021-09-15T22:23:06.595792Z"},{"marker":"1_1631744586.595792_281.3","last_update":"2021-09-15T22:23:06.595792Z"}] 2021-09-15T22:23:25.126 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-09-15T22:23:25.126 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:25.127 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:25.127 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:25.169 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:25.169 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:25.373 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":2214498870205982451},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631744586.595792_159.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:06.595792Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744586.595792_471.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:06.595792Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744586.595792_287.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:06.595792Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631744586.595792_281.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:06.595792Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:23:25.374 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-09-15T22:23:25.375 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:25.375 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:25.376 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:25.415 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:25.415 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:25.608 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631744586.595792_159.2","last_update":"2021-09-15T22:23:06.595792Z"},{"marker":"1_1631744586.595792_471.3","last_update":"2021-09-15T22:23:06.595792Z"},{"marker":"1_1631744586.595792_287.3","last_update":"2021-09-15T22:23:06.595792Z"},{"marker":"1_1631744586.595792_281.3","last_update":"2021-09-15T22:23:06.595792Z"}] 2021-09-15T22:23:25.609 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-09-15T22:23:25.609 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:25.610 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:25.610 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:25.652 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:25.653 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:25.840 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16115054566166127550},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631744586.595792_159.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:06.595792Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744586.595792_471.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:06.595792Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744586.595792_287.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:06.595792Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631744586.595792_281.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:06.595792Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:23:25.840 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-09-15T22:23:25.841 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:25.841 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:25.842 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:25.881 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:25.881 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:26.074 INFO:teuthology.orchestra.run.smithi184.stdout:[{"marker":"1_1631744586.938815_165.2","last_update":"2021-09-15T22:23:06.938815Z"},{"marker":"1_1631744586.938815_407.7","last_update":"2021-09-15T22:23:06.938815Z"},{"marker":"1_1631744586.938815_294.3","last_update":"2021-09-15T22:23:06.938815Z"},{"marker":"1_1631744586.938815_271.5","last_update":"2021-09-15T22:23:06.938815Z"}] 2021-09-15T22:23:26.074 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-09-15T22:23:26.075 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:26.076 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:26.076 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:26.119 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:26.120 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:26.311 INFO:teuthology.orchestra.run.smithi180.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8964646445785232500},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631744586.938815_165.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:06.938815Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744586.938815_407.7","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:06.938815Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744586.938815_294.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:06.938815Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631744586.938815_271.5","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:06.938815Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:23:26.312 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-09-15T22:23:26.313 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_enable_right_after_disable ... ok 2021-09-15T22:23:26.314 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-44 2021-09-15T22:23:26.339 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-45 2021-09-15T22:23:26.779 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:26.781 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:26.781 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:26.816 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:26.816 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:26.959 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:23:26.982 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744606.356831_133.1","last_update":"2021-09-15T22:23:26.356831Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:23:26.983 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:23:26.983 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:26.984 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:26.984 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:27.020 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:27.021 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:27.194 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744606.356831_133.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:26.356831Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:23:27.194 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:23:27.195 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:23:27.196 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:27.196 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:27.197 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:27.233 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:27.234 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:27.416 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744606.356831_133.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:26.356831Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:23:27.417 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:23:27.418 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:27.419 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:27.420 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:27.461 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:27.461 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:27.653 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000001.40.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.29.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.25.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.35.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:23:27.653 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-44 2021-09-15T22:23:27.654 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:27.655 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:27.655 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:27.700 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:27.701 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:27.914 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.40.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.29.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.25.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.35.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:23:27.915 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-44 2021-09-15T22:23:27.916 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:27.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:27.917 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:27.957 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:27.957 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:28.157 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000001.40.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.29.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.25.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.35.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:23:28.157 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-44 2021-09-15T22:23:28.158 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:28.159 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:28.160 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:28.206 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:28.206 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:28.401 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.40.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.29.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.25.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.35.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:23:28.402 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-44 2021-09-15T22:23:28.403 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:28.403 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:28.404 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:28.439 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:28.440 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:28.621 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":"00000000001.55.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.31.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.26.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.44.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:23:28.622 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-44 2021-09-15T22:23:28.622 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:28.623 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:28.623 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:28.666 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:28.666 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:28.870 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.55.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.31.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.26.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.44.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:23:28.871 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-44 2021-09-15T22:23:28.871 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-44 zones={test-zone2, test-zone1} 2021-09-15T22:23:28.880 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:23:28.885 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-09-15T22:23:28.886 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-09-15T22:23:28.886 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-09-15T22:23:28.887 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-09-15T22:23:28.887 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:23:28.892 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-09-15T22:23:28.893 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-09-15T22:23:28.893 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-09-15T22:23:28.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-09-15T22:23:28.946 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:28.999 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:29.111 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:29.220 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:29.276 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:29.390 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:29.488 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:29.544 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:29.650 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:29.752 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:29.807 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:29.913 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:30.015 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-44 zones={test-zone2, test-zone1} 2021-09-15T22:23:30.017 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:30.018 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:30.018 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:30.057 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:30.058 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:30.250 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000001.68.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.67.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.22.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.38.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:23:30.250 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-45 2021-09-15T22:23:30.251 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:30.252 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:30.252 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:30.297 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:30.297 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:30.504 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.68.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.67.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.22.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.38.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:23:30.505 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-45 2021-09-15T22:23:30.505 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:30.506 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:30.507 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:30.546 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:30.546 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:30.732 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000001.68.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.67.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.22.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.38.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:23:30.732 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-45 2021-09-15T22:23:30.733 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:30.733 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:30.734 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:30.776 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:30.776 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:30.978 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.68.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.67.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.22.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.38.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:23:30.979 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-45 2021-09-15T22:23:30.979 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:30.980 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:30.981 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:31.021 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:31.021 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:31.221 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":"00000000001.107.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.105.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.25.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.45.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:23:31.222 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-45 2021-09-15T22:23:31.223 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:31.223 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:31.224 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:31.267 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:31.267 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:31.469 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.107.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.105.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.25.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.45.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:23:31.470 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-45 2021-09-15T22:23:31.470 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-45 zones={test-zone2, test-zone1} 2021-09-15T22:23:31.479 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:23:31.484 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-09-15T22:23:31.484 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-09-15T22:23:31.485 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-09-15T22:23:31.485 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-09-15T22:23:31.486 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:23:31.491 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-09-15T22:23:31.491 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-09-15T22:23:31.492 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-09-15T22:23:31.492 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-09-15T22:23:31.544 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:31.599 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:31.706 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:23:31.804 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:31.860 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:31.970 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:23:32.074 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:32.127 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:32.238 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:23:32.349 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:32.419 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:32.525 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:23:32.629 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-45 zones={test-zone2, test-zone1} 2021-09-15T22:23:32.629 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'hankqd-44', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:23:32.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'hankqd-44', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:23:32.631 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket hankqd-44 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:23:32.674 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:32.675 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:32.914 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'hankqd-45', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:23:32.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'hankqd-45', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:23:32.915 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket hankqd-45 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:23:32.953 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:32.953 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:33.197 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:33.198 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:33.199 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:33.278 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:33.280 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:33.449 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:23:33.480 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744613.147967_143.1","last_update":"2021-09-15T22:23:33.147967Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:23:33.480 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:23:33.481 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:33.482 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:33.482 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:33.523 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:33.523 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:33.723 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744606.356831_133.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:26.356831Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:23:33.724 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744613.147967_143.1 target=1_1631744606.356831_133.1 2021-09-15T22:23:38.725 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:38.726 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:38.727 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:38.768 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:38.769 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:38.955 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744613.147967_143.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:33.147967Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:23:38.956 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:23:38.957 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:23:38.957 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:38.958 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:38.958 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:39.041 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:39.041 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:39.227 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744613.147967_143.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:33.147967Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:23:39.228 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:23:39.624 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'hankqd-44', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:23:39.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'hankqd-44', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:23:39.626 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket hankqd-44 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:23:39.668 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:39.668 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:39.910 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'hankqd-45', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:23:39.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'hankqd-45', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:23:39.911 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket hankqd-45 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:23:39.988 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:39.988 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:40.238 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:40.239 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:40.239 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:40.278 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:40.278 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:40.461 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000006.46.1"},{"key":1,"val":"00000000004.41.1"},{"key":2,"val":"00000000006.37.1"},{"key":3,"val":"00000000004.76.1"},{"key":4,"val":"00000000006.31.1"},{"key":5,"val":"00000000004.44.1"},{"key":6,"val":"00000000004.52.1"},{"key":7,"val":"00000000006.43.1"},{"key":8,"val":"00000000004.38.1"},{"key":9,"val":"00000000004.31.1"},{"key":10,"val":"00000000004.132.1"}]} 2021-09-15T22:23:40.462 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-44 2021-09-15T22:23:40.463 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:40.463 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:40.464 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:40.506 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:40.506 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:40.680 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.46.1"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.37.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.31.1"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:23:40.681 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone2 behind zone test-zone1: shard=1 master=00000000004.41.1 target=, shard=5 master=00000000004.44.1 target=, shard=9 master=00000000004.31.1 target= 2021-09-15T22:23:45.682 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:45.683 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:45.684 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:45.729 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:45.729 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:45.956 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.46.1"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.37.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.31.1"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:23:45.956 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone2 behind zone test-zone1: shard=1 master=00000000004.41.1 target=, shard=5 master=00000000004.44.1 target=, shard=9 master=00000000004.31.1 target= 2021-09-15T22:23:50.958 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:50.959 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:50.960 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:51.004 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:51.004 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:51.222 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.46.1"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.37.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.31.1"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:23:51.223 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone2 behind zone test-zone1: shard=1 master=00000000004.41.1 target=, shard=5 master=00000000004.44.1 target=, shard=9 master=00000000004.31.1 target= 2021-09-15T22:23:56.224 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:56.225 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:56.225 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:56.268 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:56.269 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:56.489 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.46.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.37.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.31.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:23:56.489 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-44 2021-09-15T22:23:56.490 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:56.490 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:56.491 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:56.534 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:56.534 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:56.731 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000006.46.1"},{"key":1,"val":"00000000004.41.1"},{"key":2,"val":"00000000006.37.1"},{"key":3,"val":"00000000004.76.1"},{"key":4,"val":"00000000006.31.1"},{"key":5,"val":"00000000004.44.1"},{"key":6,"val":"00000000004.52.1"},{"key":7,"val":"00000000006.43.1"},{"key":8,"val":"00000000004.38.1"},{"key":9,"val":"00000000004.31.1"},{"key":10,"val":"00000000004.132.1"}]} 2021-09-15T22:23:56.731 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-44 2021-09-15T22:23:56.732 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:56.733 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:23:56.733 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:23:56.778 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:23:56.779 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:23:56.991 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:23:56.992 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:24:01.993 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:01.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:01.994 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:24:02.038 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:24:02.039 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:24:02.258 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:24:02.258 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:24:07.260 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:07.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:07.261 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:24:07.305 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:24:07.306 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:24:07.526 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:24:07.527 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:24:12.528 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:12.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:12.529 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:24:12.574 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:24:12.574 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:24:12.775 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:24:12.776 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:24:17.777 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:17.778 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:17.780 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:24:17.822 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:24:17.822 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:24:18.027 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:24:18.027 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:24:23.029 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:23.029 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:23.030 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:24:23.074 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:24:23.075 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:24:23.278 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:24:23.279 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:24:28.280 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:28.281 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:28.282 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:24:28.326 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:24:28.326 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:24:28.521 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:24:28.521 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:24:33.523 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:33.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:33.524 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:24:33.570 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:24:33.570 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:24:33.767 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:24:33.768 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:24:38.769 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:38.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:38.771 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:24:38.813 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:24:38.814 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:24:39.017 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:24:39.094 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:24:44.096 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:44.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:44.097 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:24:44.141 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:24:44.142 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:24:44.347 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:24:44.348 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:24:49.349 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:49.350 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:49.350 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:24:49.394 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:24:49.394 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:24:49.592 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:24:49.593 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:24:54.595 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:54.595 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:54.596 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:24:54.637 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:24:54.637 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:24:54.844 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:24:54.844 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:24:59.846 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:59.847 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:24:59.847 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:24:59.891 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:24:59.891 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:25:00.083 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:25:00.084 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:25:05.085 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:05.086 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:05.086 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:25:05.130 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:25:05.130 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:25:05.334 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:25:05.335 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:25:10.336 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:10.337 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:10.337 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:25:10.380 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:25:10.380 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:25:10.566 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:25:10.567 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:25:15.568 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:15.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:15.569 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:25:15.614 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:25:15.614 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:25:15.821 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:25:15.822 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:25:20.823 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:20.824 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:20.825 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:25:20.869 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:25:20.869 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:25:21.076 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:25:21.077 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:25:26.079 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:26.079 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:26.080 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:25:26.124 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:25:26.125 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:25:26.329 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:25:26.329 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:25:31.330 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:31.331 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:31.332 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:25:31.380 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:25:31.380 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:25:31.574 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:25:31.574 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:25:36.575 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:36.576 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:36.577 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:25:36.619 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:25:36.619 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:25:36.814 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:25:36.815 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:25:41.816 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:41.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:41.818 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:25:41.861 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:25:41.862 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:25:42.074 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:25:42.075 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:25:47.076 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:47.077 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:47.077 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:25:47.120 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:25:47.121 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:25:47.351 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:25:47.351 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:25:52.352 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:52.353 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:52.353 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:25:52.401 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:25:52.402 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:25:52.607 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.26.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.36.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:25:52.608 WARNING:rgw_multi.tests:bucket hankqd-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.46.1 target=00000000002.41.1, shard=2 master=00000000006.37.1 target=00000000002.30.1, shard=4 master=00000000006.31.1 target=00000000002.26.1, shard=7 master=00000000006.43.1 target=00000000002.36.1 2021-09-15T22:25:57.609 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:57.610 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:57.610 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:25:57.655 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:25:57.655 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:25:57.872 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.46.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.37.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.76.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.31.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.43.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.132.1"}}}] 2021-09-15T22:25:57.873 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-44 2021-09-15T22:25:57.873 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:57.874 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:57.874 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:25:57.954 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:25:57.954 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:25:58.163 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":"00000000004.60.1"},{"key":1,"val":"00000000002.42.1"},{"key":2,"val":"00000000004.40.5"},{"key":3,"val":"00000000002.118.1"},{"key":4,"val":"00000000004.31.1"},{"key":5,"val":"00000000002.59.1"},{"key":6,"val":"00000000002.62.1"},{"key":7,"val":"00000000004.52.5"},{"key":8,"val":"00000000002.44.1"},{"key":9,"val":"00000000002.31.1"},{"key":10,"val":"00000000002.146.1"}]} 2021-09-15T22:25:58.164 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-44 2021-09-15T22:25:58.165 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:58.165 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:25:58.166 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:25:58.208 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:25:58.208 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:25:58.423 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.60.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000004.40.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.118.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.31.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.59.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.62.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.52.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.44.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.146.1"}}}] 2021-09-15T22:25:58.424 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-44 2021-09-15T22:25:58.424 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-44 zones={test-zone2, test-zone1} 2021-09-15T22:25:58.437 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:25:58.443 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-09-15T22:25:58.443 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-09-15T22:25:58.444 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-09-15T22:25:58.444 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-09-15T22:25:58.445 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-09-15T22:25:58.445 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-09-15T22:25:58.446 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-09-15T22:25:58.446 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-09-15T22:25:58.446 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:25:58.452 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-09-15T22:25:58.453 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-09-15T22:25:58.453 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-09-15T22:25:58.454 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-09-15T22:25:58.454 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-09-15T22:25:58.454 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-09-15T22:25:58.455 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-09-15T22:25:58.455 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-09-15T22:25:58.465 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:25:58.518 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:25:58.621 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:25:58.724 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:25:58.780 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:25:58.889 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:25:58.988 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:25:59.044 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:25:59.149 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:25:59.248 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:25:59.303 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:25:59.406 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:25:59.504 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-09-15T22:25:59.559 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-09-15T22:25:59.674 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-09-15T22:25:59.781 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-09-15T22:25:59.835 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-09-15T22:25:59.941 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-09-15T22:26:00.041 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-09-15T22:26:00.095 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-09-15T22:26:00.206 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-09-15T22:26:00.304 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-09-15T22:26:00.360 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-09-15T22:26:00.465 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-09-15T22:26:00.567 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-44 zones={test-zone2, test-zone1} 2021-09-15T22:26:00.568 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:00.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:00.569 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:00.606 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:00.607 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:00.803 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000006.82.5"},{"key":1,"val":"00000000004.29.1"},{"key":2,"val":"00000000006.84.5"},{"key":3,"val":"00000000004.45.1"},{"key":4,"val":"00000000006.32.5"},{"key":5,"val":"00000000004.45.1"},{"key":6,"val":"00000000004.28.1"},{"key":7,"val":"00000000006.44.5"},{"key":8,"val":"00000000004.45.1"},{"key":9,"val":"00000000004.39.1"},{"key":10,"val":"00000000004.48.1"}]} 2021-09-15T22:26:00.803 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-45 2021-09-15T22:26:00.804 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:00.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:00.805 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:00.848 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:00.849 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:01.074 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000006.82.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000006.84.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000006.32.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.28.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000006.44.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.39.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}}] 2021-09-15T22:26:01.074 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-45 2021-09-15T22:26:01.075 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:01.075 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:01.076 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:01.118 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:01.119 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:01.324 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000006.82.5"},{"key":1,"val":"00000000004.29.1"},{"key":2,"val":"00000000006.84.5"},{"key":3,"val":"00000000004.45.1"},{"key":4,"val":"00000000006.32.5"},{"key":5,"val":"00000000004.45.1"},{"key":6,"val":"00000000004.28.1"},{"key":7,"val":"00000000006.44.5"},{"key":8,"val":"00000000004.45.1"},{"key":9,"val":"00000000004.39.1"},{"key":10,"val":"00000000004.48.1"}]} 2021-09-15T22:26:01.324 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-45 2021-09-15T22:26:01.325 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:01.325 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:01.326 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:01.371 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:01.371 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:01.594 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.82.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.84.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.32.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.28.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.44.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.39.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}}] 2021-09-15T22:26:01.594 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-45 2021-09-15T22:26:01.595 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:01.595 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:01.596 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:01.675 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:01.675 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:01.904 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":"00000000004.119.1"},{"key":1,"val":"00000000002.32.1"},{"key":2,"val":"00000000004.121.1"},{"key":3,"val":"00000000002.53.1"},{"key":4,"val":"00000000004.33.1"},{"key":5,"val":"00000000002.67.1"},{"key":6,"val":"00000000002.23.1"},{"key":7,"val":"00000000004.50.1"},{"key":8,"val":"00000000002.49.1"},{"key":9,"val":"00000000002.41.1"},{"key":10,"val":"00000000002.41.1"}]} 2021-09-15T22:26:01.904 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-45 2021-09-15T22:26:01.905 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:01.905 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:01.906 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:01.950 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:01.951 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:02.168 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.119.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.32.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.121.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.53.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.33.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.67.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.23.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.50.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.49.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}}] 2021-09-15T22:26:02.169 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-45 2021-09-15T22:26:02.169 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-45 zones={test-zone2, test-zone1} 2021-09-15T22:26:02.177 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:26:02.183 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-09-15T22:26:02.183 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-09-15T22:26:02.184 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-09-15T22:26:02.184 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-09-15T22:26:02.185 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-09-15T22:26:02.185 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-09-15T22:26:02.185 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-09-15T22:26:02.186 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-09-15T22:26:02.186 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:26:02.192 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-09-15T22:26:02.193 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-09-15T22:26:02.193 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-09-15T22:26:02.194 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-09-15T22:26:02.194 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-09-15T22:26:02.195 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-09-15T22:26:02.195 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-09-15T22:26:02.196 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-09-15T22:26:02.205 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:26:02.259 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:26:02.369 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-09-15T22:26:02.468 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:26:02.524 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:26:02.629 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-09-15T22:26:02.726 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:26:02.779 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:26:02.889 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-09-15T22:26:02.992 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:26:03.051 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:26:03.158 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-09-15T22:26:03.256 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-09-15T22:26:03.311 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-09-15T22:26:03.417 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-09-15T22:26:03.516 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-09-15T22:26:03.572 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-09-15T22:26:03.685 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-09-15T22:26:03.788 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-09-15T22:26:03.844 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-09-15T22:26:03.957 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-09-15T22:26:04.056 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-09-15T22:26:04.115 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-09-15T22:26:04.222 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-09-15T22:26:04.329 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-45 zones={test-zone2, test-zone1} 2021-09-15T22:26:04.329 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:04.330 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:04.330 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:04.367 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:04.367 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:04.561 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631744630.158193_240.2","last_update":"2021-09-15T22:23:50.158193Z"},{"marker":"1_1631744630.158193_552.4","last_update":"2021-09-15T22:23:50.158193Z"},{"marker":"1_1631744620.200062_421.3","last_update":"2021-09-15T22:23:40.200062Z"},{"marker":"1_1631744630.158193_344.2","last_update":"2021-09-15T22:23:50.158193Z"}] 2021-09-15T22:26:04.562 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-09-15T22:26:04.562 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:04.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:04.563 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:04.607 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:04.607 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:04.836 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":2214498870205982451},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631744630.158193_240.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:50.158193Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744630.158193_552.4","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:50.158193Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744620.200062_421.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:40.200062Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631744630.158193_344.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:50.158193Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:26:04.837 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-09-15T22:26:04.837 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:04.838 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:04.838 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:04.878 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:04.878 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:05.086 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"1_1631744630.158193_240.2","last_update":"2021-09-15T22:23:50.158193Z"},{"marker":"1_1631744630.158193_552.4","last_update":"2021-09-15T22:23:50.158193Z"},{"marker":"1_1631744620.200062_421.3","last_update":"2021-09-15T22:23:40.200062Z"},{"marker":"1_1631744630.158193_344.2","last_update":"2021-09-15T22:23:50.158193Z"}] 2021-09-15T22:26:05.087 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-09-15T22:26:05.087 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:05.088 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:05.089 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:05.131 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:05.132 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:05.335 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":16115054566166127550},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631744630.158193_240.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:50.158193Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744630.158193_552.4","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:50.158193Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744620.200062_421.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:40.200062Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631744630.158193_344.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:50.158193Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:26:05.335 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-09-15T22:26:05.336 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:05.337 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:05.337 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:05.415 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:05.416 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:05.635 INFO:teuthology.orchestra.run.smithi184.stdout:[{"marker":"1_1631744630.950417_260.4","last_update":"2021-09-15T22:23:50.950417Z"},{"marker":"1_1631744630.950417_432.6","last_update":"2021-09-15T22:23:50.950417Z"},{"marker":"1_1631744630.950417_376.6","last_update":"2021-09-15T22:23:50.950417Z"},{"marker":"1_1631744630.950417_298.6","last_update":"2021-09-15T22:23:50.950417Z"}] 2021-09-15T22:26:05.635 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-09-15T22:26:05.636 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:05.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:05.637 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:05.675 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:05.675 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:05.873 INFO:teuthology.orchestra.run.smithi180.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8964646445785232500},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1631744630.950417_260.4","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:50.950417Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1631744630.950417_432.6","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:50.950417Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1631744630.950417_376.6","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:50.950417Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1631744630.950417_298.6","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:23:50.950417Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-09-15T22:26:05.874 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-09-15T22:26:05.875 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_disable_enable ... ok 2021-09-15T22:26:05.876 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-46 2021-09-15T22:26:05.901 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=hankqd-47 2021-09-15T22:26:08.311 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:08.312 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:08.312 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-46 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:08.351 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:08.351 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:08.544 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000011.60.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:26:08.545 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-46 2021-09-15T22:26:08.545 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:08.546 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:08.546 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-46 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:08.590 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:08.591 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:08.817 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000011.60.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:26:08.818 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-46 2021-09-15T22:26:08.818 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:08.819 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:08.820 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-46 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:08.855 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:08.855 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:09.065 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000011.60.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:26:09.066 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-46 2021-09-15T22:26:09.066 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:09.067 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:09.067 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-46 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:09.112 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:09.112 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:09.329 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000011.60.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:26:09.330 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-46 2021-09-15T22:26:09.330 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:09.331 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:09.331 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-46 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:09.370 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:09.371 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:09.575 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.72.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:26:09.576 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-46 2021-09-15T22:26:09.577 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:09.577 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:09.578 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-46 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:09.622 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:09.623 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:09.832 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"MULTIPART","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.72.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:26:09.833 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-46 2021-09-15T22:26:09.833 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-46 zones={test-zone2, test-zone1} 2021-09-15T22:26:09.842 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:26:09.887 DEBUG:tasks.rgw_multi.zone_rados:o=MULTIPART 2021-09-15T22:26:09.887 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:26:09.893 DEBUG:tasks.rgw_multi.zone_rados:o=MULTIPART 2021-09-15T22:26:09.943 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2021-09-15T22:26:10.156 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2021-09-15T22:26:10.437 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2021-09-15T22:26:10.692 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-46 zones={test-zone2, test-zone1} 2021-09-15T22:26:10.693 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multipart_object_sync ... ok 2021-09-15T22:26:10.693 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-48 2021-09-15T22:26:10.807 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:10.808 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:10.808 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:10.813 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:26:10.811+0000 7f5300ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:10.813 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:26:10.811+0000 7f5303fff700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:10.814 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:26:10.811+0000 7fda77fff700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:10.814 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:26:10.811+0000 7fda5c7f0700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:10.815 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:26:10.811+0000 7fda60ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:10.815 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:26:10.811+0000 7fda60ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:10.816 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:26:10.815+0000 7f52f9feb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:10.816 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:26:10.815+0000 7f52f9feb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:10.847 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:10.848 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:11.004 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:11.032 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744770.704785_170.1","last_update":"2021-09-15T22:26:10.704785Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:11.033 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:11.034 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:11.034 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:11.035 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:11.072 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:11.073 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:11.295 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744770.704785_170.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:10.704785Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:11.296 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:11.296 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:11.297 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:11.297 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:11.298 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:11.378 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:11.379 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:11.576 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744770.704785_170.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:10.704785Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:11.576 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:11.577 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-48', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:11.577 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-48', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:11.578 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-48 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:11.620 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:11.620 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:11.817 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.136.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.47.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:26:11.818 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-48 2021-09-15T22:26:11.818 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-48', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:11.819 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-48', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:11.819 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-48 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:11.862 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:11.862 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:12.092 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"testobj-sse-c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.136.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"testobj-sse-kms","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.47.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:26:12.093 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-48 2021-09-15T22:26:12.195 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_encrypted_object_sync ... ok 2021-09-15T22:26:12.195 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-49 2021-09-15T22:26:12.415 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:12.415 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:12.416 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:12.459 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:12.459 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:12.607 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:12.640 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744772.207273_174.1","last_update":"2021-09-15T22:26:12.207273Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:12.640 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:12.641 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:12.641 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:12.642 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:12.674 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:12.675 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:12.900 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744772.207273_174.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:12.207273Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:12.901 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:12.901 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:12.902 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:12.902 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:12.903 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:12.980 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:12.980 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:13.179 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744772.207273_174.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:12.207273Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:13.179 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:13.180 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:13.180 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:13.181 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:13.221 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:13.222 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:13.419 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.26.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.42.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.24.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.28.5"}]} 2021-09-15T22:26:13.419 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-49 2021-09-15T22:26:13.420 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:13.420 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:13.421 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-49 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:13.463 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:13.463 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:13.685 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"a","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.26.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.42.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.24.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"b","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.28.5"}}}] 2021-09-15T22:26:13.685 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-49 2021-09-15T22:26:13.686 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:13.686 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:13.687 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:13.725 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:13.725 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:13.929 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.26.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.42.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.24.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.28.5"}]} 2021-09-15T22:26:13.929 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-49 2021-09-15T22:26:13.930 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:13.930 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:13.931 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-49 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:13.976 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:13.976 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:14.189 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.26.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.42.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.24.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.28.5"}}}] 2021-09-15T22:26:14.190 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-49 2021-09-15T22:26:14.190 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:14.191 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:14.191 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-49 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:14.229 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:14.229 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:14.442 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.35.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.50.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.27.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.36.5"}]} 2021-09-15T22:26:14.442 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-49 2021-09-15T22:26:14.443 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:14.443 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:14.444 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:14.485 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:14.486 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:14.693 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"a","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.35.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.50.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.27.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"b","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.36.5"}}}] 2021-09-15T22:26:14.694 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-49 2021-09-15T22:26:14.694 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-49 zones={test-zone2, test-zone1} 2021-09-15T22:26:14.703 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:26:14.751 DEBUG:tasks.rgw_multi.zone_rados:o=a 2021-09-15T22:26:14.752 DEBUG:tasks.rgw_multi.zone_rados:o=b 2021-09-15T22:26:14.752 DEBUG:tasks.rgw_multi.zone_rados:o=c 2021-09-15T22:26:14.753 DEBUG:tasks.rgw_multi.zone_rados:o=d 2021-09-15T22:26:14.753 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:26:14.759 DEBUG:tasks.rgw_multi.zone_rados:o=a 2021-09-15T22:26:14.759 DEBUG:tasks.rgw_multi.zone_rados:o=b 2021-09-15T22:26:14.760 DEBUG:tasks.rgw_multi.zone_rados:o=c 2021-09-15T22:26:14.760 DEBUG:tasks.rgw_multi.zone_rados:o=d 2021-09-15T22:26:14.813 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-09-15T22:26:14.867 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-09-15T22:26:14.973 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-09-15T22:26:15.076 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-09-15T22:26:15.132 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-09-15T22:26:15.238 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-09-15T22:26:15.340 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-09-15T22:26:15.394 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-09-15T22:26:15.496 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-09-15T22:26:15.596 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-09-15T22:26:15.650 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-09-15T22:26:15.753 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-09-15T22:26:15.851 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-49 zones={test-zone2, test-zone1} 2021-09-15T22:26:15.852 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:26:15.852 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:26:15.853 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 0 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:26:15.888 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:15.889 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:16.093 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=hankqd-50 2021-09-15T22:26:16.215 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:26:16.211+0000 7fda5dff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:16.216 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:26:16.215+0000 7f53007f8700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:16.216 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:26:16.215+0000 7f5302ffd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:16.217 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:26:16.215+0000 7fda697fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:16.217 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:26:16.215+0000 7fda69ffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:16.218 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:26:16.215+0000 7f52fa7ec700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:16.218 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:26:16.215+0000 7f52fdff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:16.219 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:26:16.215+0000 7fda68ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:16.307 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:16.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:16.308 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:16.346 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:16.346 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:16.497 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:16.524 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744776.101529_178.1","last_update":"2021-09-15T22:26:16.101529Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:16.524 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:16.525 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:16.525 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:16.526 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:16.565 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:16.565 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:16.779 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744776.101529_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:16.101529Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:16.779 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:16.780 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:16.780 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:16.781 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:16.781 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:16.821 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:16.822 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:17.015 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744776.101529_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:16.101529Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:17.016 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:17.016 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:17.017 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:17.017 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-50 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:17.058 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:17.058 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:17.265 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.53.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.35.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.52.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.25.5"}]} 2021-09-15T22:26:17.265 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-50 2021-09-15T22:26:17.266 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:17.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:17.267 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-50 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:17.311 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:17.311 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:17.527 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"a","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.53.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.35.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.52.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"b","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.25.5"}}}] 2021-09-15T22:26:17.527 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=hankqd-50 2021-09-15T22:26:17.528 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:17.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:17.529 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-50 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:17.569 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:17.570 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:17.762 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.53.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.35.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.52.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.25.5"}]} 2021-09-15T22:26:17.763 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-50 2021-09-15T22:26:17.763 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:17.764 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:17.764 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-50 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:17.807 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:17.808 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:18.020 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.53.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.35.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.52.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.25.5"}}}] 2021-09-15T22:26:18.020 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-50 2021-09-15T22:26:18.021 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:18.021 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:18.022 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-50 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:18.105 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:18.105 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:18.315 INFO:teuthology.orchestra.run.smithi184.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.85.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.40.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.55.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.47.5"}]} 2021-09-15T22:26:18.315 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-50 2021-09-15T22:26:18.316 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:18.316 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'hankqd-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:18.317 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket hankqd-50 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:18.362 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:18.362 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:18.581 INFO:teuthology.orchestra.run.smithi180.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"a","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.85.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.40.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.55.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"b","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.47.5"}}}] 2021-09-15T22:26:18.582 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=hankqd-50 2021-09-15T22:26:18.582 INFO:tasks.rgw_multi.zone_rados:comparing bucket=hankqd-50 zones={test-zone2, test-zone1} 2021-09-15T22:26:18.592 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-09-15T22:26:18.596 DEBUG:tasks.rgw_multi.zone_rados:o=a 2021-09-15T22:26:18.596 DEBUG:tasks.rgw_multi.zone_rados:o=b 2021-09-15T22:26:18.597 DEBUG:tasks.rgw_multi.zone_rados:o=c 2021-09-15T22:26:18.597 DEBUG:tasks.rgw_multi.zone_rados:o=d 2021-09-15T22:26:18.598 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-09-15T22:26:18.602 DEBUG:tasks.rgw_multi.zone_rados:o=a 2021-09-15T22:26:18.602 DEBUG:tasks.rgw_multi.zone_rados:o=b 2021-09-15T22:26:18.603 DEBUG:tasks.rgw_multi.zone_rados:o=c 2021-09-15T22:26:18.603 DEBUG:tasks.rgw_multi.zone_rados:o=d 2021-09-15T22:26:18.655 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-09-15T22:26:18.708 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-09-15T22:26:18.813 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-09-15T22:26:18.912 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-09-15T22:26:18.968 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-09-15T22:26:19.077 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-09-15T22:26:19.180 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-09-15T22:26:19.235 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-09-15T22:26:19.338 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-09-15T22:26:19.437 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-09-15T22:26:19.490 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-09-15T22:26:19.594 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-09-15T22:26:19.692 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=hankqd-50 zones={test-zone2, test-zone1} 2021-09-15T22:26:19.693 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '1', '--rgw-sync-log-trim-min-cold-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:26:19.693 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '1', '--rgw-sync-log-trim-min-cold-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:26:19.694 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 1 --rgw-sync-log-trim-min-cold-buckets 0 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:26:19.728 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:19.728 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:19.943 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'hankqd-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:19.944 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'hankqd-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:19.944 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket hankqd-50 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:20.020 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:20.021 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:20.225 INFO:teuthology.orchestra.run.smithi180.stdout:[] 2021-09-15T22:26:20.225 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'hankqd-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:20.226 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'hankqd-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:20.226 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket hankqd-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:20.263 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:20.264 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:20.471 INFO:teuthology.orchestra.run.smithi180.stdout:[{"op_id":"1#00000000001.26.5","op_tag":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4934.1976","op":"write","object":"a","instance":"","state":"complete","index_ver":1,"timestamp":"2021-09-15T22:26:12.214442514Z","ver":{"pool":9,"epoch":4},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-49:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4936.14"}]},{"op_id":"5#00000000001.42.5","op_tag":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4934.1989","op":"write","object":"d","instance":"","state":"complete","index_ver":1,"timestamp":"2021-09-15T22:26:12.360081468Z","ver":{"pool":9,"epoch":2},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-49:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4936.14"}]},{"op_id":"8#00000000001.24.5","op_tag":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4934.1987","op":"write","object":"c","instance":"","state":"complete","index_ver":1,"timestamp":"2021-09-15T22:26:12.312396848Z","ver":{"pool":9,"epoch":2},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-49:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4936.14"}]},{"op_id":"10#00000000001.28.5","op_tag":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4934.1984","op":"write","object":"b","instance":"","state":"complete","index_ver":1,"timestamp":"2021-09-15T22:26:12.264039172Z","ver":{"pool":9,"epoch":8},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"4de7baf2-0fdf-417b-9ffb-8497dcfb5977:hankqd-49:4de7baf2-0fdf-417b-9ffb-8497dcfb5977.4936.14"}]}] 2021-09-15T22:26:20.471 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '999', '--rgw-sync-log-trim-min-cold-buckets', '999', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:26:20.472 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '999', '--rgw-sync-log-trim-min-cold-buckets', '999', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-09-15T22:26:20.473 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 999 --rgw-sync-log-trim-min-cold-buckets 999 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-09-15T22:26:20.552 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:20.553 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:21.271 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'hankqd-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:21.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'hankqd-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:21.439 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket hankqd-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:21.478 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:21.478 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:21.672 INFO:teuthology.orchestra.run.smithi180.stdout:[] 2021-09-15T22:26:21.672 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_index_log_trim ... ok 2021-09-15T22:26:21.683 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_creation_time ... ok 2021-09-15T22:26:21.684 INFO:tasks.rgw_multisite_tests:log information for manual testing ... ok 2021-09-15T22:26:21.685 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:21.686 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:21.687 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:21.749 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:21.750 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:21.924 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:21.953 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744776.101529_178.1","last_update":"2021-09-15T22:26:16.101529Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:21.954 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:21.954 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:21.955 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:21.955 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:21.995 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:21.996 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:22.196 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744776.101529_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:16.101529Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:22.197 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:22.198 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:22.198 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:22.199 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:22.199 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:22.239 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:22.239 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:22.434 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744776.101529_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:16.101529Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:22.435 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:22.435 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:22.436 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:22.436 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:22.476 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:22.476 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:22.641 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:22.664 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744776.101529_178.1","last_update":"2021-09-15T22:26:16.101529Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:22.665 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:22.665 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:22.666 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:22.666 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:22.706 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:22.707 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:22.896 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744776.101529_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:16.101529Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:22.897 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:22.923 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:22.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:22.924 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:22.958 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:22.958 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:23.127 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:23.158 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744782.906858_182.1","last_update":"2021-09-15T22:26:22.906858Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:23.158 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:23.159 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:23.159 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:23.160 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:23.199 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:23.199 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:23.400 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744782.906858_182.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:22.906858Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:23.401 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:23.570 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:23.571 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:23.572 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:23.611 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:23.611 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:23.765 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:23.796 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744782.906858_182.1","last_update":"2021-09-15T22:26:22.906858Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:23.797 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:23.798 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:23.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:23.800 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:23.839 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:23.840 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:24.037 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744782.906858_182.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:22.906858Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:24.037 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:24.108 INFO:tasks.rgw_multisite_tests:test low level implementation of s3 notifications ... ok 2021-09-15T22:26:24.109 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:24.110 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:24.111 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:24.149 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:24.149 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:24.319 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:24.347 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744784.090976_184.1","last_update":"2021-09-15T22:26:24.090976Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:24.348 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:24.348 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:24.349 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:24.350 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:24.393 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:24.394 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:24.580 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744784.090976_184.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:24.090976Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:24.580 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:24.581 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:24.581 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:24.582 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:24.582 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:24.660 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:24.660 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:24.847 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744784.090976_184.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:24.090976Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:24.847 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:24.848 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:24.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:24.849 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:24.888 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:24.888 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:25.056 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:25.088 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744784.090976_184.1","last_update":"2021-09-15T22:26:24.090976Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:25.088 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:25.089 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:25.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:25.090 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:25.129 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:25.129 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:25.318 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744784.090976_184.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:24.090976Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:25.319 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:25.347 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:25.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:25.348 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:25.382 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:25.382 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:25.547 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:25.578 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744785.330595_188.1","last_update":"2021-09-15T22:26:25.330595Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:25.578 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:25.579 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:25.579 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:25.580 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:25.620 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:25.621 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:25.814 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744785.330595_188.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:25.330595Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:25.815 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:25.853 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:25.854 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:25.854 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:25.893 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:25.893 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:26.058 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:26.088 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744785.330595_188.1","last_update":"2021-09-15T22:26:25.330595Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:26.089 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:26.089 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:26.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:26.090 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:26.130 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:26.130 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:26.316 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744785.330595_188.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:25.330595Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:26.317 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:26.735 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-52', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:26.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-52', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:26.736 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-52 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:26.772 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:26.772 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:26.955 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.56.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.112.5"},{"key":4,"val":"00000000001.64.5"},{"key":5,"val":"00000000001.63.5"},{"key":6,"val":""},{"key":7,"val":"00000000001.58.5"},{"key":8,"val":"00000000001.45.5"},{"key":9,"val":"00000000001.167.5"},{"key":10,"val":"00000000002.53.5"}]} 2021-09-15T22:26:26.956 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-52 2021-09-15T22:26:26.957 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-52', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:26.957 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-52', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:26.958 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-52 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:27.001 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:27.002 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:27.207 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.56.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.112.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.64.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.63.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.58.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.45.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.167.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.53.5"}}}] 2021-09-15T22:26:27.207 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-52 2021-09-15T22:26:27.221 WARNING:rgw_multi.tests_ps:superfluous records are found 2021-09-15T22:26:27.390 INFO:tasks.rgw_multisite_tests:test s3 records fetching ... ok 2021-09-15T22:26:27.391 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:27.391 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:27.392 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:27.429 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:27.429 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:27.587 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:27.617 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744787.372472_190.1","last_update":"2021-09-15T22:26:27.372472Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:27.617 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:27.618 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:27.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:27.619 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:27.662 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:27.663 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:27.862 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744787.372472_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:27.372472Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:27.863 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:27.863 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:27.864 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:27.864 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:27.865 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:27.940 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:27.940 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:28.141 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744787.372472_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:27.372472Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:28.141 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:28.142 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:28.142 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:28.143 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:28.182 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:28.182 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:28.349 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:28.379 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744787.372472_190.1","last_update":"2021-09-15T22:26:27.372472Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:28.379 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:28.380 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:28.381 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:28.381 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:28.423 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:28.423 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:28.609 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744787.372472_190.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:27.372472Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:28.610 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:28.635 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:28.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:28.636 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:28.671 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:28.671 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:28.833 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:28.864 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744788.618982_194.1","last_update":"2021-09-15T22:26:28.618982Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:28.865 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:28.865 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:28.866 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:28.866 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:28.904 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:28.905 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:29.102 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744788.618982_194.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:28.618982Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:29.103 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:29.165 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:29.166 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:29.166 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:29.206 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:29.207 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:29.374 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:29.404 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744788.618982_194.1","last_update":"2021-09-15T22:26:28.618982Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:29.405 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:29.406 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:29.406 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:29.407 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:29.445 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:29.445 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:29.643 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744788.618982_194.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:28.618982Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:29.644 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:29.718 INFO:tasks.rgw_multisite_tests:test s3 notification set/get/delete ... ok 2021-09-15T22:26:29.718 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:29.719 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:29.719 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:29.755 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:29.756 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:29.928 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:29.959 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744789.699423_196.1","last_update":"2021-09-15T22:26:29.699423Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:29.960 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:29.960 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:29.961 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:29.961 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:30.000 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:30.001 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:30.202 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744789.699423_196.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:29.699423Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:30.203 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:30.203 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:30.204 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:30.204 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:30.205 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:30.281 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:30.282 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:30.472 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744789.699423_196.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:29.699423Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:30.472 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:30.473 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:30.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:30.474 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:30.512 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:30.512 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:30.672 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:30.699 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744789.699423_196.1","last_update":"2021-09-15T22:26:29.699423Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:30.700 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:30.700 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:30.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:30.701 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:30.740 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:30.740 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:30.936 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744789.699423_196.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:29.699423Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:30.937 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:31.117 INFO:tasks.rgw_multisite_tests:test s3 topics set/get/delete on master ... ok 2021-09-15T22:26:31.118 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:31.119 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:31.120 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:31.157 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:31.158 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:31.330 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:31.361 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744789.699423_196.1","last_update":"2021-09-15T22:26:29.699423Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:31.362 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:31.363 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:31.363 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:31.364 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:31.405 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:31.406 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:31.614 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744789.699423_196.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:29.699423Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:31.615 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:31.615 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:31.616 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:31.616 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:31.617 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:31.652 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:31.652 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:31.846 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744789.699423_196.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:29.699423Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:31.847 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:31.847 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:31.848 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:31.848 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:31.890 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:31.890 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:32.065 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:32.096 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744789.699423_196.1","last_update":"2021-09-15T22:26:29.699423Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:32.097 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:32.097 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:32.098 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:32.098 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:32.138 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:32.138 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:32.337 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744789.699423_196.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:29.699423Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:32.337 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:32.338 INFO:tasks.rgw_multisite_tests:test s3 topics with secret set/get/delete on master ... ok 2021-09-15T22:26:32.339 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:32.339 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:32.340 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:32.378 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:32.378 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:32.554 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:32.582 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744789.699423_196.1","last_update":"2021-09-15T22:26:29.699423Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:32.582 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:32.583 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:32.583 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:32.584 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:32.626 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:32.627 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:32.818 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744789.699423_196.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:29.699423Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:32.819 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:32.819 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:32.820 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:32.820 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:32.821 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:32.858 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:32.858 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:33.053 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744789.699423_196.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:29.699423Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:33.054 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:33.055 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:33.055 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:33.056 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:33.094 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:33.094 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:33.274 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:33.306 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744789.699423_196.1","last_update":"2021-09-15T22:26:29.699423Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:33.307 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:33.307 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:33.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:33.308 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:33.347 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:33.347 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:33.533 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744789.699423_196.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:29.699423Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:33.534 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:33.785 INFO:tasks.rgw_multisite_tests:test s3 notification set/get/delete on master ... ok 2021-09-15T22:26:33.786 INFO:tasks.rgw_multisite_tests:rgw_multi.tests_ps.test_ps_s3_notification_filter_on_master ... ok 2021-09-15T22:26:33.786 INFO:tasks.rgw_multisite_tests:rgw_multi.tests_ps.test_ps_s3_notification_filter ... ok 2021-09-15T22:26:33.787 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:33.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:33.788 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:33.825 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:33.825 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:33.993 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:34.024 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744793.767425_202.1","last_update":"2021-09-15T22:26:33.767425Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:34.024 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:34.025 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:34.026 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:34.026 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:34.066 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:34.066 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:34.274 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744793.767425_202.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:33.767425Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:34.275 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:34.275 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:34.276 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:34.276 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:34.277 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:34.355 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:34.355 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:34.539 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744793.767425_202.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:33.767425Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:34.540 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:34.541 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:34.541 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:34.542 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:34.583 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:34.583 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:34.743 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:34.771 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744793.767425_202.1","last_update":"2021-09-15T22:26:33.767425Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:34.772 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:34.772 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:34.773 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:34.773 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:34.812 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:34.812 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:35.009 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744793.767425_202.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:33.767425Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:35.009 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:35.190 INFO:tasks.rgw_multisite_tests:test s3 notification set/get/delete on master ... ok 2021-09-15T22:26:35.191 INFO:tasks.rgw_multisite_tests:rgw_multi.tests_ps.test_objcet_timing ... ok 2021-09-15T22:26:35.192 INFO:tasks.rgw_multisite_tests:test pushing amqp s3 notification on master ... ok 2021-09-15T22:26:35.192 INFO:tasks.rgw_multisite_tests:test pushing kafka s3 notification on master ... ok 2021-09-15T22:26:35.193 INFO:tasks.rgw_multisite_tests:test pushing kafka s3 notification on master ... ok 2021-09-15T22:26:35.193 INFO:tasks.rgw_multisite_tests:rgw_multi.tests_ps.test_ps_s3_notification_push_kafka_security_ssl ... ok 2021-09-15T22:26:35.194 INFO:tasks.rgw_multisite_tests:rgw_multi.tests_ps.test_ps_s3_notification_push_kafka_security_ssl_sasl ... ok 2021-09-15T22:26:35.195 INFO:tasks.rgw_multisite_tests:test deletion of multiple keys on master ... ok 2021-09-15T22:26:35.195 INFO:tasks.rgw_multisite_tests:test pushing http s3 notification on master ... ok 2021-09-15T22:26:35.196 INFO:tasks.rgw_multisite_tests:test that opaque id set in topic, is sent in notification ... ok 2021-09-15T22:26:35.196 INFO:tasks.rgw_multisite_tests:test that opaque id set in topic, is sent in notification on master ... ok 2021-09-15T22:26:35.197 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:35.197 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:35.198 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:35.236 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:35.236 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:35.403 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:35.436 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744795.172609_208.1","last_update":"2021-09-15T22:26:35.172609Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:35.436 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:35.437 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:35.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:35.438 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:35.477 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:35.477 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:35.668 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744795.172609_208.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:35.172609Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:35.668 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:35.669 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:35.669 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:35.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:35.670 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:35.708 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:35.708 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:35.902 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744795.172609_208.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:35.172609Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:35.903 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:35.904 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:35.904 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:35.905 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:35.941 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:35.942 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:36.113 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:36.143 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744795.172609_208.1","last_update":"2021-09-15T22:26:35.172609Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:36.143 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:36.144 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:36.144 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:36.145 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:36.184 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:36.185 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:36.383 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744795.172609_208.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:35.172609Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:36.383 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:36.398 INFO:tasks.rgw_multisite_tests:test set/get/delete of topic ... ok 2021-09-15T22:26:36.399 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:36.400 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:36.400 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:36.438 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:36.439 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:36.604 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:36.635 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744795.172609_208.1","last_update":"2021-09-15T22:26:35.172609Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:36.636 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:36.637 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:36.637 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:36.638 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:36.675 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:36.676 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:36.879 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744795.172609_208.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:35.172609Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:36.879 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:36.880 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:36.880 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:36.881 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:36.881 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:36.917 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:36.917 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:37.102 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744795.172609_208.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:35.172609Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:37.102 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:37.103 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:37.103 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:37.104 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:37.143 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:37.143 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:37.312 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:37.344 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744795.172609_208.1","last_update":"2021-09-15T22:26:35.172609Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:37.344 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:37.345 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:37.345 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:37.346 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:37.386 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:37.386 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:37.574 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744795.172609_208.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:35.172609Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:37.575 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:37.590 INFO:tasks.rgw_multisite_tests:test set topic with endpoint ... ok 2021-09-15T22:26:37.590 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:37.591 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:37.591 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:37.630 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:37.631 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:37.797 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:37.828 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744795.172609_208.1","last_update":"2021-09-15T22:26:35.172609Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:37.828 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:37.829 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:37.829 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:37.830 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:37.868 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:37.868 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:38.067 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744795.172609_208.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:35.172609Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:38.067 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:38.068 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:38.068 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:38.069 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:38.069 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:38.109 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:38.110 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:38.306 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744795.172609_208.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:35.172609Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:38.307 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:38.308 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:38.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:38.309 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:38.350 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:38.350 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:38.519 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:38.550 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744795.172609_208.1","last_update":"2021-09-15T22:26:35.172609Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:38.551 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:38.551 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:38.552 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:38.553 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:38.588 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:38.588 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:38.780 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744795.172609_208.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:35.172609Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:38.781 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:38.813 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:38.814 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:38.814 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:38.847 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:38.848 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:39.024 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:39.055 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744798.797122_212.1","last_update":"2021-09-15T22:26:38.797122Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:39.056 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:39.056 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:39.057 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:39.057 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:39.096 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:39.097 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:39.294 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744798.797122_212.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:38.797122Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:39.295 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:39.349 INFO:tasks.rgw_multisite_tests:test set/get/delete of notification ... ok 2021-09-15T22:26:39.350 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:39.350 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:39.351 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:39.388 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:39.388 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:39.556 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:39.589 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744799.331277_214.1","last_update":"2021-09-15T22:26:39.331277Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:39.589 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:39.590 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:39.590 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:39.591 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:39.629 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:39.630 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:39.839 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744799.331277_214.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:39.331277Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:39.840 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:39.841 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:39.841 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:39.842 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:39.842 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:39.877 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:39.877 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:40.063 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744799.331277_214.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:39.331277Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:40.063 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:40.064 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:40.065 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:40.065 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:40.104 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:40.105 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:40.284 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:40.316 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744799.331277_214.1","last_update":"2021-09-15T22:26:39.331277Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:40.316 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:40.317 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:40.317 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:40.318 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:40.356 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:40.356 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:40.545 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744799.331277_214.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:39.331277Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:40.545 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:40.579 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:40.579 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:40.580 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:40.614 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:40.614 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:40.784 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:40.817 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744800.561772_218.1","last_update":"2021-09-15T22:26:40.561772Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:40.818 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:40.818 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:40.819 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:40.819 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:40.859 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:40.859 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:41.056 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744800.561772_218.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:40.561772Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:41.057 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:41.105 INFO:tasks.rgw_multisite_tests:test set/get/delete of notification on specific events ... ok 2021-09-15T22:26:41.106 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:41.107 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:41.107 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:41.145 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:41.146 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:41.323 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:41.355 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744801.087586_220.1","last_update":"2021-09-15T22:26:41.087586Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:41.355 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:41.356 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:41.356 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:41.356 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:41.397 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:41.397 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:41.603 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744801.087586_220.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:41.087586Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:41.604 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:41.605 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:41.605 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:41.605 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:41.606 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:41.685 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:41.685 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:41.881 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744801.087586_220.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:41.087586Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:41.882 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:41.882 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:41.883 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:41.883 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:41.921 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:41.921 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:42.101 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:42.133 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744801.087586_220.1","last_update":"2021-09-15T22:26:41.087586Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:42.134 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:42.134 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:42.135 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:42.135 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:42.175 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:42.175 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:42.372 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744801.087586_220.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:41.087586Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:42.373 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:42.407 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:42.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:42.409 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:42.443 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:42.443 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:42.607 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:42.638 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744802.390541_224.1","last_update":"2021-09-15T22:26:42.390541Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:42.638 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:42.639 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:42.639 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:42.640 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:42.677 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:42.677 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:42.870 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744802.390541_224.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:42.390541Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:42.871 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:43.307 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-61', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:43.307 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-61', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:43.308 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-61 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:43.344 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:43.344 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:43.518 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.69.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.175.5"},{"key":4,"val":"00000000001.53.5"},{"key":5,"val":"00000000001.74.5"},{"key":6,"val":""},{"key":7,"val":"00000000001.49.5"},{"key":8,"val":"00000000001.76.5"},{"key":9,"val":"00000000001.72.5"},{"key":10,"val":"00000000002.55.5"}]} 2021-09-15T22:26:43.519 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-61 2021-09-15T22:26:43.519 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-61', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:43.520 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-61', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:43.521 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-61 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:43.565 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:43.566 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:43.769 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.69.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.175.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.53.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.74.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.49.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.76.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.72.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.55.5"}}}] 2021-09-15T22:26:43.770 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-61 2021-09-15T22:26:43.848 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-61', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:43.848 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-61', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:43.849 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-61 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:43.881 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:43.881 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:44.078 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000004.73.5"},{"key":2,"val":""},{"key":3,"val":"00000000002.177.5"},{"key":4,"val":"00000000002.55.5"},{"key":5,"val":"00000000002.80.5"},{"key":6,"val":""},{"key":7,"val":"00000000002.51.5"},{"key":8,"val":"00000000002.82.5"},{"key":9,"val":"00000000002.78.5"},{"key":10,"val":"00000000004.59.5"}]} 2021-09-15T22:26:44.078 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-61 2021-09-15T22:26:44.079 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-61', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:44.079 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-61', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:44.079 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-61 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:44.126 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:44.126 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:44.328 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.73.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.177.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.55.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.80.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.82.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.78.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.59.5"}}}] 2021-09-15T22:26:44.329 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-61 2021-09-15T22:26:44.387 INFO:tasks.rgw_multisite_tests:test set/get/delete of subscription ... ok 2021-09-15T22:26:44.388 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:44.388 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:44.389 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:44.425 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:44.425 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:44.585 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:44.616 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744804.369348_226.1","last_update":"2021-09-15T22:26:44.369348Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:44.617 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:44.617 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:44.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:44.619 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:44.659 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:44.659 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:44.879 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744804.369348_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:44.369348Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:44.880 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:44.881 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:44.881 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:44.882 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:44.882 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:44.960 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:44.960 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:45.159 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744804.369348_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:44.369348Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:45.160 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:45.160 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:45.161 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:45.162 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:45.202 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:45.202 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:45.381 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:45.414 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744804.369348_226.1","last_update":"2021-09-15T22:26:44.369348Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:45.414 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:45.415 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:45.415 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:45.416 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:45.455 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:45.456 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:45.673 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744804.369348_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:44.369348Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:45.674 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:45.830 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:26:45.826+0000 7f52fa7ec700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:45.831 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:26:45.826+0000 7fda757fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:45.831 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:26:45.826+0000 7fda77fff700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:45.832 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:26:45.826+0000 7f52fb7ee700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:45.832 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:26:45.826+0000 7f52fbfef700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:45.833 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:26:45.826+0000 7fda76ffd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:45.834 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:26:45.830+0000 7f52fdff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:45.834 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:26:45.830+0000 7fda68ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:45.834 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:26:45.830+0000 7fda75ffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:45.835 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:26:45.830+0000 7f52fd7f2700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:45.835 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:26:45.830+0000 7f52fdff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:45.836 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:26:45.834+0000 7fda63fff700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-09-15T22:26:46.147 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:46.148 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:46.148 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:46.191 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:46.191 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:46.381 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000003.77.3"},{"key":2,"val":""},{"key":3,"val":"00000000001.52.5"},{"key":4,"val":"00000000001.41.5"},{"key":5,"val":"00000000001.73.5"},{"key":6,"val":""},{"key":7,"val":"00000000001.35.5"},{"key":8,"val":"00000000001.85.5"},{"key":9,"val":"00000000001.118.5"},{"key":10,"val":"00000000002.43.5"}]} 2021-09-15T22:26:46.381 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-62 2021-09-15T22:26:46.382 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:46.382 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:46.383 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:46.429 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:46.429 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:46.647 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.77.3"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.52.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.41.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.73.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.35.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.85.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.118.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.5"}}}] 2021-09-15T22:26:46.648 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-62 2021-09-15T22:26:47.071 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:47.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:47.072 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:47.104 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:47.104 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:47.295 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000001.69.5"},{"key":1,"val":"00000000004.79.5"},{"key":2,"val":""},{"key":3,"val":"00000000002.54.5"},{"key":4,"val":"00000000001.41.5"},{"key":5,"val":"00000000003.77.5"},{"key":6,"val":""},{"key":7,"val":"00000000003.39.5"},{"key":8,"val":"00000000002.87.5"},{"key":9,"val":"00000000002.120.5"},{"key":10,"val":"00000000003.45.5"}]} 2021-09-15T22:26:47.296 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-62 2021-09-15T22:26:47.296 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:47.297 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:47.297 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:47.342 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:47.342 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:47.572 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.69.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.79.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.54.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.41.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.77.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.39.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.87.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.120.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.45.5"}}}] 2021-09-15T22:26:47.573 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-62 2021-09-15T22:26:47.756 INFO:tasks.rgw_multisite_tests:test that events are only sent on incremental sync ... ok 2021-09-15T22:26:47.757 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:47.758 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:47.758 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:47.794 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:47.794 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:47.962 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:47.997 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744807.737571_238.1","last_update":"2021-09-15T22:26:47.737571Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:47.997 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:47.998 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:47.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:47.999 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:48.041 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:48.041 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:48.242 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744807.737571_238.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:47.737571Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:48.242 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:48.243 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:48.243 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:48.244 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:48.244 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:48.282 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:48.282 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:48.471 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744807.737571_238.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:47.737571Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:48.471 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:48.472 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:48.472 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:48.473 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:48.510 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:48.510 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:48.685 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:48.717 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744807.737571_238.1","last_update":"2021-09-15T22:26:47.737571Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:48.718 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:48.718 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:48.719 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:48.719 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:48.759 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:48.759 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:48.971 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744807.737571_238.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:47.737571Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:48.971 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:49.017 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:49.018 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:49.018 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:49.055 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:49.055 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:49.232 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:49.263 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744808.999791_245.1","last_update":"2021-09-15T22:26:48.999791Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:49.264 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:49.264 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:49.265 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:49.265 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:49.304 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:49.304 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:49.529 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744808.999791_245.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:48.999791Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:49.529 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:49.530 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:49.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:49.531 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-63 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:49.571 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:49.571 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:49.787 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-09-15T22:26:49.787 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-63 2021-09-15T22:26:49.788 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:49.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:49.789 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-63 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:49.832 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:49.832 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:50.056 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:26:50.057 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-63 2021-09-15T22:26:50.515 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:50.515 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:50.516 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-63 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:50.556 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:50.556 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:50.734 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.129.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.32.5"},{"key":4,"val":"00000000001.74.5"},{"key":5,"val":"00000000001.88.5"},{"key":6,"val":""},{"key":7,"val":"00000000001.68.5"},{"key":8,"val":"00000000001.70.5"},{"key":9,"val":"00000000001.53.5"},{"key":10,"val":"00000000002.54.5"}]} 2021-09-15T22:26:50.735 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-63 2021-09-15T22:26:50.735 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:50.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:50.736 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-63 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:50.778 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:50.779 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:51.000 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.129.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.32.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.74.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.88.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.68.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.70.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.53.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.54.5"}}}] 2021-09-15T22:26:51.000 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-63 2021-09-15T22:26:51.137 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:51.138 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:51.138 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-63 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:51.174 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:51.175 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:51.375 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000004.133.5"},{"key":2,"val":""},{"key":3,"val":"00000000002.34.5"},{"key":4,"val":"00000000002.76.5"},{"key":5,"val":"00000000002.90.5"},{"key":6,"val":""},{"key":7,"val":"00000000002.72.5"},{"key":8,"val":"00000000002.74.5"},{"key":9,"val":"00000000002.55.5"},{"key":10,"val":"00000000004.58.5"}]} 2021-09-15T22:26:51.375 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-63 2021-09-15T22:26:51.376 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:51.376 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:51.377 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-63 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:51.415 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:51.415 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:51.611 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.133.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.34.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.76.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.90.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.72.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.74.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.55.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.58.5"}}}] 2021-09-15T22:26:51.611 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-63 2021-09-15T22:26:51.719 INFO:tasks.rgw_multisite_tests:test subscriptions for different events ... ok 2021-09-15T22:26:51.720 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:51.721 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:51.721 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:51.757 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:51.758 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:51.937 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:51.969 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744811.700807_256.1","last_update":"2021-09-15T22:26:51.700807Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:51.970 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:51.970 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:51.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:51.971 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:52.011 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:52.064 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:52.220 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744811.700807_256.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:51.700807Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:52.221 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:52.221 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:52.222 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:52.222 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:52.223 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:52.261 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:52.261 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:52.457 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744811.700807_256.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:51.700807Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:52.457 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:52.458 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:52.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:52.459 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:52.498 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:52.499 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:52.669 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:52.699 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744811.700807_256.1","last_update":"2021-09-15T22:26:51.700807Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:52.700 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:52.701 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:52.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:52.702 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:52.740 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:52.740 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:52.946 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744811.700807_256.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:51.700807Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:52.947 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:52.979 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:52.979 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:52.980 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:53.014 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:53.015 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:53.185 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:53.216 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744812.962476_260.1","last_update":"2021-09-15T22:26:52.962476Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:53.217 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:53.217 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:53.218 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:53.218 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:53.256 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:53.256 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:53.457 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744812.962476_260.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:52.962476Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:53.458 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:57.867 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-64', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:57.868 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-64', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:57.868 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-64 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:57.902 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:57.902 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:58.083 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000010.79.5"},{"key":1,"val":"00000000010.199.5"},{"key":2,"val":"00000000009.109.5"},{"key":3,"val":"00000000010.91.5"},{"key":4,"val":"00000000007.109.5"},{"key":5,"val":"00000000007.110.5"},{"key":6,"val":"00000000008.90.5"},{"key":7,"val":"00000000010.94.5"},{"key":8,"val":"00000000010.108.5"},{"key":9,"val":"00000000010.112.5"},{"key":10,"val":"00000000010.107.5"}]} 2021-09-15T22:26:58.084 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-64 2021-09-15T22:26:58.084 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-64', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:58.085 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-64', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:58.085 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-64 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:58.130 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:58.130 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:58.340 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.79.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.199.5"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000009.109.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.91.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000007.109.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000007.110.5"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000008.90.5"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.94.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.108.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.112.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.107.5"}}}] 2021-09-15T22:26:58.341 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-64 2021-09-15T22:26:59.037 INFO:tasks.rgw_multisite_tests:test incremental fetching of events from a subscription ... ok 2021-09-15T22:26:59.038 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:59.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:59.039 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:59.081 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:59.082 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:59.238 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:26:59.269 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744819.018036_262.1","last_update":"2021-09-15T22:26:59.018036Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:26:59.270 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:26:59.270 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:59.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:59.272 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:59.308 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:59.308 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:59.516 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744819.018036_262.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:59.018036Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:59.517 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:26:59.518 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:26:59.518 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:59.519 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:59.519 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:59.602 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:59.603 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:26:59.802 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744819.018036_262.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:59.018036Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:26:59.803 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:26:59.804 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:59.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:26:59.805 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:26:59.841 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:26:59.842 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:00.016 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:27:00.052 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744819.018036_262.1","last_update":"2021-09-15T22:26:59.018036Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:27:00.053 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:27:00.053 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:00.054 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:00.054 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:00.093 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:00.093 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:00.284 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744819.018036_262.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:26:59.018036Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:27:00.285 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:27:00.320 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:00.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:00.321 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:00.357 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:00.358 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:00.531 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:27:00.553 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744820.302251_266.1","last_update":"2021-09-15T22:27:00.302251Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:27:00.554 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:27:00.555 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:00.555 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:00.556 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:00.595 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:00.596 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:00.792 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744820.302251_266.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:00.302251Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:27:00.793 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:27:01.223 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:01.223 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:01.224 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-65 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:01.276 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:01.276 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:01.456 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.138.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.69.5"},{"key":4,"val":"00000000001.64.5"},{"key":5,"val":"00000000001.84.5"},{"key":6,"val":""},{"key":7,"val":"00000000001.59.5"},{"key":8,"val":"00000000001.114.5"},{"key":9,"val":"00000000001.62.5"},{"key":10,"val":"00000000002.78.5"}]} 2021-09-15T22:27:01.457 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-65 2021-09-15T22:27:01.457 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:01.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:01.459 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:01.495 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:01.496 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:01.706 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.138.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.69.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.64.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.84.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.59.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.114.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.62.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.78.5"}}}] 2021-09-15T22:27:01.706 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-65 2021-09-15T22:27:01.868 INFO:tasks.rgw_multisite_tests:test acking of some events in a subscription ... ok 2021-09-15T22:27:01.869 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:01.869 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:01.870 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:01.905 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:01.905 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:02.072 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:27:02.094 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744821.851340_268.1","last_update":"2021-09-15T22:27:01.851340Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:27:02.094 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:27:02.095 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:02.095 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:02.096 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:02.135 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:02.135 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:02.339 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744821.851340_268.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:01.851340Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:27:02.339 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-09-15T22:27:02.340 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:27:02.340 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:02.341 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:02.342 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:02.419 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:02.419 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:02.593 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744821.851340_268.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:01.851340Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:27:02.594 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:27:02.595 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:02.595 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:02.596 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:02.636 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:02.636 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:02.802 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:27:02.835 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744821.851340_268.1","last_update":"2021-09-15T22:27:01.851340Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:27:02.836 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:27:02.837 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:02.837 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:02.838 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:02.877 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:02.878 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:03.079 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744821.851340_268.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:01.851340Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:27:03.079 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:27:03.112 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:03.113 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:03.113 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:03.149 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:03.149 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:03.324 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:27:03.357 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744823.095559_272.1","last_update":"2021-09-15T22:27:03.095559Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:27:03.358 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-09-15T22:27:03.358 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:03.359 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:03.359 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:03.399 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:03.399 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:03.603 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:27:03.603 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-09-15T22:27:03.895 INFO:tasks.rgw.c2.client.0.smithi184.stdout:*** Caught signal (Segmentation fault) ** 2021-09-15T22:27:03.895 INFO:tasks.rgw.c2.client.0.smithi184.stdout: in thread 7fda637fe700 thread_name:rados_async 2021-09-15T22:27:03.896 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-66', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:03.897 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'hankqd-66', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:03.897 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket hankqd-66 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:03.899 INFO:tasks.rgw.c2.client.0.smithi184.stdout: ceph version 15.2.14-69-g3bb6dfef (3bb6dfef60c759eba3da031acb0f1cd05ff3875f) octopus (stable) 2021-09-15T22:27:03.899 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 1: (()+0x46210) [0x7fda9af6a210] 2021-09-15T22:27:03.899 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 2: (rgw::putobj::ETagVerifier_MPU::process(ceph::buffer::v15_2_0::list&&, unsigned long)+0x44) [0x7fda9bbd39d4] 2021-09-15T22:27:03.899 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 3: (RGWRados::fetch_remote_obj(RGWObjectCtx&, rgw_user const&, req_info*, rgw_zone_id const&, rgw_obj const&, rgw_obj const&, RGWBucketInfo const&, RGWBucketInfo const*, std::optional, std::chrono::time_point > >*, std::chrono::time_point > >*, std::chrono::time_point > > const*, std::chrono::time_point > > const*, bool, char const*, char const*, RGWRados::AttrsMod, bool, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >&, RGWObjCategory, std::optional, std::chrono::time_point > >, std::__cxx11::basic_string, std::allocator >*, std::__cxx11::basic_string, std::allocator >*, void (*)(long, void*), void*, DoutPrefixProvider const*, RGWFetchObjFilter*, rgw_zone_set*, std::optional*)+0xf87) [0x7fda9ba0b067] 2021-09-15T22:27:03.900 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 4: (RGWAsyncFetchRemoteObj::_send_request()+0x4d6) [0x7fda9b938f06] 2021-09-15T22:27:03.900 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 5: (RGWAsyncRadosProcessor::handle_request(RGWAsyncRadosRequest*)+0x25) [0x7fda9b9330e5] 2021-09-15T22:27:03.900 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 6: (RGWAsyncRadosProcessor::RGWWQ::_process(RGWAsyncRadosRequest*, ThreadPool::TPHandle&)+0x11) [0x7fda9b93b3e1] 2021-09-15T22:27:03.900 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 7: (ThreadPool::worker(ThreadPool::WorkThread*)+0x5bb) [0x7fda9227dc1b] 2021-09-15T22:27:03.901 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 8: (ThreadPool::WorkThread::entry()+0x15) [0x7fda9227ece5] 2021-09-15T22:27:03.901 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 9: (()+0x9609) [0x7fda91dda609] 2021-09-15T22:27:03.901 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 10: (clone()+0x43) [0x7fda9b046293] 2021-09-15T22:27:03.901 INFO:tasks.rgw.c2.client.0.smithi184.stdout:2021-09-15T22:27:03.894+0000 7fda637fe700 -1 *** Caught signal (Segmentation fault) ** 2021-09-15T22:27:03.902 INFO:tasks.rgw.c2.client.0.smithi184.stdout: in thread 7fda637fe700 thread_name:rados_async 2021-09-15T22:27:03.902 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 2021-09-15T22:27:03.902 INFO:tasks.rgw.c2.client.0.smithi184.stdout: ceph version 15.2.14-69-g3bb6dfef (3bb6dfef60c759eba3da031acb0f1cd05ff3875f) octopus (stable) 2021-09-15T22:27:03.902 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 1: (()+0x46210) [0x7fda9af6a210] 2021-09-15T22:27:03.903 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 2: (rgw::putobj::ETagVerifier_MPU::process(ceph::buffer::v15_2_0::list&&, unsigned long)+0x44) [0x7fda9bbd39d4] 2021-09-15T22:27:03.903 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 3: (RGWRados::fetch_remote_obj(RGWObjectCtx&, rgw_user const&, req_info*, rgw_zone_id const&, rgw_obj const&, rgw_obj const&, RGWBucketInfo const&, RGWBucketInfo const*, std::optional, std::chrono::time_point > >*, std::chrono::time_point > >*, std::chrono::time_point > > const*, std::chrono::time_point > > const*, bool, char const*, char const*, RGWRados::AttrsMod, bool, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >&, RGWObjCategory, std::optional, std::chrono::time_point > >, std::__cxx11::basic_string, std::allocator >*, std::__cxx11::basic_string, std::allocator >*, void (*)(long, void*), void*, DoutPrefixProvider const*, RGWFetchObjFilter*, rgw_zone_set*, std::optional*)+0xf87) [0x7fda9ba0b067] 2021-09-15T22:27:03.903 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 4: (RGWAsyncFetchRemoteObj::_send_request()+0x4d6) [0x7fda9b938f06] 2021-09-15T22:27:03.904 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 5: (RGWAsyncRadosProcessor::handle_request(RGWAsyncRadosRequest*)+0x25) [0x7fda9b9330e5] 2021-09-15T22:27:03.904 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 6: (RGWAsyncRadosProcessor::RGWWQ::_process(RGWAsyncRadosRequest*, ThreadPool::TPHandle&)+0x11) [0x7fda9b93b3e1] 2021-09-15T22:27:03.904 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 7: (ThreadPool::worker(ThreadPool::WorkThread*)+0x5bb) [0x7fda9227dc1b] 2021-09-15T22:27:03.904 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 8: (ThreadPool::WorkThread::entry()+0x15) [0x7fda9227ece5] 2021-09-15T22:27:03.905 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 9: (()+0x9609) [0x7fda91dda609] 2021-09-15T22:27:03.905 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 10: (clone()+0x43) [0x7fda9b046293] 2021-09-15T22:27:03.905 INFO:tasks.rgw.c2.client.0.smithi184.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-09-15T22:27:03.905 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 2021-09-15T22:27:03.918 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 0> 2021-09-15T22:27:03.894+0000 7fda637fe700 -1 *** Caught signal (Segmentation fault) ** 2021-09-15T22:27:03.918 INFO:tasks.rgw.c2.client.0.smithi184.stdout: in thread 7fda637fe700 thread_name:rados_async 2021-09-15T22:27:03.918 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 2021-09-15T22:27:03.918 INFO:tasks.rgw.c2.client.0.smithi184.stdout: ceph version 15.2.14-69-g3bb6dfef (3bb6dfef60c759eba3da031acb0f1cd05ff3875f) octopus (stable) 2021-09-15T22:27:03.919 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 1: (()+0x46210) [0x7fda9af6a210] 2021-09-15T22:27:03.919 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 2: (rgw::putobj::ETagVerifier_MPU::process(ceph::buffer::v15_2_0::list&&, unsigned long)+0x44) [0x7fda9bbd39d4] 2021-09-15T22:27:03.919 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 3: (RGWRados::fetch_remote_obj(RGWObjectCtx&, rgw_user const&, req_info*, rgw_zone_id const&, rgw_obj const&, rgw_obj const&, RGWBucketInfo const&, RGWBucketInfo const*, std::optional, std::chrono::time_point > >*, std::chrono::time_point > >*, std::chrono::time_point > > const*, std::chrono::time_point > > const*, bool, char const*, char const*, RGWRados::AttrsMod, bool, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >&, RGWObjCategory, std::optional, std::chrono::time_point > >, std::__cxx11::basic_string, std::allocator >*, std::__cxx11::basic_string, std::allocator >*, void (*)(long, void*), void*, DoutPrefixProvider const*, RGWFetchObjFilter*, rgw_zone_set*, std::optional*)+0xf87) [0x7fda9ba0b067] 2021-09-15T22:27:03.919 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 4: (RGWAsyncFetchRemoteObj::_send_request()+0x4d6) [0x7fda9b938f06] 2021-09-15T22:27:03.920 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 5: (RGWAsyncRadosProcessor::handle_request(RGWAsyncRadosRequest*)+0x25) [0x7fda9b9330e5] 2021-09-15T22:27:03.920 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 6: (RGWAsyncRadosProcessor::RGWWQ::_process(RGWAsyncRadosRequest*, ThreadPool::TPHandle&)+0x11) [0x7fda9b93b3e1] 2021-09-15T22:27:03.920 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 7: (ThreadPool::worker(ThreadPool::WorkThread*)+0x5bb) [0x7fda9227dc1b] 2021-09-15T22:27:03.920 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 8: (ThreadPool::WorkThread::entry()+0x15) [0x7fda9227ece5] 2021-09-15T22:27:03.921 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 9: (()+0x9609) [0x7fda91dda609] 2021-09-15T22:27:03.921 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 10: (clone()+0x43) [0x7fda9b046293] 2021-09-15T22:27:03.921 INFO:tasks.rgw.c2.client.0.smithi184.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-09-15T22:27:03.921 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 2021-09-15T22:27:03.933 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 0> 2021-09-15T22:27:03.894+0000 7fda637fe700 -1 *** Caught signal (Segmentation fault) ** 2021-09-15T22:27:03.933 INFO:tasks.rgw.c2.client.0.smithi184.stdout: in thread 7fda637fe700 thread_name:rados_async 2021-09-15T22:27:03.933 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 2021-09-15T22:27:03.934 INFO:tasks.rgw.c2.client.0.smithi184.stdout: ceph version 15.2.14-69-g3bb6dfef (3bb6dfef60c759eba3da031acb0f1cd05ff3875f) octopus (stable) 2021-09-15T22:27:03.934 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 1: (()+0x46210) [0x7fda9af6a210] 2021-09-15T22:27:03.934 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 2: (rgw::putobj::ETagVerifier_MPU::process(ceph::buffer::v15_2_0::list&&, unsigned long)+0x44) [0x7fda9bbd39d4] 2021-09-15T22:27:03.934 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 3: (RGWRados::fetch_remote_obj(RGWObjectCtx&, rgw_user const&, req_info*, rgw_zone_id const&, rgw_obj const&, rgw_obj const&, RGWBucketInfo const&, RGWBucketInfo const*, std::optional, std::chrono::time_point > >*, std::chrono::time_point > >*, std::chrono::time_point > > const*, std::chrono::time_point > > const*, bool, char const*, char const*, RGWRados::AttrsMod, bool, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >&, RGWObjCategory, std::optional, std::chrono::time_point > >, std::__cxx11::basic_string, std::allocator >*, std::__cxx11::basic_string, std::allocator >*, void (*)(long, void*), void*, DoutPrefixProvider const*, RGWFetchObjFilter*, rgw_zone_set*, std::optional*)+0xf87) [0x7fda9ba0b067] 2021-09-15T22:27:03.935 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 4: (RGWAsyncFetchRemoteObj::_send_request()+0x4d6) [0x7fda9b938f06] 2021-09-15T22:27:03.935 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 5: (RGWAsyncRadosProcessor::handle_request(RGWAsyncRadosRequest*)+0x25) [0x7fda9b9330e5] 2021-09-15T22:27:03.935 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 6: (RGWAsyncRadosProcessor::RGWWQ::_process(RGWAsyncRadosRequest*, ThreadPool::TPHandle&)+0x11) [0x7fda9b93b3e1] 2021-09-15T22:27:03.935 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 7: (ThreadPool::worker(ThreadPool::WorkThread*)+0x5bb) [0x7fda9227dc1b] 2021-09-15T22:27:03.936 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 8: (ThreadPool::WorkThread::entry()+0x15) [0x7fda9227ece5] 2021-09-15T22:27:03.936 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 9: (()+0x9609) [0x7fda91dda609] 2021-09-15T22:27:03.936 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 10: (clone()+0x43) [0x7fda9b046293] 2021-09-15T22:27:03.936 INFO:tasks.rgw.c2.client.0.smithi184.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-09-15T22:27:03.937 INFO:tasks.rgw.c2.client.0.smithi184.stdout: 2021-09-15T22:27:03.945 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:03.945 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:04.004 INFO:tasks.rgw.c2.client.0.smithi184.stderr:daemon-helper: command crashed with signal 11 2021-09-15T22:27:04.151 INFO:teuthology.orchestra.run.smithi180.stdout:{"markers":[{"key":0,"val":"00000000001.102.5"},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":"00000000001.48.5"},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":"00000000005.77.5"},{"key":10,"val":""}]} 2021-09-15T22:27:04.152 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-66 2021-09-15T22:27:04.152 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-66', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:04.153 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'hankqd-66', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:04.153 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket hankqd-66 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:04.199 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:04.199 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:04.411 INFO:teuthology.orchestra.run.smithi184.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.102.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.48.5"}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000005.77.5"}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-09-15T22:27:04.412 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=hankqd-66 2021-09-15T22:27:04.491 INFO:tasks.rgw_multisite_tests:test object creation notifications in using put/copy/post ... ok 2021-09-15T22:27:04.493 INFO:tasks.rgw_multisite_tests:test object creation s3 notifications in using put/copy/post on master ... ok 2021-09-15T22:27:04.493 INFO:tasks.rgw_multisite_tests:test multipart object upload on master ... ok 2021-09-15T22:27:04.494 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:04.494 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:04.495 DEBUG:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:04.532 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:04.532 INFO:teuthology.orchestra.run.smithi180.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:04.700 INFO:teuthology.orchestra.run.smithi180.stderr:No --period given, using current period=fc8d61ff-709a-4d9b-a65c-86a8ab621cb2 2021-09-15T22:27:04.727 INFO:teuthology.orchestra.run.smithi180.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1631744824.473069_274.1","last_update":"2021-09-15T22:27:04.473069Z"},{"marker":"","last_update":"0.000000"}] 2021-09-15T22:27:04.727 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-09-15T22:27:04.727 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:04.728 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:04.728 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:04.769 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:04.769 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:04.969 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:27:04.969 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:27:06.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2021-09-15T22:27:09.970 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:09.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:09.971 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:10.012 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:10.012 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:10.210 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:27:10.210 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:27:12.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~6s 2021-09-15T22:27:15.212 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:15.213 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:15.213 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:15.253 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:15.253 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:15.451 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:27:15.452 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:27:17.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~11s 2021-09-15T22:27:20.453 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:20.453 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:20.454 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:20.495 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:20.496 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:20.695 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:27:20.695 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:27:23.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~17s 2021-09-15T22:27:25.697 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:25.697 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:25.698 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:25.740 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:25.740 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:25.951 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:27:25.951 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:27:28.910 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~22s 2021-09-15T22:27:30.952 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:30.953 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:30.954 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:30.992 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:30.993 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:31.200 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:27:31.200 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:27:34.516 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~28s 2021-09-15T22:27:36.201 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:36.202 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:36.203 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:36.243 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:36.243 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:36.437 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:27:36.438 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:27:40.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~34s 2021-09-15T22:27:41.439 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:41.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:41.441 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:41.480 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:41.480 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:41.692 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:27:41.693 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:27:45.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~39s 2021-09-15T22:27:46.694 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:46.695 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:46.696 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:46.735 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:46.735 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:46.950 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:27:46.950 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:27:51.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~45s 2021-09-15T22:27:51.951 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:51.952 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:51.953 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:51.992 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:51.992 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:52.203 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:27:52.204 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:27:56.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~50s 2021-09-15T22:27:57.205 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:57.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:27:57.207 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:27:57.246 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:27:57.246 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:27:57.478 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:27:57.478 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:28:02.479 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:02.480 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:02.481 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:28:02.520 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:28:02.521 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:28:02.540 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~56s 2021-09-15T22:28:02.726 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:28:02.727 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:28:07.728 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:07.729 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:07.729 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:28:07.769 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:28:07.770 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:28:07.979 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:28:07.979 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:28:08.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~62s 2021-09-15T22:28:12.981 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:12.982 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:12.983 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:28:13.023 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:28:13.023 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:28:13.232 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:28:13.232 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:28:13.751 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~67s 2021-09-15T22:28:18.233 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:18.234 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:18.235 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:28:18.275 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:28:18.276 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:28:18.482 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:28:18.483 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:28:19.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~73s 2021-09-15T22:28:23.484 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:23.485 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:23.485 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:28:23.526 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:28:23.527 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:28:23.734 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:28:23.735 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:28:24.962 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~78s 2021-09-15T22:28:28.737 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:28.737 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:28.738 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:28:28.776 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:28:28.776 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:28:28.987 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:28:28.988 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:28:30.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~84s 2021-09-15T22:28:33.990 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:33.990 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:33.991 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:28:34.031 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:28:34.031 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:28:34.246 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:28:34.247 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:28:36.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~90s 2021-09-15T22:28:39.248 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:39.249 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:39.250 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:28:39.289 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:28:39.289 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:28:39.499 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:28:39.500 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:28:41.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~95s 2021-09-15T22:28:44.500 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:44.501 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:44.502 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:28:44.542 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:28:44.542 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:28:44.746 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:28:44.747 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:28:47.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~101s 2021-09-15T22:28:49.748 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:49.749 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:49.749 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:28:49.790 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:28:49.790 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:28:50.013 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:28:50.013 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:28:52.987 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~106s 2021-09-15T22:28:55.015 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:55.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:28:55.016 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:28:55.057 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:28:55.057 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:28:55.290 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:28:55.291 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:28:58.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~112s 2021-09-15T22:29:00.292 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:00.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:00.294 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:29:00.333 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:29:00.333 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:29:00.535 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:29:00.536 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:29:04.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~118s 2021-09-15T22:29:05.537 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:05.538 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:05.539 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:29:05.579 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:29:05.580 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:29:05.792 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:29:05.793 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:29:09.804 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~123s 2021-09-15T22:29:10.794 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:10.795 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:10.795 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:29:10.836 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:29:10.837 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:29:11.068 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:29:11.069 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:29:15.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~129s 2021-09-15T22:29:16.070 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:16.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:16.072 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:29:16.111 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:29:16.112 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:29:16.325 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:29:16.325 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:29:21.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~135s 2021-09-15T22:29:21.327 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:21.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:21.328 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:29:21.371 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:29:21.371 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:29:21.583 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:29:21.584 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:29:26.585 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:26.586 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:26.587 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:29:26.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~140s 2021-09-15T22:29:26.625 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:29:26.625 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:29:26.854 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:29:26.854 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:29:31.856 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:31.857 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:31.857 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:29:31.896 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:29:31.896 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:29:32.111 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:29:32.112 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:29:32.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~146s 2021-09-15T22:29:37.114 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:37.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:37.115 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:29:37.153 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:29:37.153 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:29:37.386 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:29:37.387 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:29:37.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~151s 2021-09-15T22:29:42.388 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:42.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:42.389 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:29:42.430 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:29:42.430 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:29:42.635 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:29:42.636 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:29:43.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~157s 2021-09-15T22:29:47.637 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:47.638 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:47.638 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:29:47.679 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:29:47.679 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:29:47.893 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:29:47.894 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:29:49.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~163s 2021-09-15T22:29:52.896 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:52.896 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:52.897 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:29:52.936 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:29:52.936 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:29:53.141 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:29:53.141 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:29:54.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~168s 2021-09-15T22:29:58.142 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:58.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:29:58.144 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:29:58.183 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:29:58.183 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:29:58.390 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:29:58.391 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:30:00.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~174s 2021-09-15T22:30:03.392 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:03.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:03.394 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:30:03.431 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:30:03.431 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:30:03.645 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:30:03.645 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:30:05.856 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~179s 2021-09-15T22:30:08.647 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:08.648 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:08.649 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:30:08.688 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:30:08.689 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:30:08.903 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:30:08.904 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:30:11.461 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~185s 2021-09-15T22:30:13.906 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:13.906 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:13.907 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:30:13.947 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:30:13.947 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:30:14.164 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:30:14.165 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:30:17.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~191s 2021-09-15T22:30:19.166 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:19.167 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:19.168 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:30:19.207 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:30:19.208 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:30:19.427 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:30:19.428 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:30:22.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~196s 2021-09-15T22:30:24.429 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:24.430 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:24.430 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:30:24.469 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:30:24.469 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:30:24.688 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:30:24.688 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:30:28.279 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~202s 2021-09-15T22:30:29.689 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:29.690 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:29.690 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:30:29.731 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:30:29.731 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:30:29.945 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:30:29.945 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:30:33.884 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~207s 2021-09-15T22:30:34.947 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:34.947 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:34.948 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:30:34.986 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:30:34.987 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:30:35.219 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:30:35.219 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:30:39.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~213s 2021-09-15T22:30:40.220 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:40.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:40.222 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:30:40.260 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:30:40.260 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:30:40.483 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:30:40.483 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:30:45.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~219s 2021-09-15T22:30:45.485 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:45.486 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:45.486 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:30:45.524 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:30:45.525 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:30:45.746 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:30:45.747 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:30:50.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~224s 2021-09-15T22:30:50.749 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:50.749 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:50.750 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:30:50.790 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:30:50.790 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:30:51.012 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:30:51.012 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:30:56.013 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:56.014 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:30:56.015 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:30:56.055 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:30:56.055 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:30:56.288 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:30:56.288 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:30:56.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~230s 2021-09-15T22:31:01.290 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:01.291 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:01.291 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:31:01.331 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:31:01.331 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:31:01.534 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:31:01.535 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:31:01.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~235s 2021-09-15T22:31:06.536 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:06.537 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:06.537 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:31:06.576 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:31:06.576 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:31:06.781 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:31:06.782 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:31:07.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~241s 2021-09-15T22:31:11.783 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:11.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:11.784 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:31:11.824 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:31:11.825 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:31:12.037 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:31:12.037 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:31:13.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~247s 2021-09-15T22:31:17.038 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:17.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:17.040 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:31:17.079 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:31:17.079 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:31:17.296 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:31:17.297 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:31:18.722 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~252s 2021-09-15T22:31:22.298 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:22.299 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:22.299 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:31:22.341 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:31:22.341 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:31:22.547 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:31:22.547 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:31:24.327 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~258s 2021-09-15T22:31:27.549 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:27.549 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:27.550 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:31:27.590 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:31:27.591 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:31:27.809 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:31:27.809 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:31:29.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~263s 2021-09-15T22:31:32.810 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:32.811 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:32.812 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:31:32.853 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:31:32.853 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:31:33.065 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:31:33.065 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:31:35.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~269s 2021-09-15T22:31:38.067 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:38.068 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:38.069 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:31:38.110 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:31:38.111 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:31:38.337 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:31:38.338 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:31:41.142 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~275s 2021-09-15T22:31:43.339 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:43.340 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:43.341 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:31:43.381 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:31:43.381 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:31:43.604 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:31:43.604 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:31:46.747 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~280s 2021-09-15T22:31:48.606 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:48.607 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:48.607 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:31:48.648 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:31:48.648 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:31:48.859 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:31:48.859 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:31:52.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~286s 2021-09-15T22:31:53.861 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:53.862 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:53.863 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:31:53.903 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:31:53.903 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:31:54.114 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:31:54.115 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:31:57.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~291s 2021-09-15T22:31:59.116 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:59.117 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:31:59.118 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:31:59.157 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:31:59.158 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:31:59.367 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:31:59.384 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:32:03.562 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~297s 2021-09-15T22:32:04.386 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:32:04.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:32:04.388 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:32:04.425 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:32:04.426 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:32:04.623 INFO:teuthology.orchestra.run.smithi184.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"fc8d61ff-709a-4d9b-a65c-86a8ab621cb2","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1631743817.278003_20.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-09-15T22:10:17.278003Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1631744823.095559_272.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:27:03.095559Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1631743950.486515_127.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-09-15T22:12:30.486515Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-09-15T22:32:04.624 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1631744824.473069_274.1 target=1_1631744823.095559_272.1 2021-09-15T22:32:09.167 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~303s 2021-09-15T22:32:09.168 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2021-09-15T22:32:09.625 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:32:09.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-09-15T22:32:09.627 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-09-15T22:32:09.667 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setuser ceph since I am not root 2021-09-15T22:32:09.667 INFO:teuthology.orchestra.run.smithi184.stderr:ignoring --setgroup ceph since I am not root 2021-09-15T22:32:09.771 INFO:tasks.ceph.c2.osd.0:Sent signal 15 2021-09-15T22:32:09.774 INFO:tasks.ceph.c2.osd.1:Sent signal 15 2021-09-15T22:32:09.774 INFO:tasks.ceph.c2.osd.2:Sent signal 15 2021-09-15T22:32:09.775 INFO:tasks.ceph.c2.mon.a:Sent signal 15 2021-09-15T22:32:09.775 INFO:tasks.rgw.c2.client.1:Sent signal 15 2021-09-15T22:32:09.776 INFO:tasks.ceph.c2.mgr.x:Sent signal 15 2021-09-15T22:32:09.777 INFO:tasks.ceph.c2.osd.0.smithi184.stderr:2021-09-15T22:32:09.771+0000 7f56c6ffd700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster c2 -i 0 (PID: 12128) UID: 0 2021-09-15T22:32:09.777 INFO:tasks.ceph.c2.osd.0.smithi184.stderr:2021-09-15T22:32:09.771+0000 7f56c6ffd700 -1 osd.0 64 *** Got signal Terminated *** 2021-09-15T22:32:09.777 INFO:tasks.ceph.c2.osd.0.smithi184.stderr:2021-09-15T22:32:09.771+0000 7f56c6ffd700 -1 osd.0 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-09-15T22:32:09.778 INFO:tasks.ceph.c2.osd.1.smithi184.stderr:2021-09-15T22:32:09.771+0000 7fadc288b700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster c2 -i 1 (PID: 12131) UID: 0 2021-09-15T22:32:09.778 INFO:tasks.ceph.c2.osd.1.smithi184.stderr:2021-09-15T22:32:09.771+0000 7fadc288b700 -1 osd.1 64 *** Got signal Terminated *** 2021-09-15T22:32:09.778 INFO:tasks.ceph.c2.osd.1.smithi184.stderr:2021-09-15T22:32:09.771+0000 7fadc288b700 -1 osd.1 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-09-15T22:32:09.779 INFO:tasks.ceph.c2.osd.2.smithi184.stderr:2021-09-15T22:32:09.775+0000 7fa905607700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster c2 -i 2 (PID: 12133) UID: 0 2021-09-15T22:32:09.779 INFO:tasks.ceph.c2.osd.2.smithi184.stderr:2021-09-15T22:32:09.775+0000 7fa905607700 -1 osd.2 64 *** Got signal Terminated *** 2021-09-15T22:32:09.779 INFO:tasks.ceph.c2.osd.2.smithi184.stderr:2021-09-15T22:32:09.775+0000 7fa905607700 -1 osd.2 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-09-15T22:32:09.780 INFO:tasks.ceph.c2.mon.a.smithi184.stderr:2021-09-15T22:32:09.775+0000 7f600e91b700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster c2 -i a (PID: 11943) UID: 0 2021-09-15T22:32:09.780 INFO:tasks.ceph.c2.mon.a.smithi184.stderr:2021-09-15T22:32:09.775+0000 7f600e91b700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-09-15T22:32:09.781 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:32:09.775+0000 7f53293e7700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 26907) UID: 0 2021-09-15T22:32:09.781 INFO:tasks.rgw.c2.client.1.smithi184.stdout:2021-09-15T22:32:09.775+0000 7f532d7c1980 -1 shutting down 2021-09-15T22:32:09.782 INFO:tasks.ceph.c2.mgr.x.smithi184.stderr:2021-09-15T22:32:09.775+0000 7fde83b8a700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mgr -f --cluster c2 -i x (PID: 11945) UID: 0 2021-09-15T22:32:09.782 INFO:tasks.ceph.c2.mgr.x.smithi184.stderr:2021-09-15T22:32:09.775+0000 7fde83b8a700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2021-09-16T09:58:51.819 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-09-16T09:58:51.846 DEBUG:teuthology.task.console_log:Killing console logger for smithi180 2021-09-16T09:58:51.848 DEBUG:teuthology.task.console_log:Killing console logger for smithi184 2021-09-16T09:58:51.849 DEBUG:teuthology.exit:Finished running handlers